Aug 27 02:15:55 user nova-compute[72820]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 27 02:15:58 user nova-compute[72820]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72820) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72820) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72820) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 27 02:15:58 user nova-compute[72820]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:15:58 user nova-compute[72820]: INFO nova.virt.driver [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 27 02:15:58 user nova-compute[72820]: INFO nova.compute.provider_config [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] Acquiring lock "singleton_lock" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] Acquired lock "singleton_lock" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] Releasing lock "singleton_lock" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] Full set of CONF: {{(pid=72820) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ******************************************************************************** {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] Configuration options gathered from: {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ================================================================================ {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] allow_resize_to_same_host      = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] arq_binding_timeout            = 300 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] backdoor_port                  = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] backdoor_socket                = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] block_device_allocate_retries  = 300 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] block_device_allocate_retries_interval = 5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cert                           = self.pem {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] compute_monitors               = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] config_dir                     = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] config_drive_format            = iso9660 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] config_source                  = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] console_host                   = user {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] control_exchange               = nova {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cpu_allocation_ratio           = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] daemon                         = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] debug                          = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] default_access_ip_network_name = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] default_availability_zone      = nova {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] default_ephemeral_format       = ext4 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] default_green_pool_size        = 1000 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] default_schedule_zone          = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] disk_allocation_ratio          = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] enable_new_services            = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] enabled_ssl_apis               = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] flat_injected                  = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] force_config_drive             = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] force_raw_images               = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] graceful_shutdown_timeout      = 5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] heal_instance_info_cache_interval = 60 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] host                           = user {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] instance_build_timeout         = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] instance_delete_interval       = 300 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] instance_name_template         = instance-%08x {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] instance_usage_audit           = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] instance_usage_audit_period    = month {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] internal_service_availability_zone = internal {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] key                            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] live_migration_retry_count     = 30 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] log_config_append              = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] log_dir                        = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] log_file                       = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] log_options                    = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] log_rotate_interval            = 1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] log_rotate_interval_type       = days {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] log_rotation_type              = none {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] long_rpc_timeout               = 1800 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] max_concurrent_builds          = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] max_concurrent_live_migrations = 1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] max_concurrent_snapshots       = 5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] max_local_block_devices        = 3 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] max_logfile_count              = 30 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] max_logfile_size_mb            = 200 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] maximum_instance_delete_attempts = 5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] metadata_listen                = 0.0.0.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] metadata_listen_port           = 8775 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] metadata_workers               = 3 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] migrate_max_retries            = -1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] mkisofs_cmd                    = genisoimage {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] my_ip                          = 10.0.0.210 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] network_allocate_retries       = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] osapi_compute_listen_port      = 8774 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] osapi_compute_unique_server_name_scope =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] osapi_compute_workers          = 3 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] password_length                = 12 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] periodic_enable                = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] periodic_fuzzy_delay           = 60 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] pointer_model                  = ps2mouse {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] preallocate_images             = none {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] publish_errors                 = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] pybasedir                      = /opt/stack/nova {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ram_allocation_ratio           = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] rate_limit_burst               = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] rate_limit_except_level        = CRITICAL {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] rate_limit_interval            = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] reboot_timeout                 = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] reclaim_instance_interval      = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] record                         = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] reimage_timeout_per_gb         = 60 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] report_interval                = 120 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] rescue_timeout                 = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] reserved_host_cpus             = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] reserved_host_disk_mb          = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] reserved_host_memory_mb        = 512 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] reserved_huge_pages            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] resize_confirm_window          = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] resize_fs_using_block_device   = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] resume_guests_state_on_host_boot = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] rpc_response_timeout           = 60 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] run_external_periodic_tasks    = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] running_deleted_instance_action = reap {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] running_deleted_instance_timeout = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] scheduler_instance_sync_interval = 120 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] service_down_time              = 720 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] servicegroup_driver            = db {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] shelved_offload_time           = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] shelved_poll_interval          = 3600 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] shutdown_timeout               = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] source_is_ipv6                 = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ssl_only                       = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] state_path                     = /opt/stack/data/nova {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] sync_power_state_interval      = 600 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] sync_power_state_pool_size     = 1000 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] syslog_log_facility            = LOG_USER {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] tempdir                        = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] timeout_nbd                    = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] transport_url                  = **** {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] update_resources_interval      = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] use_cow_images                 = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] use_eventlog                   = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] use_journal                    = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] use_json                       = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] use_rootwrap_daemon            = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] use_stderr                     = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] use_syslog                     = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vcpu_pin_set                   = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vif_plugging_is_fatal          = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vif_plugging_timeout           = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] virt_mkfs                      = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] volume_usage_poll_interval     = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] watch_log_file                 = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] web                            = /usr/share/spice-html5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_concurrency.disable_process_locking = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.auth_strategy              = keystone {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.compute_link_prefix        = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.dhcp_domain                = novalocal {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.enable_instance_password   = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.glance_link_prefix         = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.instance_list_per_project_cells = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.list_records_by_skipping_down_cells = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.local_metadata_per_cell    = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.max_limit                  = 1000 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.metadata_cache_expiration  = 15 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.neutron_default_tenant_id  = default {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.use_forwarded_for          = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.use_neutron_default_nets   = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.vendordata_dynamic_targets = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.vendordata_jsonfile_path   = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.backend_argument         = **** {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.config_prefix            = cache.oslo {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.dead_timeout             = 60.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.debug_cache_backend      = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.enable_retry_client      = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.enable_socket_keepalive  = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.enabled                  = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.expiration_time          = 600 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.hashclient_retry_attempts = 2 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.memcache_dead_retry      = 300 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.memcache_password        =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.memcache_sasl_enabled    = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.memcache_username        =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.proxies                  = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.retry_attempts           = 2 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.retry_delay              = 0.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.socket_keepalive_count   = 1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.socket_keepalive_idle    = 1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.socket_keepalive_interval = 1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.tls_allowed_ciphers      = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.tls_cafile               = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.tls_certfile             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.tls_enabled              = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cache.tls_keyfile              = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cinder.auth_section            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cinder.auth_type               = password {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cinder.cafile                  = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cinder.certfile                = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cinder.collect_timing          = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cinder.cross_az_attach         = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cinder.debug                   = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cinder.endpoint_template       = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cinder.http_retries            = 3 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cinder.insecure                = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cinder.keyfile                 = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cinder.os_region_name          = RegionOne {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cinder.split_loggers           = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cinder.timeout                 = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] compute.cpu_dedicated_set      = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] compute.cpu_shared_set         = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] compute.image_type_exclude_list = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] compute.resource_provider_association_refresh = 300 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] compute.shutdown_retry_interval = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] conductor.workers              = 3 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] console.allowed_origins        = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] console.ssl_ciphers            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] console.ssl_minimum_version    = default {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] consoleauth.token_ttl          = 600 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.cafile                  = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.certfile                = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.collect_timing          = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.connect_retries         = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.connect_retry_delay     = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.endpoint_override       = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.insecure                = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.keyfile                 = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.max_version             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.min_version             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.region_name             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.service_name            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.service_type            = accelerator {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.split_loggers           = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.status_code_retries     = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.status_code_retry_delay = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.timeout                 = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] cyborg.version                 = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.backend               = sqlalchemy {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.connection            = **** {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.connection_debug      = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.connection_parameters =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.connection_recycle_time = 3600 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.connection_trace      = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.db_inc_retry_interval = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.db_max_retries        = 20 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.db_max_retry_interval = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.db_retry_interval     = 1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.max_overflow          = 50 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.max_pool_size         = 5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.max_retries           = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.mysql_enable_ndb      = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.mysql_wsrep_sync_wait = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.pool_timeout          = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.retry_interval        = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.slave_connection      = **** {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] database.sqlite_synchronous    = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.backend           = sqlalchemy {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.connection        = **** {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.connection_debug  = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.connection_parameters =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.connection_recycle_time = 3600 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.connection_trace  = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.db_inc_retry_interval = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.db_max_retries    = 20 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.db_max_retry_interval = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.db_retry_interval = 1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.max_overflow      = 50 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.max_pool_size     = 5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.max_retries       = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.mysql_enable_ndb  = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.pool_timeout      = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.retry_interval    = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.slave_connection  = **** {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] api_database.sqlite_synchronous = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] devices.enabled_mdev_types     = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ephemeral_storage_encryption.enabled = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.api_servers             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.cafile                  = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.certfile                = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.collect_timing          = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.connect_retries         = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.connect_retry_delay     = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.debug                   = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.default_trusted_certificate_ids = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.enable_certificate_validation = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.enable_rbd_download     = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.endpoint_override       = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.insecure                = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.keyfile                 = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.max_version             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.min_version             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.num_retries             = 3 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.rbd_ceph_conf           =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.rbd_connect_timeout     = 5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.rbd_pool                =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.rbd_user                =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.region_name             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.service_name            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.service_type            = image {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.split_loggers           = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.status_code_retries     = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.status_code_retry_delay = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.timeout                 = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.verify_glance_signatures = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] glance.version                 = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] guestfs.debug                  = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] hyperv.config_drive_cdrom      = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] hyperv.config_drive_inject_password = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] hyperv.enable_remotefx         = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] hyperv.instances_path_share    =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] hyperv.limit_cpu_features      = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] hyperv.use_multipath_io        = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] hyperv.vswitch_name            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] mks.enabled                    = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] image_cache.manager_interval   = 2400 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] image_cache.precache_concurrency = 1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] image_cache.remove_unused_base_images = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] image_cache.subdirectory_name  = _base {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.api_max_retries         = 60 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.api_retry_interval      = 2 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.auth_section            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.auth_type               = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.cafile                  = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.certfile                = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.collect_timing          = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.connect_retries         = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.connect_retry_delay     = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.endpoint_override       = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.insecure                = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.keyfile                 = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.max_version             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.min_version             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.partition_key           = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.peer_list               = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.region_name             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.serial_console_state_timeout = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.service_name            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.service_type            = baremetal {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.split_loggers           = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.status_code_retries     = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.status_code_retry_delay = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.timeout                 = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ironic.version                 = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] key_manager.fixed_key          = **** {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican.barbican_api_version  = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican.barbican_endpoint     = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican.barbican_endpoint_type = public {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican.barbican_region_name  = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican.cafile                = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican.certfile              = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican.collect_timing        = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican.insecure              = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican.keyfile               = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican.number_of_retries     = 60 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican.retry_delay           = 1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican.send_service_user_token = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican.split_loggers         = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican.timeout               = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican.verify_ssl            = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican.verify_ssl_path       = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican_service_user.auth_section = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican_service_user.auth_type = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican_service_user.cafile   = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican_service_user.certfile = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican_service_user.collect_timing = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican_service_user.insecure = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican_service_user.keyfile  = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican_service_user.split_loggers = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] barbican_service_user.timeout  = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vault.approle_role_id          = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vault.approle_secret_id        = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vault.cafile                   = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vault.certfile                 = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vault.collect_timing           = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vault.insecure                 = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vault.keyfile                  = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vault.kv_mountpoint            = secret {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vault.kv_version               = 2 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vault.namespace                = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vault.root_token_id            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vault.split_loggers            = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vault.ssl_ca_crt_file          = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vault.timeout                  = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vault.use_ssl                  = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.cafile                = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.certfile              = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.collect_timing        = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.connect_retries       = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.connect_retry_delay   = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.endpoint_override     = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.insecure              = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.keyfile               = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.max_version           = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.min_version           = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.region_name           = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.service_name          = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.service_type          = identity {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.split_loggers         = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.status_code_retries   = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.status_code_retry_delay = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.timeout               = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] keystone.version               = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.connection_uri         =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.cpu_mode               = custom {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: WARNING oslo_config.cfg [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.cpu_power_governor_high = performance {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.cpu_power_management   = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.device_detach_attempts = 8 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.device_detach_timeout  = 20 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.disk_cachemodes        = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.disk_prefix            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.enabled_perf_events    = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.file_backed_memory     = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.gid_maps               = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.hw_disk_discard        = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.hw_machine_type        = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.images_rbd_pool        = rbd {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.images_type            = default {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.images_volume_group    = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.inject_key             = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.inject_partition       = -2 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.inject_password        = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.iscsi_iface            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.iser_use_multipath     = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.live_migration_downtime = 500 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.live_migration_inbound_addr = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.live_migration_scheme  = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.live_migration_timeout_action = abort {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.live_migration_tunnelled = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: WARNING oslo_config.cfg [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 27 02:15:58 user nova-compute[72820]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 27 02:15:58 user nova-compute[72820]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 27 02:15:58 user nova-compute[72820]: and ``live_migration_inbound_addr`` respectively.
Aug 27 02:15:58 user nova-compute[72820]: ).  Its value may be silently ignored in the future.
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.live_migration_with_native_tls = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.max_queues             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.nfs_mount_options      = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.num_pcie_ports         = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.pmem_namespaces        = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.quobyte_client_cfg     = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.rbd_secret_uuid        = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.rbd_user               = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.rescue_image_id        = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.rescue_kernel_id       = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.rx_queue_size          = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.smbfs_mount_options    =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.snapshot_compression   = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.snapshot_image_format  = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.sparse_logical_volumes = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.swtpm_enabled          = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.swtpm_group            = tss {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.swtpm_user             = tss {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.sysinfo_serial         = unique {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.tb_cache_size          = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.tx_queue_size          = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.uid_maps               = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.use_virtio_for_bridges = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.virt_type              = kvm {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.volume_clear           = zero {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.volume_clear_size      = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.volume_use_multipath   = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.vzstorage_cache_path   = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.auth_section           = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.auth_type              = password {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.cafile                 = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.certfile               = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.collect_timing         = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.connect_retries        = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.connect_retry_delay    = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.default_floating_pool  = public {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.endpoint_override      = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.extension_sync_interval = 600 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.http_retries           = 3 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.insecure               = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.keyfile                = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.max_version            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.min_version            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.ovs_bridge             = br-int {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.physnets               = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.region_name            = RegionOne {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.service_metadata_proxy = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.service_name           = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.service_type           = network {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.split_loggers          = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.status_code_retries    = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.status_code_retry_delay = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.timeout                = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] neutron.version                = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] notifications.bdms_in_notifications = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] notifications.default_level    = INFO {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] notifications.notification_format = unversioned {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] notifications.notify_on_state_change = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] pci.alias                      = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] pci.device_spec                = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] pci.report_in_placement        = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.auth_section         = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.auth_type            = password {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.cafile               = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.certfile             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.collect_timing       = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.connect_retries      = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.connect_retry_delay  = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.default_domain_id    = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.default_domain_name  = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.domain_id            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.domain_name          = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.endpoint_override    = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.insecure             = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.keyfile              = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.max_version          = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.min_version          = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.password             = **** {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.project_domain_id    = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.project_domain_name  = Default {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.project_id           = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.project_name         = service {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.region_name          = RegionOne {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.service_name         = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.service_type         = placement {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.split_loggers        = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.status_code_retries  = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.status_code_retry_delay = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.system_scope         = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.timeout              = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.trust_id             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.user_domain_id       = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.user_domain_name     = Default {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.user_id              = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.username             = placement {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] placement.version              = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] quota.cores                    = 20 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] quota.count_usage_from_placement = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] quota.injected_file_content_bytes = 10240 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] quota.injected_file_path_length = 255 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] quota.injected_files           = 5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] quota.instances                = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] quota.key_pairs                = 100 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] quota.metadata_items           = 128 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] quota.ram                      = 51200 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] quota.recheck_quota            = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] quota.server_group_members     = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] quota.server_groups            = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] rdp.enabled                    = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] scheduler.image_metadata_prefilter = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] scheduler.max_attempts         = 3 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] scheduler.max_placement_results = 1000 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] scheduler.workers              = 3 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.host_subset_size = 1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.isolated_hosts = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.isolated_images = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.pci_in_placement = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.track_instance_changes = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] metrics.required               = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] metrics.weight_multiplier      = 1.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] metrics.weight_setting         = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] serial_console.enabled         = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] serial_console.port_range      = 10000:20000 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] serial_console.serialproxy_port = 6083 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] service_user.auth_section      = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] service_user.auth_type         = password {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] service_user.cafile            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] service_user.certfile          = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] service_user.collect_timing    = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] service_user.insecure          = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] service_user.keyfile           = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] service_user.send_service_user_token = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] service_user.split_loggers     = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] service_user.timeout           = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] spice.agent_enabled            = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] spice.enabled                  = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] spice.html5proxy_port          = 6082 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] spice.image_compression        = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] spice.jpeg_compression         = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] spice.playback_compression     = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] spice.server_listen            = 127.0.0.1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] spice.streaming_mode           = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] spice.zlib_compression         = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] upgrade_levels.baseapi         = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] upgrade_levels.cert            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] upgrade_levels.compute         = auto {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] upgrade_levels.conductor       = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] upgrade_levels.scheduler       = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vendordata_dynamic_auth.cafile = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vendordata_dynamic_auth.certfile = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vendordata_dynamic_auth.insecure = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vendordata_dynamic_auth.timeout = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.api_retry_count         = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.ca_file                 = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.cache_prefix            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.cluster_name            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.connection_pool_size    = 10 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.console_delay_seconds   = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.datastore_regex         = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.host_ip                 = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.host_password           = **** {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.host_port               = 443 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.host_username           = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.insecure                = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.integration_bridge      = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.maximum_objects         = 100 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.pbm_default_policy      = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.pbm_enabled             = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.pbm_wsdl_location       = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.serial_port_proxy_uri   = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.serial_port_service_uri = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.task_poll_interval      = 0.5 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.use_linked_clone        = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.vnc_keymap              = en-us {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.vnc_port                = 5900 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vmware.vnc_port_total          = 10000 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vnc.auth_schemes               = ['none'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vnc.enabled                    = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vnc.novncproxy_port            = 6080 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vnc.vencrypt_ca_certs          = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vnc.vencrypt_client_cert       = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vnc.vencrypt_client_key        = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.disable_rootwrap   = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.enable_numa_live_migration = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.libvirt_disable_apic = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] wsgi.client_socket_timeout     = 900 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] wsgi.default_pool_size         = 1000 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] wsgi.keep_alive                = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] wsgi.max_header_line           = 16384 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] wsgi.ssl_ca_file               = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] wsgi.ssl_cert_file             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] wsgi.ssl_key_file              = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] wsgi.tcp_keepidle              = 600 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] zvm.ca_file                    = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] zvm.cloud_connector_url        = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] zvm.reachable_timeout          = 300 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_policy.enforce_new_defaults = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_policy.enforce_scope      = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_policy.policy_default_rule = default {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] profiler.connection_string     = messaging:// {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] profiler.enabled               = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] profiler.es_doc_type           = notification {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] profiler.es_scroll_size        = 10000 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] profiler.es_scroll_time        = 2m {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] profiler.filter_error_trace    = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] profiler.hmac_keys             = **** {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] profiler.sentinel_service_name = mymaster {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] profiler.socket_timeout        = 0.1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] profiler.trace_requests        = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] profiler.trace_sqlalchemy      = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] profiler_jaeger.process_tags   = {} {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] profiler_jaeger.service_name_prefix = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] profiler_otlp.service_name_prefix = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] remote_debug.host              = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] remote_debug.port              = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_notifications.retry = -1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.auth_section        = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.auth_type           = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.cafile              = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.certfile            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.collect_timing      = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.connect_retries     = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.connect_retry_delay = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.endpoint_id         = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.endpoint_override   = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.insecure            = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.keyfile             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.max_version         = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.min_version         = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.region_name         = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.service_name        = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.service_type        = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.split_loggers       = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.status_code_retries = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.status_code_retry_delay = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.timeout             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.valid_interfaces    = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_limit.version             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_reports.file_event_handler = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] oslo_reports.log_dir           = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vif_plug_ovs_privileged.group  = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] vif_plug_ovs_privileged.user   = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] os_vif_ovs.isolate_vif         = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] os_brick.lock_path             = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] privsep_osbrick.capabilities   = [21] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] privsep_osbrick.group          = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] privsep_osbrick.helper_command = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] privsep_osbrick.user           = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] nova_sys_admin.group           = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] nova_sys_admin.helper_command  = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] nova_sys_admin.user            = None {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG oslo_service.service [None req-706a36b0-c683-4cf8-a852-64e787139e23 None None] ******************************************************************************** {{(pid=72820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 27 02:15:58 user nova-compute[72820]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 27 02:15:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Starting native event thread {{(pid=72820) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Starting green dispatch thread {{(pid=72820) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Starting connection event dispatch thread {{(pid=72820) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Connecting to libvirt: qemu:///system {{(pid=72820) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f75c4c46800> {{(pid=72820) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Aug 27 02:15:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f75c4c46800> {{(pid=72820) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Aug 27 02:15:58 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Connection event '1' reason 'None'
Aug 27 02:15:58 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 27 02:15:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.mount [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Initialising _HostMountState generation 0 {{(pid=72820) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 27 02:16:06 user nova-compute[72820]: INFO nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Libvirt host capabilities <capabilities>
Aug 27 02:16:06 user nova-compute[72820]:   <host>
Aug 27 02:16:06 user nova-compute[72820]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 27 02:16:06 user nova-compute[72820]:     <cpu>
Aug 27 02:16:06 user nova-compute[72820]:       <arch>x86_64</arch>
Aug 27 02:16:06 user nova-compute[72820]:       <model>IvyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <vendor>Intel</vendor>
Aug 27 02:16:06 user nova-compute[72820]:       <microcode version='1070'/>
Aug 27 02:16:06 user nova-compute[72820]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 27 02:16:06 user nova-compute[72820]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature name='ss'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature name='vmx'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature name='pcid'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature name='osxsave'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature name='hypervisor'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature name='arat'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature name='tsc_adjust'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature name='md-clear'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature name='stibp'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature name='arch-capabilities'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature name='ssbd'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature name='invtsc'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature name='rsba'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature name='skip-l1dfl-vmentry'/>
Aug 27 02:16:06 user nova-compute[72820]:       <pages unit='KiB' size='4'/>
Aug 27 02:16:06 user nova-compute[72820]:       <pages unit='KiB' size='2048'/>
Aug 27 02:16:06 user nova-compute[72820]:     </cpu>
Aug 27 02:16:06 user nova-compute[72820]:     <power_management>
Aug 27 02:16:06 user nova-compute[72820]:       <suspend_mem/>
Aug 27 02:16:06 user nova-compute[72820]:       <suspend_disk/>
Aug 27 02:16:06 user nova-compute[72820]:       <suspend_hybrid/>
Aug 27 02:16:06 user nova-compute[72820]:     </power_management>
Aug 27 02:16:06 user nova-compute[72820]:     <iommu support='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     <migration_features>
Aug 27 02:16:06 user nova-compute[72820]:       <live/>
Aug 27 02:16:06 user nova-compute[72820]:       <uri_transports>
Aug 27 02:16:06 user nova-compute[72820]:         <uri_transport>tcp</uri_transport>
Aug 27 02:16:06 user nova-compute[72820]:         <uri_transport>rdma</uri_transport>
Aug 27 02:16:06 user nova-compute[72820]:       </uri_transports>
Aug 27 02:16:06 user nova-compute[72820]:     </migration_features>
Aug 27 02:16:06 user nova-compute[72820]:     <topology>
Aug 27 02:16:06 user nova-compute[72820]:       <cells num='2'>
Aug 27 02:16:06 user nova-compute[72820]:         <cell id='0'>
Aug 27 02:16:06 user nova-compute[72820]:           <memory unit='KiB'>8140616</memory>
Aug 27 02:16:06 user nova-compute[72820]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 27 02:16:06 user nova-compute[72820]:           <pages unit='KiB' size='2048'>0</pages>
Aug 27 02:16:06 user nova-compute[72820]:           <distances>
Aug 27 02:16:06 user nova-compute[72820]:             <sibling id='0' value='10'/>
Aug 27 02:16:06 user nova-compute[72820]:             <sibling id='1' value='20'/>
Aug 27 02:16:06 user nova-compute[72820]:           </distances>
Aug 27 02:16:06 user nova-compute[72820]:           <cpus num='6'>
Aug 27 02:16:06 user nova-compute[72820]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 27 02:16:06 user nova-compute[72820]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 27 02:16:06 user nova-compute[72820]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 27 02:16:06 user nova-compute[72820]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 27 02:16:06 user nova-compute[72820]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 27 02:16:06 user nova-compute[72820]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 27 02:16:06 user nova-compute[72820]:           </cpus>
Aug 27 02:16:06 user nova-compute[72820]:         </cell>
Aug 27 02:16:06 user nova-compute[72820]:         <cell id='1'>
Aug 27 02:16:06 user nova-compute[72820]:           <memory unit='KiB'>8255068</memory>
Aug 27 02:16:06 user nova-compute[72820]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 27 02:16:06 user nova-compute[72820]:           <pages unit='KiB' size='2048'>0</pages>
Aug 27 02:16:06 user nova-compute[72820]:           <distances>
Aug 27 02:16:06 user nova-compute[72820]:             <sibling id='0' value='20'/>
Aug 27 02:16:06 user nova-compute[72820]:             <sibling id='1' value='10'/>
Aug 27 02:16:06 user nova-compute[72820]:           </distances>
Aug 27 02:16:06 user nova-compute[72820]:           <cpus num='6'>
Aug 27 02:16:06 user nova-compute[72820]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 27 02:16:06 user nova-compute[72820]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 27 02:16:06 user nova-compute[72820]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 27 02:16:06 user nova-compute[72820]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 27 02:16:06 user nova-compute[72820]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 27 02:16:06 user nova-compute[72820]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 27 02:16:06 user nova-compute[72820]:           </cpus>
Aug 27 02:16:06 user nova-compute[72820]:         </cell>
Aug 27 02:16:06 user nova-compute[72820]:       </cells>
Aug 27 02:16:06 user nova-compute[72820]:     </topology>
Aug 27 02:16:06 user nova-compute[72820]:     <cache>
Aug 27 02:16:06 user nova-compute[72820]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 27 02:16:06 user nova-compute[72820]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 27 02:16:06 user nova-compute[72820]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 27 02:16:06 user nova-compute[72820]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 27 02:16:06 user nova-compute[72820]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 27 02:16:06 user nova-compute[72820]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 27 02:16:06 user nova-compute[72820]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 27 02:16:06 user nova-compute[72820]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 27 02:16:06 user nova-compute[72820]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 27 02:16:06 user nova-compute[72820]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 27 02:16:06 user nova-compute[72820]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 27 02:16:06 user nova-compute[72820]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 27 02:16:06 user nova-compute[72820]:     </cache>
Aug 27 02:16:06 user nova-compute[72820]:     <secmodel>
Aug 27 02:16:06 user nova-compute[72820]:       <model>apparmor</model>
Aug 27 02:16:06 user nova-compute[72820]:       <doi>0</doi>
Aug 27 02:16:06 user nova-compute[72820]:     </secmodel>
Aug 27 02:16:06 user nova-compute[72820]:     <secmodel>
Aug 27 02:16:06 user nova-compute[72820]:       <model>dac</model>
Aug 27 02:16:06 user nova-compute[72820]:       <doi>0</doi>
Aug 27 02:16:06 user nova-compute[72820]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 27 02:16:06 user nova-compute[72820]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 27 02:16:06 user nova-compute[72820]:     </secmodel>
Aug 27 02:16:06 user nova-compute[72820]:   </host>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='alpha'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>64</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>clipper</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='armv6l'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>32</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>integratorcp</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>borzoi</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>spitz</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>nuri</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>musca-b1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>versatileab</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>kzm</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>musca-a</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>smdkc210</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>sx1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>z2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>tosa</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>sabrelite</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>realview-eb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>n810</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>n800</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>versatilepb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>terrier</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mainstone</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>midway</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>musicpal</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>microbit</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>cubieboard</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>verdex</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>netduino2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>raspi2b</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>cheetah</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>highbank</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>akita</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>connex</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>collie</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>raspi0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='armv7l'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>32</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>integratorcp</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>borzoi</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>spitz</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>nuri</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>musca-b1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>versatileab</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>kzm</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>musca-a</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>smdkc210</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>sx1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>z2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>tosa</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>sabrelite</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>realview-eb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>n810</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>n800</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>versatilepb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>terrier</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mainstone</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>midway</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>musicpal</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>microbit</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>cubieboard</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>verdex</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>netduino2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>raspi2b</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>cheetah</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>highbank</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>akita</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>connex</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>collie</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>raspi0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='aarch64'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>64</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>integratorcp</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>borzoi</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>spitz</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>nuri</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>musca-b1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>versatileab</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>kzm</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>musca-a</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>smdkc210</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>sx1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>z2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>tosa</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>sabrelite</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>realview-eb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>n810</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>n800</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>versatilepb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>terrier</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mainstone</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>midway</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>musicpal</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>microbit</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>cubieboard</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>verdex</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>netduino2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>raspi3b</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>raspi2b</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>cheetah</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>highbank</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>akita</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>connex</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>collie</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>raspi0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <acpi default='on' toggle='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='cris'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>32</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='i686'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>32</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>x-remote</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>isapc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>microvm</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='kvm'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <pae/>
Aug 27 02:16:06 user nova-compute[72820]:       <nonpae/>
Aug 27 02:16:06 user nova-compute[72820]:       <acpi default='on' toggle='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:       <apic default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='m68k'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>32</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>an5206</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>q800</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>next-cube</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='microblaze'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>32</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='microblazeel'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>32</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='mips'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>32</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='16'>malta</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='mipsel'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>32</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='16'>malta</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='mips64'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>64</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='16'>malta</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>pica61</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>magnum</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='mips64el'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>64</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='16'>malta</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>pica61</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>magnum</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='16'>boston</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='ppc'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>32</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>g3beige</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mac99</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>ppce500</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>pegasos2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>sam460ex</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>bamboo</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>40p</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>ref405ep</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>taihu</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='ppc64'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>64</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2048'>powernv9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>taihu</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2048'>powernv10</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>ppce500</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>40p</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>pegasos2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>bamboo</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>g3beige</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mac99</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>sam460ex</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>ref405ep</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2048'>powernv8</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='ppc64le'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>64</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2048'>powernv9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>taihu</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2048'>powernv10</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>ppce500</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>40p</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>pegasos2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>bamboo</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>g3beige</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>mac99</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>sam460ex</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>ref405ep</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2048'>powernv8</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='riscv32'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>32</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='8'>spike</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>opentitan</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='5'>sifive_u</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>sifive_e</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='8'>virt</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='riscv64'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>64</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='8'>spike</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='5'>sifive_u</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>shakti_c</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>sifive_e</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='8'>virt</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='s390x'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>64</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='sh4'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>32</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>shix</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>r2d</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='sh4eb'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>64</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>shix</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>r2d</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='sparc'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>32</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>SS-5</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>SS-20</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>LX</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>SS-4</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>SS-10</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>Voyager</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='sparc64'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>64</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>sun4u</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>niagara</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>sun4v</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='x86_64'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>64</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>x-remote</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='1'>isapc</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>microvm</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='kvm'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <acpi default='on' toggle='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:       <apic default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='xtensa'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>32</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>sim</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>kc705</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>ml605</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>virt</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>lx200</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>lx60</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]:   <guest>
Aug 27 02:16:06 user nova-compute[72820]:     <os_type>hvm</os_type>
Aug 27 02:16:06 user nova-compute[72820]:     <arch name='xtensaeb'>
Aug 27 02:16:06 user nova-compute[72820]:       <wordsize>32</wordsize>
Aug 27 02:16:06 user nova-compute[72820]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='4'>sim</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>kc705</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>ml605</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>virt</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>lx200</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>lx60</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 27 02:16:06 user nova-compute[72820]:       <domain type='qemu'/>
Aug 27 02:16:06 user nova-compute[72820]:     </arch>
Aug 27 02:16:06 user nova-compute[72820]:     <features>
Aug 27 02:16:06 user nova-compute[72820]:       <cpuselection/>
Aug 27 02:16:06 user nova-compute[72820]:       <deviceboot/>
Aug 27 02:16:06 user nova-compute[72820]:       <disksnapshot default='on' toggle='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     </features>
Aug 27 02:16:06 user nova-compute[72820]:   </guest>
Aug 27 02:16:06 user nova-compute[72820]: </capabilities>
Aug 27 02:16:06 user nova-compute[72820]: 
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 27 02:16:06 user nova-compute[72820]: <domainCapabilities>
Aug 27 02:16:06 user nova-compute[72820]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 02:16:06 user nova-compute[72820]:   <domain>kvm</domain>
Aug 27 02:16:06 user nova-compute[72820]:   <machine>pc-q35-jammy</machine>
Aug 27 02:16:06 user nova-compute[72820]:   <arch>i686</arch>
Aug 27 02:16:06 user nova-compute[72820]:   <vcpu max='288'/>
Aug 27 02:16:06 user nova-compute[72820]:   <iothreads supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:   <os supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:     <enum name='firmware'/>
Aug 27 02:16:06 user nova-compute[72820]:     <loader supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='type'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>rom</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>pflash</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='readonly'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>yes</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>no</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='secure'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>no</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </loader>
Aug 27 02:16:06 user nova-compute[72820]:   </os>
Aug 27 02:16:06 user nova-compute[72820]:   <cpu>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='host-passthrough' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='hostPassthroughMigratable'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>off</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='maximum' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='maximumMigratable'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>on</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>off</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='host-model' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <vendor>Intel</vendor>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ss'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='vmx'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='pcid'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='hypervisor'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='arat'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='umip'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='md-clear'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='stibp'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ssbd'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ibpb'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ibrs'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='amd-stibp'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='erms'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='lm'/>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='custom' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>qemu64</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>qemu32</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>phenom</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium3</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium2</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>n270</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>kvm64</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>kvm32</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>coreduo</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>core2duo</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>athlon</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Westmere</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Snowridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>SandyBridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Penryn</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G5</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G4</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G3</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G2</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G1</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Nehalem</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>IvyBridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Icelake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-Rome</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-Milan</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Dhyana</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cooperlake</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Conroe</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>486</model>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:   </cpu>
Aug 27 02:16:06 user nova-compute[72820]:   <memoryBacking supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:     <enum name='sourceType'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>file</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>anonymous</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>memfd</value>
Aug 27 02:16:06 user nova-compute[72820]:     </enum>
Aug 27 02:16:06 user nova-compute[72820]:   </memoryBacking>
Aug 27 02:16:06 user nova-compute[72820]:   <devices>
Aug 27 02:16:06 user nova-compute[72820]:     <disk supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='diskDevice'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>disk</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>cdrom</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>floppy</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>lun</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='bus'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>fdc</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>scsi</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>usb</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>sata</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-non-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </disk>
Aug 27 02:16:06 user nova-compute[72820]:     <graphics supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='type'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>sdl</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vnc</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>spice</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>egl-headless</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </graphics>
Aug 27 02:16:06 user nova-compute[72820]:     <video supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='modelType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vga</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>cirrus</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vmvga</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>qxl</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>none</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>bochs</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>ramfb</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </video>
Aug 27 02:16:06 user nova-compute[72820]:     <hostdev supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='mode'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>subsystem</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='startupPolicy'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>default</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>mandatory</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>requisite</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>optional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='subsysType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>usb</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>pci</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>scsi</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='capsType'/>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='pciBackend'/>
Aug 27 02:16:06 user nova-compute[72820]:     </hostdev>
Aug 27 02:16:06 user nova-compute[72820]:     <rng supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-non-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='backendModel'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>random</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>egd</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>builtin</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </rng>
Aug 27 02:16:06 user nova-compute[72820]:     <filesystem supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='driverType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>path</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>handle</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtiofs</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </filesystem>
Aug 27 02:16:06 user nova-compute[72820]:     <tpm supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>tpm-tis</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>tpm-crb</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='backendModel'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>passthrough</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>emulator</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </tpm>
Aug 27 02:16:06 user nova-compute[72820]:   </devices>
Aug 27 02:16:06 user nova-compute[72820]:   <features>
Aug 27 02:16:06 user nova-compute[72820]:     <gic supported='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     <vmcoreinfo supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <genid supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <backingStoreInput supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <backup supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <sev supported='no'/>
Aug 27 02:16:06 user nova-compute[72820]:   </features>
Aug 27 02:16:06 user nova-compute[72820]: </domainCapabilities>
Aug 27 02:16:06 user nova-compute[72820]:  {{(pid=72820) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 27 02:16:06 user nova-compute[72820]: <domainCapabilities>
Aug 27 02:16:06 user nova-compute[72820]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 02:16:06 user nova-compute[72820]:   <domain>kvm</domain>
Aug 27 02:16:06 user nova-compute[72820]:   <machine>pc-i440fx-6.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:   <arch>i686</arch>
Aug 27 02:16:06 user nova-compute[72820]:   <vcpu max='255'/>
Aug 27 02:16:06 user nova-compute[72820]:   <iothreads supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:   <os supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:     <enum name='firmware'/>
Aug 27 02:16:06 user nova-compute[72820]:     <loader supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='type'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>rom</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>pflash</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='readonly'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>yes</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>no</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='secure'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>no</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </loader>
Aug 27 02:16:06 user nova-compute[72820]:   </os>
Aug 27 02:16:06 user nova-compute[72820]:   <cpu>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='host-passthrough' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='hostPassthroughMigratable'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>off</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='maximum' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='maximumMigratable'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>on</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>off</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='host-model' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <vendor>Intel</vendor>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ss'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='vmx'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='pcid'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='hypervisor'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='arat'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='umip'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='md-clear'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='stibp'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ssbd'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ibpb'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ibrs'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='amd-stibp'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='erms'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='lm'/>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='custom' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>qemu64</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>qemu32</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>phenom</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium3</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium2</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>n270</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>kvm64</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>kvm32</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>coreduo</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>core2duo</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>athlon</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Westmere</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Snowridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>SandyBridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Penryn</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G5</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G4</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G3</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G2</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G1</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Nehalem</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>IvyBridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Icelake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-Rome</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-Milan</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Dhyana</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cooperlake</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Conroe</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>486</model>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:   </cpu>
Aug 27 02:16:06 user nova-compute[72820]:   <memoryBacking supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:     <enum name='sourceType'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>file</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>anonymous</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>memfd</value>
Aug 27 02:16:06 user nova-compute[72820]:     </enum>
Aug 27 02:16:06 user nova-compute[72820]:   </memoryBacking>
Aug 27 02:16:06 user nova-compute[72820]:   <devices>
Aug 27 02:16:06 user nova-compute[72820]:     <disk supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='diskDevice'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>disk</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>cdrom</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>floppy</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>lun</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='bus'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>ide</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>fdc</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>scsi</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>usb</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>sata</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-non-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </disk>
Aug 27 02:16:06 user nova-compute[72820]:     <graphics supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='type'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>sdl</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vnc</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>spice</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>egl-headless</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </graphics>
Aug 27 02:16:06 user nova-compute[72820]:     <video supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='modelType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vga</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>cirrus</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vmvga</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>qxl</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>none</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>bochs</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>ramfb</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </video>
Aug 27 02:16:06 user nova-compute[72820]:     <hostdev supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='mode'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>subsystem</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='startupPolicy'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>default</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>mandatory</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>requisite</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>optional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='subsysType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>usb</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>pci</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>scsi</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='capsType'/>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='pciBackend'/>
Aug 27 02:16:06 user nova-compute[72820]:     </hostdev>
Aug 27 02:16:06 user nova-compute[72820]:     <rng supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-non-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='backendModel'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>random</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>egd</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>builtin</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </rng>
Aug 27 02:16:06 user nova-compute[72820]:     <filesystem supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='driverType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>path</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>handle</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtiofs</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </filesystem>
Aug 27 02:16:06 user nova-compute[72820]:     <tpm supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>tpm-tis</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>tpm-crb</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='backendModel'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>passthrough</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>emulator</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </tpm>
Aug 27 02:16:06 user nova-compute[72820]:   </devices>
Aug 27 02:16:06 user nova-compute[72820]:   <features>
Aug 27 02:16:06 user nova-compute[72820]:     <gic supported='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     <vmcoreinfo supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <genid supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <backingStoreInput supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <backup supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <sev supported='no'/>
Aug 27 02:16:06 user nova-compute[72820]:   </features>
Aug 27 02:16:06 user nova-compute[72820]: </domainCapabilities>
Aug 27 02:16:06 user nova-compute[72820]:  {{(pid=72820) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 27 02:16:06 user nova-compute[72820]: <domainCapabilities>
Aug 27 02:16:06 user nova-compute[72820]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 02:16:06 user nova-compute[72820]:   <domain>kvm</domain>
Aug 27 02:16:06 user nova-compute[72820]:   <machine>pc-q35-6.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:   <arch>i686</arch>
Aug 27 02:16:06 user nova-compute[72820]:   <vcpu max='288'/>
Aug 27 02:16:06 user nova-compute[72820]:   <iothreads supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:   <os supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:     <enum name='firmware'/>
Aug 27 02:16:06 user nova-compute[72820]:     <loader supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='type'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>rom</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>pflash</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='readonly'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>yes</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>no</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='secure'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>no</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </loader>
Aug 27 02:16:06 user nova-compute[72820]:   </os>
Aug 27 02:16:06 user nova-compute[72820]:   <cpu>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='host-passthrough' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='hostPassthroughMigratable'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>off</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='maximum' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='maximumMigratable'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>on</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>off</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='host-model' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <vendor>Intel</vendor>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ss'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='vmx'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='pcid'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='hypervisor'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='arat'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='umip'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='md-clear'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='stibp'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ssbd'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ibpb'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ibrs'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='amd-stibp'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='erms'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='lm'/>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='custom' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>qemu64</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>qemu32</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>phenom</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium3</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium2</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>n270</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>kvm64</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>kvm32</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>coreduo</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>core2duo</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>athlon</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Westmere</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Snowridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>SandyBridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Penryn</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G5</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G4</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G3</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G2</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G1</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Nehalem</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>IvyBridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Icelake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-Rome</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-Milan</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Dhyana</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cooperlake</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Conroe</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>486</model>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:   </cpu>
Aug 27 02:16:06 user nova-compute[72820]:   <memoryBacking supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:     <enum name='sourceType'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>file</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>anonymous</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>memfd</value>
Aug 27 02:16:06 user nova-compute[72820]:     </enum>
Aug 27 02:16:06 user nova-compute[72820]:   </memoryBacking>
Aug 27 02:16:06 user nova-compute[72820]:   <devices>
Aug 27 02:16:06 user nova-compute[72820]:     <disk supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='diskDevice'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>disk</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>cdrom</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>floppy</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>lun</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='bus'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>fdc</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>scsi</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>usb</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>sata</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-non-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </disk>
Aug 27 02:16:06 user nova-compute[72820]:     <graphics supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='type'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>sdl</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vnc</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>spice</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>egl-headless</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </graphics>
Aug 27 02:16:06 user nova-compute[72820]:     <video supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='modelType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vga</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>cirrus</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vmvga</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>qxl</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>none</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>bochs</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>ramfb</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </video>
Aug 27 02:16:06 user nova-compute[72820]:     <hostdev supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='mode'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>subsystem</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='startupPolicy'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>default</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>mandatory</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>requisite</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>optional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='subsysType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>usb</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>pci</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>scsi</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='capsType'/>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='pciBackend'/>
Aug 27 02:16:06 user nova-compute[72820]:     </hostdev>
Aug 27 02:16:06 user nova-compute[72820]:     <rng supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-non-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='backendModel'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>random</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>egd</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>builtin</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </rng>
Aug 27 02:16:06 user nova-compute[72820]:     <filesystem supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='driverType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>path</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>handle</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtiofs</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </filesystem>
Aug 27 02:16:06 user nova-compute[72820]:     <tpm supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>tpm-tis</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>tpm-crb</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='backendModel'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>passthrough</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>emulator</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </tpm>
Aug 27 02:16:06 user nova-compute[72820]:   </devices>
Aug 27 02:16:06 user nova-compute[72820]:   <features>
Aug 27 02:16:06 user nova-compute[72820]:     <gic supported='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     <vmcoreinfo supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <genid supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <backingStoreInput supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <backup supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <sev supported='no'/>
Aug 27 02:16:06 user nova-compute[72820]:   </features>
Aug 27 02:16:06 user nova-compute[72820]: </domainCapabilities>
Aug 27 02:16:06 user nova-compute[72820]:  {{(pid=72820) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 27 02:16:06 user nova-compute[72820]: <domainCapabilities>
Aug 27 02:16:06 user nova-compute[72820]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 02:16:06 user nova-compute[72820]:   <domain>kvm</domain>
Aug 27 02:16:06 user nova-compute[72820]:   <machine>pc-i440fx-jammy</machine>
Aug 27 02:16:06 user nova-compute[72820]:   <arch>i686</arch>
Aug 27 02:16:06 user nova-compute[72820]:   <vcpu max='255'/>
Aug 27 02:16:06 user nova-compute[72820]:   <iothreads supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:   <os supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:     <enum name='firmware'/>
Aug 27 02:16:06 user nova-compute[72820]:     <loader supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='type'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>rom</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>pflash</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='readonly'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>yes</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>no</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='secure'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>no</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </loader>
Aug 27 02:16:06 user nova-compute[72820]:   </os>
Aug 27 02:16:06 user nova-compute[72820]:   <cpu>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='host-passthrough' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='hostPassthroughMigratable'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>off</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='maximum' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='maximumMigratable'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>on</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>off</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='host-model' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <vendor>Intel</vendor>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ss'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='vmx'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='pcid'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='hypervisor'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='arat'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='umip'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='md-clear'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='stibp'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ssbd'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ibpb'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ibrs'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='amd-stibp'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='erms'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='lm'/>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='custom' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>qemu64</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>qemu32</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>phenom</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium3</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium2</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>n270</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>kvm64</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>kvm32</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>coreduo</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>core2duo</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>athlon</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Westmere</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Snowridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>SandyBridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Penryn</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G5</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G4</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G3</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G2</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G1</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Nehalem</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>IvyBridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Icelake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-Rome</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-Milan</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Dhyana</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cooperlake</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Conroe</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>486</model>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:   </cpu>
Aug 27 02:16:06 user nova-compute[72820]:   <memoryBacking supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:     <enum name='sourceType'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>file</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>anonymous</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>memfd</value>
Aug 27 02:16:06 user nova-compute[72820]:     </enum>
Aug 27 02:16:06 user nova-compute[72820]:   </memoryBacking>
Aug 27 02:16:06 user nova-compute[72820]:   <devices>
Aug 27 02:16:06 user nova-compute[72820]:     <disk supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='diskDevice'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>disk</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>cdrom</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>floppy</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>lun</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='bus'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>ide</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>fdc</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>scsi</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>usb</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>sata</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-non-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </disk>
Aug 27 02:16:06 user nova-compute[72820]:     <graphics supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='type'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>sdl</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vnc</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>spice</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>egl-headless</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </graphics>
Aug 27 02:16:06 user nova-compute[72820]:     <video supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='modelType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vga</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>cirrus</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vmvga</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>qxl</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>none</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>bochs</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>ramfb</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </video>
Aug 27 02:16:06 user nova-compute[72820]:     <hostdev supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='mode'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>subsystem</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='startupPolicy'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>default</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>mandatory</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>requisite</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>optional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='subsysType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>usb</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>pci</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>scsi</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='capsType'/>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='pciBackend'/>
Aug 27 02:16:06 user nova-compute[72820]:     </hostdev>
Aug 27 02:16:06 user nova-compute[72820]:     <rng supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-non-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='backendModel'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>random</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>egd</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>builtin</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </rng>
Aug 27 02:16:06 user nova-compute[72820]:     <filesystem supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='driverType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>path</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>handle</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtiofs</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </filesystem>
Aug 27 02:16:06 user nova-compute[72820]:     <tpm supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>tpm-tis</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>tpm-crb</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='backendModel'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>passthrough</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>emulator</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </tpm>
Aug 27 02:16:06 user nova-compute[72820]:   </devices>
Aug 27 02:16:06 user nova-compute[72820]:   <features>
Aug 27 02:16:06 user nova-compute[72820]:     <gic supported='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     <vmcoreinfo supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <genid supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <backingStoreInput supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <backup supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <sev supported='no'/>
Aug 27 02:16:06 user nova-compute[72820]:   </features>
Aug 27 02:16:06 user nova-compute[72820]: </domainCapabilities>
Aug 27 02:16:06 user nova-compute[72820]:  {{(pid=72820) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 27 02:16:06 user nova-compute[72820]: <domainCapabilities>
Aug 27 02:16:06 user nova-compute[72820]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 02:16:06 user nova-compute[72820]:   <domain>kvm</domain>
Aug 27 02:16:06 user nova-compute[72820]:   <machine>pc-q35-jammy</machine>
Aug 27 02:16:06 user nova-compute[72820]:   <arch>x86_64</arch>
Aug 27 02:16:06 user nova-compute[72820]:   <vcpu max='288'/>
Aug 27 02:16:06 user nova-compute[72820]:   <iothreads supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:   <os supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:     <enum name='firmware'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>efi</value>
Aug 27 02:16:06 user nova-compute[72820]:     </enum>
Aug 27 02:16:06 user nova-compute[72820]:     <loader supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='type'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>rom</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>pflash</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='readonly'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>yes</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>no</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='secure'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>yes</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>no</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </loader>
Aug 27 02:16:06 user nova-compute[72820]:   </os>
Aug 27 02:16:06 user nova-compute[72820]:   <cpu>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='host-passthrough' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='hostPassthroughMigratable'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>on</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>off</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='maximum' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='maximumMigratable'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>on</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>off</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='host-model' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <vendor>Intel</vendor>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ss'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='vmx'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='pcid'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='hypervisor'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='arat'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='umip'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='md-clear'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='stibp'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ssbd'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='invtsc'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ibpb'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ibrs'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='amd-stibp'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='rsba'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='erms'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='custom' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>qemu64</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>qemu32</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>phenom</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium3</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium2</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>n270</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>kvm64</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>kvm32</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>coreduo</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>core2duo</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>athlon</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Westmere</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Snowridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>SandyBridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Penryn</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G5</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G4</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G3</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G2</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Opteron_G1</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Nehalem</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>IvyBridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Icelake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-Rome</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-Milan</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Dhyana</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cooperlake</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Conroe</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>486</model>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:   </cpu>
Aug 27 02:16:06 user nova-compute[72820]:   <memoryBacking supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:     <enum name='sourceType'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>file</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>anonymous</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>memfd</value>
Aug 27 02:16:06 user nova-compute[72820]:     </enum>
Aug 27 02:16:06 user nova-compute[72820]:   </memoryBacking>
Aug 27 02:16:06 user nova-compute[72820]:   <devices>
Aug 27 02:16:06 user nova-compute[72820]:     <disk supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='diskDevice'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>disk</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>cdrom</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>floppy</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>lun</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='bus'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>fdc</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>scsi</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>usb</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>sata</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-non-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </disk>
Aug 27 02:16:06 user nova-compute[72820]:     <graphics supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='type'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>sdl</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vnc</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>spice</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>egl-headless</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </graphics>
Aug 27 02:16:06 user nova-compute[72820]:     <video supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='modelType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vga</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>cirrus</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vmvga</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>qxl</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>none</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>bochs</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>ramfb</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </video>
Aug 27 02:16:06 user nova-compute[72820]:     <hostdev supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='mode'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>subsystem</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='startupPolicy'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>default</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>mandatory</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>requisite</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>optional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='subsysType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>usb</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>pci</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>scsi</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='capsType'/>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='pciBackend'/>
Aug 27 02:16:06 user nova-compute[72820]:     </hostdev>
Aug 27 02:16:06 user nova-compute[72820]:     <rng supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-non-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='backendModel'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>random</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>egd</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>builtin</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </rng>
Aug 27 02:16:06 user nova-compute[72820]:     <filesystem supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='driverType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>path</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>handle</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtiofs</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </filesystem>
Aug 27 02:16:06 user nova-compute[72820]:     <tpm supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>tpm-tis</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>tpm-crb</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='backendModel'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>passthrough</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>emulator</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </tpm>
Aug 27 02:16:06 user nova-compute[72820]:   </devices>
Aug 27 02:16:06 user nova-compute[72820]:   <features>
Aug 27 02:16:06 user nova-compute[72820]:     <gic supported='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     <vmcoreinfo supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <genid supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <backingStoreInput supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <backup supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <sev supported='no'/>
Aug 27 02:16:06 user nova-compute[72820]:   </features>
Aug 27 02:16:06 user nova-compute[72820]: </domainCapabilities>
Aug 27 02:16:06 user nova-compute[72820]:  {{(pid=72820) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 27 02:16:06 user nova-compute[72820]: <domainCapabilities>
Aug 27 02:16:06 user nova-compute[72820]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 02:16:06 user nova-compute[72820]:   <domain>kvm</domain>
Aug 27 02:16:06 user nova-compute[72820]:   <machine>pc-i440fx-6.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:   <arch>x86_64</arch>
Aug 27 02:16:06 user nova-compute[72820]:   <vcpu max='255'/>
Aug 27 02:16:06 user nova-compute[72820]:   <iothreads supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:   <os supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:     <enum name='firmware'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>efi</value>
Aug 27 02:16:06 user nova-compute[72820]:     </enum>
Aug 27 02:16:06 user nova-compute[72820]:     <loader supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='type'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>rom</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>pflash</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='readonly'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>yes</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>no</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='secure'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>no</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </loader>
Aug 27 02:16:06 user nova-compute[72820]:   </os>
Aug 27 02:16:06 user nova-compute[72820]:   <cpu>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='host-passthrough' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='hostPassthroughMigratable'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>on</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>off</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='maximum' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='maximumMigratable'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>on</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>off</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='host-model' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <vendor>Intel</vendor>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ss'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='vmx'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='pcid'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='hypervisor'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='arat'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='umip'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='md-clear'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='stibp'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ssbd'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='invtsc'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ibpb'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ibrs'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='amd-stibp'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='rsba'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='erms'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='custom' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>qemu64</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>qemu32</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>phenom</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium3</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium2</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>n270</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>kvm64</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>kvm32</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>coreduo</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>core2duo</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>athlon</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Westmere</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Snowridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>SandyBridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Penryn</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G5</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G4</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G3</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G2</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Opteron_G1</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Nehalem</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>IvyBridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Icelake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-Rome</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-Milan</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Dhyana</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cooperlake</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Conroe</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>486</model>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:   </cpu>
Aug 27 02:16:06 user nova-compute[72820]:   <memoryBacking supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:     <enum name='sourceType'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>file</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>anonymous</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>memfd</value>
Aug 27 02:16:06 user nova-compute[72820]:     </enum>
Aug 27 02:16:06 user nova-compute[72820]:   </memoryBacking>
Aug 27 02:16:06 user nova-compute[72820]:   <devices>
Aug 27 02:16:06 user nova-compute[72820]:     <disk supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='diskDevice'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>disk</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>cdrom</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>floppy</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>lun</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='bus'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>ide</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>fdc</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>scsi</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>usb</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>sata</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-non-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </disk>
Aug 27 02:16:06 user nova-compute[72820]:     <graphics supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='type'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>sdl</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vnc</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>spice</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>egl-headless</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </graphics>
Aug 27 02:16:06 user nova-compute[72820]:     <video supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='modelType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vga</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>cirrus</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vmvga</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>qxl</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>none</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>bochs</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>ramfb</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </video>
Aug 27 02:16:06 user nova-compute[72820]:     <hostdev supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='mode'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>subsystem</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='startupPolicy'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>default</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>mandatory</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>requisite</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>optional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='subsysType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>usb</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>pci</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>scsi</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='capsType'/>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='pciBackend'/>
Aug 27 02:16:06 user nova-compute[72820]:     </hostdev>
Aug 27 02:16:06 user nova-compute[72820]:     <rng supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-non-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='backendModel'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>random</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>egd</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>builtin</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </rng>
Aug 27 02:16:06 user nova-compute[72820]:     <filesystem supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='driverType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>path</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>handle</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtiofs</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </filesystem>
Aug 27 02:16:06 user nova-compute[72820]:     <tpm supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>tpm-tis</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>tpm-crb</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='backendModel'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>passthrough</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>emulator</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </tpm>
Aug 27 02:16:06 user nova-compute[72820]:   </devices>
Aug 27 02:16:06 user nova-compute[72820]:   <features>
Aug 27 02:16:06 user nova-compute[72820]:     <gic supported='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     <vmcoreinfo supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <genid supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <backingStoreInput supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <backup supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <sev supported='no'/>
Aug 27 02:16:06 user nova-compute[72820]:   </features>
Aug 27 02:16:06 user nova-compute[72820]: </domainCapabilities>
Aug 27 02:16:06 user nova-compute[72820]:  {{(pid=72820) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 27 02:16:06 user nova-compute[72820]: <domainCapabilities>
Aug 27 02:16:06 user nova-compute[72820]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 02:16:06 user nova-compute[72820]:   <domain>kvm</domain>
Aug 27 02:16:06 user nova-compute[72820]:   <machine>pc-q35-6.2</machine>
Aug 27 02:16:06 user nova-compute[72820]:   <arch>x86_64</arch>
Aug 27 02:16:06 user nova-compute[72820]:   <vcpu max='288'/>
Aug 27 02:16:06 user nova-compute[72820]:   <iothreads supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:   <os supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:     <enum name='firmware'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>efi</value>
Aug 27 02:16:06 user nova-compute[72820]:     </enum>
Aug 27 02:16:06 user nova-compute[72820]:     <loader supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='type'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>rom</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>pflash</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='readonly'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>yes</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>no</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='secure'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>yes</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>no</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </loader>
Aug 27 02:16:06 user nova-compute[72820]:   </os>
Aug 27 02:16:06 user nova-compute[72820]:   <cpu>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='host-passthrough' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='hostPassthroughMigratable'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>on</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>off</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='maximum' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='maximumMigratable'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>on</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>off</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='host-model' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <vendor>Intel</vendor>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ss'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='vmx'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='pcid'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='hypervisor'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='arat'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='umip'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='md-clear'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='stibp'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ssbd'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='invtsc'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ibpb'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ibrs'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='amd-stibp'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='rsba'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='erms'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='custom' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>qemu64</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>qemu32</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>phenom</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium3</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium2</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>n270</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>kvm64</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>kvm32</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>coreduo</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>core2duo</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>athlon</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Westmere</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Snowridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>SandyBridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Penryn</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G5</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G4</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G3</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G2</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Opteron_G1</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Nehalem</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>IvyBridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Icelake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-Rome</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-Milan</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Dhyana</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cooperlake</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Conroe</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>486</model>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:   </cpu>
Aug 27 02:16:06 user nova-compute[72820]:   <memoryBacking supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:     <enum name='sourceType'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>file</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>anonymous</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>memfd</value>
Aug 27 02:16:06 user nova-compute[72820]:     </enum>
Aug 27 02:16:06 user nova-compute[72820]:   </memoryBacking>
Aug 27 02:16:06 user nova-compute[72820]:   <devices>
Aug 27 02:16:06 user nova-compute[72820]:     <disk supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='diskDevice'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>disk</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>cdrom</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>floppy</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>lun</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='bus'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>fdc</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>scsi</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>usb</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>sata</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-non-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </disk>
Aug 27 02:16:06 user nova-compute[72820]:     <graphics supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='type'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>sdl</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vnc</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>spice</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>egl-headless</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </graphics>
Aug 27 02:16:06 user nova-compute[72820]:     <video supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='modelType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vga</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>cirrus</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vmvga</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>qxl</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>none</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>bochs</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>ramfb</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </video>
Aug 27 02:16:06 user nova-compute[72820]:     <hostdev supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='mode'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>subsystem</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='startupPolicy'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>default</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>mandatory</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>requisite</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>optional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='subsysType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>usb</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>pci</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>scsi</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='capsType'/>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='pciBackend'/>
Aug 27 02:16:06 user nova-compute[72820]:     </hostdev>
Aug 27 02:16:06 user nova-compute[72820]:     <rng supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-non-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='backendModel'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>random</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>egd</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>builtin</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </rng>
Aug 27 02:16:06 user nova-compute[72820]:     <filesystem supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='driverType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>path</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>handle</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtiofs</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </filesystem>
Aug 27 02:16:06 user nova-compute[72820]:     <tpm supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>tpm-tis</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>tpm-crb</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='backendModel'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>passthrough</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>emulator</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </tpm>
Aug 27 02:16:06 user nova-compute[72820]:   </devices>
Aug 27 02:16:06 user nova-compute[72820]:   <features>
Aug 27 02:16:06 user nova-compute[72820]:     <gic supported='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     <vmcoreinfo supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <genid supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <backingStoreInput supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <backup supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <sev supported='no'/>
Aug 27 02:16:06 user nova-compute[72820]:   </features>
Aug 27 02:16:06 user nova-compute[72820]: </domainCapabilities>
Aug 27 02:16:06 user nova-compute[72820]:  {{(pid=72820) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 27 02:16:06 user nova-compute[72820]: <domainCapabilities>
Aug 27 02:16:06 user nova-compute[72820]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 02:16:06 user nova-compute[72820]:   <domain>kvm</domain>
Aug 27 02:16:06 user nova-compute[72820]:   <machine>pc-i440fx-jammy</machine>
Aug 27 02:16:06 user nova-compute[72820]:   <arch>x86_64</arch>
Aug 27 02:16:06 user nova-compute[72820]:   <vcpu max='255'/>
Aug 27 02:16:06 user nova-compute[72820]:   <iothreads supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:   <os supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:     <enum name='firmware'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>efi</value>
Aug 27 02:16:06 user nova-compute[72820]:     </enum>
Aug 27 02:16:06 user nova-compute[72820]:     <loader supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='type'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>rom</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>pflash</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='readonly'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>yes</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>no</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='secure'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>no</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </loader>
Aug 27 02:16:06 user nova-compute[72820]:   </os>
Aug 27 02:16:06 user nova-compute[72820]:   <cpu>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='host-passthrough' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='hostPassthroughMigratable'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>on</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>off</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='maximum' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='maximumMigratable'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>on</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>off</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='host-model' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <vendor>Intel</vendor>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ss'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='vmx'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='pcid'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='hypervisor'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='arat'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='umip'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='md-clear'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='stibp'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ssbd'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='invtsc'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ibpb'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='ibrs'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='amd-stibp'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='rsba'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='erms'/>
Aug 27 02:16:06 user nova-compute[72820]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:     <mode name='custom' supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>qemu64</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>qemu32</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>phenom</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium3</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium2</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>pentium</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>n270</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>kvm64</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>kvm32</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>coreduo</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>core2duo</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>athlon</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Westmere</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Snowridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Skylake-Client</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>SandyBridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Penryn</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G5</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G4</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G3</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Opteron_G2</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Opteron_G1</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Nehalem</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>IvyBridge</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Icelake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Haswell</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-Rome</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-Milan</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>EPYC</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Dhyana</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cooperlake</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>Conroe</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='no'>Broadwell</model>
Aug 27 02:16:06 user nova-compute[72820]:       <model usable='yes'>486</model>
Aug 27 02:16:06 user nova-compute[72820]:     </mode>
Aug 27 02:16:06 user nova-compute[72820]:   </cpu>
Aug 27 02:16:06 user nova-compute[72820]:   <memoryBacking supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:     <enum name='sourceType'>
Aug 27 02:16:06 user nova-compute[72820]:       <value>file</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>anonymous</value>
Aug 27 02:16:06 user nova-compute[72820]:       <value>memfd</value>
Aug 27 02:16:06 user nova-compute[72820]:     </enum>
Aug 27 02:16:06 user nova-compute[72820]:   </memoryBacking>
Aug 27 02:16:06 user nova-compute[72820]:   <devices>
Aug 27 02:16:06 user nova-compute[72820]:     <disk supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='diskDevice'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>disk</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>cdrom</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>floppy</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>lun</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='bus'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>ide</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>fdc</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>scsi</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>usb</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>sata</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-non-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </disk>
Aug 27 02:16:06 user nova-compute[72820]:     <graphics supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='type'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>sdl</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vnc</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>spice</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>egl-headless</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </graphics>
Aug 27 02:16:06 user nova-compute[72820]:     <video supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='modelType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vga</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>cirrus</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>vmvga</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>qxl</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>none</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>bochs</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>ramfb</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </video>
Aug 27 02:16:06 user nova-compute[72820]:     <hostdev supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='mode'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>subsystem</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='startupPolicy'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>default</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>mandatory</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>requisite</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>optional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='subsysType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>usb</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>pci</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>scsi</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='capsType'/>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='pciBackend'/>
Aug 27 02:16:06 user nova-compute[72820]:     </hostdev>
Aug 27 02:16:06 user nova-compute[72820]:     <rng supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtio-non-transitional</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='backendModel'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>random</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>egd</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>builtin</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </rng>
Aug 27 02:16:06 user nova-compute[72820]:     <filesystem supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='driverType'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>path</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>handle</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>virtiofs</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </filesystem>
Aug 27 02:16:06 user nova-compute[72820]:     <tpm supported='yes'>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='model'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>tpm-tis</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>tpm-crb</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:       <enum name='backendModel'>
Aug 27 02:16:06 user nova-compute[72820]:         <value>passthrough</value>
Aug 27 02:16:06 user nova-compute[72820]:         <value>emulator</value>
Aug 27 02:16:06 user nova-compute[72820]:       </enum>
Aug 27 02:16:06 user nova-compute[72820]:     </tpm>
Aug 27 02:16:06 user nova-compute[72820]:   </devices>
Aug 27 02:16:06 user nova-compute[72820]:   <features>
Aug 27 02:16:06 user nova-compute[72820]:     <gic supported='no'/>
Aug 27 02:16:06 user nova-compute[72820]:     <vmcoreinfo supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <genid supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <backingStoreInput supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <backup supported='yes'/>
Aug 27 02:16:06 user nova-compute[72820]:     <sev supported='no'/>
Aug 27 02:16:06 user nova-compute[72820]:   </features>
Aug 27 02:16:06 user nova-compute[72820]: </domainCapabilities>
Aug 27 02:16:06 user nova-compute[72820]:  {{(pid=72820) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Checking secure boot support for host arch (x86_64) {{(pid=72820) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 27 02:16:06 user nova-compute[72820]: INFO nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Secure Boot support detected
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] cpu compare xml: <cpu match="exact">
Aug 27 02:16:06 user nova-compute[72820]:   <model>Nehalem</model>
Aug 27 02:16:06 user nova-compute[72820]: </cpu>
Aug 27 02:16:06 user nova-compute[72820]:  {{(pid=72820) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 27 02:16:06 user nova-compute[72820]: INFO nova.virt.node [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Generated node identity a962b30a-2750-431c-be10-075d0f991065
Aug 27 02:16:06 user nova-compute[72820]: INFO nova.virt.node [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Wrote node identity a962b30a-2750-431c-be10-075d0f991065 to /opt/stack/data/nova/compute_id
Aug 27 02:16:06 user nova-compute[72820]: WARNING nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Compute nodes ['a962b30a-2750-431c-be10-075d0f991065'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 27 02:16:06 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 27 02:16:06 user nova-compute[72820]: WARNING nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 27 02:16:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:16:06 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:16:07 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:16:07 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:16:07 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Hypervisor/Node resource view: name=user free_ram=10838MB free_disk=26.171329498291016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:16:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:16:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:16:07 user nova-compute[72820]: WARNING nova.compute.resource_tracker [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] No compute node record for user:a962b30a-2750-431c-be10-075d0f991065: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host a962b30a-2750-431c-be10-075d0f991065 could not be found.
Aug 27 02:16:07 user nova-compute[72820]: INFO nova.compute.resource_tracker [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Compute node record created for user:user with uuid: a962b30a-2750-431c-be10-075d0f991065
Aug 27 02:16:07 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:16:07 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:16:07 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [req-1a65790b-6472-4d07-9946-86fc371e4ad8] Created resource provider record via placement API for resource provider with UUID a962b30a-2750-431c-be10-075d0f991065 and name user.
Aug 27 02:16:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72820) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 27 02:16:07 user nova-compute[72820]: INFO nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] kernel doesn't support AMD SEV
Aug 27 02:16:07 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Updating inventory in ProviderTree for provider a962b30a-2750-431c-be10-075d0f991065 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 02:16:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:16:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Libvirt baseline CPU <cpu>
Aug 27 02:16:07 user nova-compute[72820]:   <arch>x86_64</arch>
Aug 27 02:16:07 user nova-compute[72820]:   <model>Nehalem</model>
Aug 27 02:16:07 user nova-compute[72820]:   <vendor>Intel</vendor>
Aug 27 02:16:07 user nova-compute[72820]:   <topology sockets="6" cores="1" threads="1"/>
Aug 27 02:16:07 user nova-compute[72820]: </cpu>
Aug 27 02:16:07 user nova-compute[72820]:  {{(pid=72820) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 27 02:16:07 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Updated inventory for provider a962b30a-2750-431c-be10-075d0f991065 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 27 02:16:07 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Updating resource provider a962b30a-2750-431c-be10-075d0f991065 generation from 0 to 1 during operation: update_inventory {{(pid=72820) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 27 02:16:07 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Updating inventory in ProviderTree for provider a962b30a-2750-431c-be10-075d0f991065 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 02:16:07 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Updating resource provider a962b30a-2750-431c-be10-075d0f991065 generation from 1 to 2 during operation: update_traits {{(pid=72820) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 27 02:16:07 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:16:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.676s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:16:07 user nova-compute[72820]: DEBUG nova.service [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Creating RPC server for service compute {{(pid=72820) start /opt/stack/nova/nova/service.py:182}}
Aug 27 02:16:08 user nova-compute[72820]: DEBUG nova.service [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Join ServiceGroup membership for this service compute {{(pid=72820) start /opt/stack/nova/nova/service.py:199}}
Aug 27 02:16:08 user nova-compute[72820]: DEBUG nova.servicegroup.drivers.db [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72820) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 27 02:16:37 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:16:37 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Didn't find any instances for network info cache update. {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:16:58 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:16:58 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:16:58 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=10240MB free_disk=26.075092315673828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:16:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:17:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:17:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:17:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:17:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 02:17:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Didn't find any instances for network info cache update. {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 02:17:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:17:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:17:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:17:59 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:17:59 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:17:59 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:17:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:17:59 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:17:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:17:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:17:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:17:59 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:17:59 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:17:59 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:17:59 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=10164MB free_disk=26.12167739868164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:17:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:17:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:17:59 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:17:59 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:17:59 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:17:59 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:17:59 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:17:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:18:00 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:18:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:18:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:18:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 02:18:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Didn't find any instances for network info cache update. {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 02:18:59 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:18:59 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:18:59 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:18:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:18:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:18:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:18:59 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:18:59 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:18:59 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:18:59 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=10198MB free_disk=25.905384063720703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:18:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:18:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:18:59 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:18:59 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:18:59 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:18:59 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:18:59 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:18:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:19:00 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:19:00 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:19:00 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:19:00 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:19:00 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:19:02 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:19:59 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:20:00 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:20:00 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:20:00 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 02:20:00 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Didn't find any instances for network info cache update. {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 02:20:00 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:20:00 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:20:01 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:20:01 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:20:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:20:01 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:20:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:01 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:20:01 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:20:01 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:20:01 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=9429MB free_disk=25.927936553955078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:20:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:01 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:20:01 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:20:01 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:20:01 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:20:01 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:20:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:02 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:20:03 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:20:03 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:20:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Acquiring lock "703a5060-dd34-4fff-9dec-6924ad018713" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "703a5060-dd34-4fff-9dec-6924ad018713" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:06 user nova-compute[72820]: DEBUG nova.compute.manager [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:20:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:06 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:20:06 user nova-compute[72820]: INFO nova.compute.claims [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Claim successful on node user
Aug 27 02:20:07 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:20:07 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:20:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:20:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:20:07 user nova-compute[72820]: DEBUG nova.network.neutron [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:20:07 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:20:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:20:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:20:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:20:07 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Creating image(s)
Aug 27 02:20:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Acquiring lock "/opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "/opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "/opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d.part --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:08 user nova-compute[72820]: DEBUG nova.policy [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d23062df28045afb400b603b9defb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87dab14feca44a93aaf191cedb1b0a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:20:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d.part --force-share --output=json" returned: 0 in 0.171s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:08 user nova-compute[72820]: DEBUG nova.virt.images [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] 68b7ab8d-6942-4500-ab2d-968640e48617 was qcow2, converting to raw {{(pid=72820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 02:20:08 user nova-compute[72820]: DEBUG nova.privsep.utils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 02:20:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d.part /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d.converted {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d.part /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d.converted" returned: 0 in 0.382s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d.converted --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.647s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:09 user nova-compute[72820]: INFO oslo.privsep.daemon [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpbt6il8b7/privsep.sock']
Aug 27 02:20:09 user sudo[82088]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpbt6il8b7/privsep.sock
Aug 27 02:20:09 user sudo[82088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 27 02:20:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "26581695-c4b9-40b8-ab7a-34c99db0dadb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:20:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:09 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:20:09 user nova-compute[72820]: INFO nova.compute.claims [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Claim successful on node user
Aug 27 02:20:10 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:20:10 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:20:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:10 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:20:10 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:20:10 user nova-compute[72820]: DEBUG nova.network.neutron [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:20:10 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:20:10 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:20:10 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:20:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:20:10 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Creating image(s)
Aug 27 02:20:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "/opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "/opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "/opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:11 user nova-compute[72820]: DEBUG nova.policy [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7f59dea3a6f4315828320a9ae6c721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca683dd78dbf41ec8fbe3d3f76011272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:20:11 user sudo[82088]: pam_unix(sudo:session): session closed for user root
Aug 27 02:20:11 user nova-compute[72820]: DEBUG nova.network.neutron [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Successfully created port: 3174b771-02bc-4766-9e03-53c1e899b297 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:20:11 user nova-compute[72820]: INFO oslo.privsep.daemon [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Spawned new privsep daemon via rootwrap
Aug 27 02:20:11 user nova-compute[72820]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 27 02:20:11 user nova-compute[72820]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 27 02:20:11 user nova-compute[72820]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 27 02:20:11 user nova-compute[72820]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82095
Aug 27 02:20:11 user nova-compute[72820]: WARNING oslo_privsep.priv_context [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] privsep daemon already running
Aug 27 02:20:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.218s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.214s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.189s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk 1073741824" returned: 0 in 0.052s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.242s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "f8f612f3-41c9-4dae-8d49-218d61720b15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.187s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.217s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:20:12 user nova-compute[72820]: INFO nova.compute.claims [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Claim successful on node user
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/disk 1073741824" returned: 0 in 0.055s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Cannot resize image /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Ensure instance console log exists: /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.171s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Cannot resize image /opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Ensure instance console log exists: /opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:20:12 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:20:12 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Creating image(s)
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "/opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "/opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:12 user nova-compute[72820]: DEBUG nova.policy [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7f59dea3a6f4315828320a9ae6c721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca683dd78dbf41ec8fbe3d3f76011272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.185s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.175s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk 1073741824" returned: 0 in 0.118s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG nova.network.neutron [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Successfully created port: 4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Cannot resize image /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Ensure instance console log exists: /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:14 user nova-compute[72820]: DEBUG nova.network.neutron [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Successfully updated port: 3174b771-02bc-4766-9e03-53c1e899b297 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:20:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Acquiring lock "refresh_cache-703a5060-dd34-4fff-9dec-6924ad018713" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:20:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Acquired lock "refresh_cache-703a5060-dd34-4fff-9dec-6924ad018713" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:20:14 user nova-compute[72820]: DEBUG nova.network.neutron [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:20:14 user nova-compute[72820]: DEBUG nova.network.neutron [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:20:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-2cd9098d-ad6b-4543-b7e4-5a2d33196625 req-0d2c6c27-b780-40c8-9874-a3d7d1e6b9a5 service nova] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Received event network-changed-3174b771-02bc-4766-9e03-53c1e899b297 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-2cd9098d-ad6b-4543-b7e4-5a2d33196625 req-0d2c6c27-b780-40c8-9874-a3d7d1e6b9a5 service nova] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Refreshing instance network info cache due to event network-changed-3174b771-02bc-4766-9e03-53c1e899b297. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:20:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2cd9098d-ad6b-4543-b7e4-5a2d33196625 req-0d2c6c27-b780-40c8-9874-a3d7d1e6b9a5 service nova] Acquiring lock "refresh_cache-703a5060-dd34-4fff-9dec-6924ad018713" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:20:14 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Successfully created port: 7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:20:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:14 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:20:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:14 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:20:14 user nova-compute[72820]: INFO nova.compute.claims [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Claim successful on node user
Aug 27 02:20:14 user nova-compute[72820]: DEBUG nova.network.neutron [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Updating instance_info_cache with network_info: [{"id": "3174b771-02bc-4766-9e03-53c1e899b297", "address": "fa:16:3e:50:07:21", "network": {"id": "06365b03-94bf-4068-a08a-b794dc377256", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1090515065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87dab14feca44a93aaf191cedb1b0a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3174b771-02", "ovs_interfaceid": "3174b771-02bc-4766-9e03-53c1e899b297", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Releasing lock "refresh_cache-703a5060-dd34-4fff-9dec-6924ad018713" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.compute.manager [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Instance network_info: |[{"id": "3174b771-02bc-4766-9e03-53c1e899b297", "address": "fa:16:3e:50:07:21", "network": {"id": "06365b03-94bf-4068-a08a-b794dc377256", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1090515065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87dab14feca44a93aaf191cedb1b0a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3174b771-02", "ovs_interfaceid": "3174b771-02bc-4766-9e03-53c1e899b297", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2cd9098d-ad6b-4543-b7e4-5a2d33196625 req-0d2c6c27-b780-40c8-9874-a3d7d1e6b9a5 service nova] Acquired lock "refresh_cache-703a5060-dd34-4fff-9dec-6924ad018713" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.network.neutron [req-2cd9098d-ad6b-4543-b7e4-5a2d33196625 req-0d2c6c27-b780-40c8-9874-a3d7d1e6b9a5 service nova] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Refreshing network info cache for port 3174b771-02bc-4766-9e03-53c1e899b297 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Start _get_guest_xml network_info=[{"id": "3174b771-02bc-4766-9e03-53c1e899b297", "address": "fa:16:3e:50:07:21", "network": {"id": "06365b03-94bf-4068-a08a-b794dc377256", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1090515065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87dab14feca44a93aaf191cedb1b0a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3174b771-02", "ovs_interfaceid": "3174b771-02bc-4766-9e03-53c1e899b297", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:20:15 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:20:15 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.privsep.utils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1386185593',display_name='tempest-DeleteServersTestJSON-server-1386185593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1386185593',id=1,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87dab14feca44a93aaf191cedb1b0a14',ramdisk_id='',reservation_id='r-0ctckil0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-580668285',owner_user_name='tempest-DeleteServersTestJSON-580668285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:20:08Z,user_data=None,user_id='4d23062df28045afb400b603b9defb27',uuid=703a5060-dd34-4fff-9dec-6924ad018713,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3174b771-02bc-4766-9e03-53c1e899b297", "address": "fa:16:3e:50:07:21", "network": {"id": "06365b03-94bf-4068-a08a-b794dc377256", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1090515065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87dab14feca44a93aaf191cedb1b0a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3174b771-02", "ovs_interfaceid": "3174b771-02bc-4766-9e03-53c1e899b297", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Converting VIF {"id": "3174b771-02bc-4766-9e03-53c1e899b297", "address": "fa:16:3e:50:07:21", "network": {"id": "06365b03-94bf-4068-a08a-b794dc377256", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1090515065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87dab14feca44a93aaf191cedb1b0a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3174b771-02", "ovs_interfaceid": "3174b771-02bc-4766-9e03-53c1e899b297", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:07:21,bridge_name='br-int',has_traffic_filtering=True,id=3174b771-02bc-4766-9e03-53c1e899b297,network=Network(06365b03-94bf-4068-a08a-b794dc377256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3174b771-02') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.objects.instance [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lazy-loading 'pci_devices' on Instance uuid 703a5060-dd34-4fff-9dec-6924ad018713 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:20:15 user nova-compute[72820]:   <uuid>703a5060-dd34-4fff-9dec-6924ad018713</uuid>
Aug 27 02:20:15 user nova-compute[72820]:   <name>instance-00000001</name>
Aug 27 02:20:15 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:20:15 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:20:15 user nova-compute[72820]:   <metadata>
Aug 27 02:20:15 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:20:15 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:20:15 user nova-compute[72820]:       <nova:name>tempest-DeleteServersTestJSON-server-1386185593</nova:name>
Aug 27 02:20:15 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:20:15</nova:creationTime>
Aug 27 02:20:15 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:20:15 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:20:15 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:20:15 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:20:15 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:20:15 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:20:15 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:20:15 user nova-compute[72820]:       <nova:owner>
Aug 27 02:20:15 user nova-compute[72820]:         <nova:user uuid="4d23062df28045afb400b603b9defb27">tempest-DeleteServersTestJSON-580668285-project-member</nova:user>
Aug 27 02:20:15 user nova-compute[72820]:         <nova:project uuid="87dab14feca44a93aaf191cedb1b0a14">tempest-DeleteServersTestJSON-580668285</nova:project>
Aug 27 02:20:15 user nova-compute[72820]:       </nova:owner>
Aug 27 02:20:15 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:20:15 user nova-compute[72820]:       <nova:ports>
Aug 27 02:20:15 user nova-compute[72820]:         <nova:port uuid="3174b771-02bc-4766-9e03-53c1e899b297">
Aug 27 02:20:15 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 02:20:15 user nova-compute[72820]:         </nova:port>
Aug 27 02:20:15 user nova-compute[72820]:       </nova:ports>
Aug 27 02:20:15 user nova-compute[72820]:     </nova:instance>
Aug 27 02:20:15 user nova-compute[72820]:   </metadata>
Aug 27 02:20:15 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:20:15 user nova-compute[72820]:     <system>
Aug 27 02:20:15 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:20:15 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:20:15 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:20:15 user nova-compute[72820]:       <entry name="serial">703a5060-dd34-4fff-9dec-6924ad018713</entry>
Aug 27 02:20:15 user nova-compute[72820]:       <entry name="uuid">703a5060-dd34-4fff-9dec-6924ad018713</entry>
Aug 27 02:20:15 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:20:15 user nova-compute[72820]:     </system>
Aug 27 02:20:15 user nova-compute[72820]:   </sysinfo>
Aug 27 02:20:15 user nova-compute[72820]:   <os>
Aug 27 02:20:15 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:20:15 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:20:15 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:20:15 user nova-compute[72820]:   </os>
Aug 27 02:20:15 user nova-compute[72820]:   <features>
Aug 27 02:20:15 user nova-compute[72820]:     <acpi/>
Aug 27 02:20:15 user nova-compute[72820]:     <apic/>
Aug 27 02:20:15 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:20:15 user nova-compute[72820]:   </features>
Aug 27 02:20:15 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:20:15 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:20:15 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:20:15 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:20:15 user nova-compute[72820]:   </clock>
Aug 27 02:20:15 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:20:15 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:20:15 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:20:15 user nova-compute[72820]:   </cpu>
Aug 27 02:20:15 user nova-compute[72820]:   <devices>
Aug 27 02:20:15 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:20:15 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:20:15 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/disk"/>
Aug 27 02:20:15 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:20:15 user nova-compute[72820]:     </disk>
Aug 27 02:20:15 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:20:15 user nova-compute[72820]:       <mac address="fa:16:3e:50:07:21"/>
Aug 27 02:20:15 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:20:15 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:20:15 user nova-compute[72820]:       <target dev="tap3174b771-02"/>
Aug 27 02:20:15 user nova-compute[72820]:     </interface>
Aug 27 02:20:15 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:20:15 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/console.log" append="off"/>
Aug 27 02:20:15 user nova-compute[72820]:     </serial>
Aug 27 02:20:15 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:20:15 user nova-compute[72820]:     <video>
Aug 27 02:20:15 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:20:15 user nova-compute[72820]:     </video>
Aug 27 02:20:15 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:20:15 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:20:15 user nova-compute[72820]:     </rng>
Aug 27 02:20:15 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:20:15 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:20:15 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:20:15 user nova-compute[72820]:     </memballoon>
Aug 27 02:20:15 user nova-compute[72820]:   </devices>
Aug 27 02:20:15 user nova-compute[72820]: </domain>
Aug 27 02:20:15 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1386185593',display_name='tempest-DeleteServersTestJSON-server-1386185593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1386185593',id=1,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87dab14feca44a93aaf191cedb1b0a14',ramdisk_id='',reservation_id='r-0ctckil0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-580668285',owner_user_name='tempest-DeleteServersTestJSON-580668285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:20:08Z,user_data=None,user_id='4d23062df28045afb400b603b9defb27',uuid=703a5060-dd34-4fff-9dec-6924ad018713,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3174b771-02bc-4766-9e03-53c1e899b297", "address": "fa:16:3e:50:07:21", "network": {"id": "06365b03-94bf-4068-a08a-b794dc377256", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1090515065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87dab14feca44a93aaf191cedb1b0a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3174b771-02", "ovs_interfaceid": "3174b771-02bc-4766-9e03-53c1e899b297", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Converting VIF {"id": "3174b771-02bc-4766-9e03-53c1e899b297", "address": "fa:16:3e:50:07:21", "network": {"id": "06365b03-94bf-4068-a08a-b794dc377256", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1090515065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87dab14feca44a93aaf191cedb1b0a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3174b771-02", "ovs_interfaceid": "3174b771-02bc-4766-9e03-53c1e899b297", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:07:21,bridge_name='br-int',has_traffic_filtering=True,id=3174b771-02bc-4766-9e03-53c1e899b297,network=Network(06365b03-94bf-4068-a08a-b794dc377256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3174b771-02') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG os_vif [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:07:21,bridge_name='br-int',has_traffic_filtering=True,id=3174b771-02bc-4766-9e03-53c1e899b297,network=Network(06365b03-94bf-4068-a08a-b794dc377256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3174b771-02') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Created schema index Interface.name {{(pid=72820) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Created schema index Port.name {{(pid=72820) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Created schema index Bridge.name {{(pid=72820) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [POLLOUT] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:20:15 user nova-compute[72820]: INFO oslo.privsep.daemon [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmphb8of2nz/privsep.sock']
Aug 27 02:20:15 user sudo[82156]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmphb8of2nz/privsep.sock
Aug 27 02:20:15 user sudo[82156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:20:15 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:20:15 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Creating image(s)
Aug 27 02:20:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "/opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "/opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.policy [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '250575b5f1464f97b2e95bb1c8e46dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f0d3ebcd3c470c8927c690914135d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.198s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.network.neutron [req-2cd9098d-ad6b-4543-b7e4-5a2d33196625 req-0d2c6c27-b780-40c8-9874-a3d7d1e6b9a5 service nova] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Updated VIF entry in instance network info cache for port 3174b771-02bc-4766-9e03-53c1e899b297. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG nova.network.neutron [req-2cd9098d-ad6b-4543-b7e4-5a2d33196625 req-0d2c6c27-b780-40c8-9874-a3d7d1e6b9a5 service nova] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Updating instance_info_cache with network_info: [{"id": "3174b771-02bc-4766-9e03-53c1e899b297", "address": "fa:16:3e:50:07:21", "network": {"id": "06365b03-94bf-4068-a08a-b794dc377256", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1090515065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87dab14feca44a93aaf191cedb1b0a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3174b771-02", "ovs_interfaceid": "3174b771-02bc-4766-9e03-53c1e899b297", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.196s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Successfully updated port: 7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2cd9098d-ad6b-4543-b7e4-5a2d33196625 req-0d2c6c27-b780-40c8-9874-a3d7d1e6b9a5 service nova] Releasing lock "refresh_cache-703a5060-dd34-4fff-9dec-6924ad018713" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk 1073741824" returned: 0 in 0.053s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "refresh_cache-f8f612f3-41c9-4dae-8d49-218d61720b15" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquired lock "refresh_cache-f8f612f3-41c9-4dae-8d49-218d61720b15" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.181s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Cannot resize image /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Ensure instance console log exists: /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Updating instance_info_cache with network_info: [{"id": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "address": "fa:16:3e:64:42:e4", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c62328f-29", "ovs_interfaceid": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Releasing lock "refresh_cache-f8f612f3-41c9-4dae-8d49-218d61720b15" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Instance network_info: |[{"id": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "address": "fa:16:3e:64:42:e4", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c62328f-29", "ovs_interfaceid": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Start _get_guest_xml network_info=[{"id": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "address": "fa:16:3e:64:42:e4", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c62328f-29", "ovs_interfaceid": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:20:16 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:20:16 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-402850353',display_name='tempest-ServerRescueNegativeTestJSON-server-402850353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-402850353',id=3,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca683dd78dbf41ec8fbe3d3f76011272',ramdisk_id='',reservation_id='r-g4u7ta58',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1600105144',owner_user_name='tempest-ServerRescueNegativeTestJSON-1600105144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:20:13Z,user_data=None,user_id='a7f59dea3a6f4315828320a9ae6c721d',uuid=f8f612f3-41c9-4dae-8d49-218d61720b15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "address": "fa:16:3e:64:42:e4", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c62328f-29", "ovs_interfaceid": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converting VIF {"id": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "address": "fa:16:3e:64:42:e4", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c62328f-29", "ovs_interfaceid": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:42:e4,bridge_name='br-int',has_traffic_filtering=True,id=7c62328f-29e6-4fbb-88c7-31c0851c5fe4,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c62328f-29') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.objects.instance [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'pci_devices' on Instance uuid f8f612f3-41c9-4dae-8d49-218d61720b15 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.compute.manager [req-8e4fee67-16ee-44c2-92f5-c83de28a1e85 req-50f758ec-6594-496d-99a6-62d486362462 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Received event network-changed-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.compute.manager [req-8e4fee67-16ee-44c2-92f5-c83de28a1e85 req-50f758ec-6594-496d-99a6-62d486362462 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Refreshing instance network info cache due to event network-changed-7c62328f-29e6-4fbb-88c7-31c0851c5fe4. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8e4fee67-16ee-44c2-92f5-c83de28a1e85 req-50f758ec-6594-496d-99a6-62d486362462 service nova] Acquiring lock "refresh_cache-f8f612f3-41c9-4dae-8d49-218d61720b15" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8e4fee67-16ee-44c2-92f5-c83de28a1e85 req-50f758ec-6594-496d-99a6-62d486362462 service nova] Acquired lock "refresh_cache-f8f612f3-41c9-4dae-8d49-218d61720b15" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.network.neutron [req-8e4fee67-16ee-44c2-92f5-c83de28a1e85 req-50f758ec-6594-496d-99a6-62d486362462 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Refreshing network info cache for port 7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:20:16 user nova-compute[72820]:   <uuid>f8f612f3-41c9-4dae-8d49-218d61720b15</uuid>
Aug 27 02:20:16 user nova-compute[72820]:   <name>instance-00000003</name>
Aug 27 02:20:16 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:20:16 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:20:16 user nova-compute[72820]:   <metadata>
Aug 27 02:20:16 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:20:16 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:20:16 user nova-compute[72820]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-402850353</nova:name>
Aug 27 02:20:16 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:20:16</nova:creationTime>
Aug 27 02:20:16 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:20:16 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:20:16 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:20:16 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:20:16 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:20:16 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:20:16 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:20:16 user nova-compute[72820]:       <nova:owner>
Aug 27 02:20:16 user nova-compute[72820]:         <nova:user uuid="a7f59dea3a6f4315828320a9ae6c721d">tempest-ServerRescueNegativeTestJSON-1600105144-project-member</nova:user>
Aug 27 02:20:16 user nova-compute[72820]:         <nova:project uuid="ca683dd78dbf41ec8fbe3d3f76011272">tempest-ServerRescueNegativeTestJSON-1600105144</nova:project>
Aug 27 02:20:16 user nova-compute[72820]:       </nova:owner>
Aug 27 02:20:16 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:20:16 user nova-compute[72820]:       <nova:ports>
Aug 27 02:20:16 user nova-compute[72820]:         <nova:port uuid="7c62328f-29e6-4fbb-88c7-31c0851c5fe4">
Aug 27 02:20:16 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 02:20:16 user nova-compute[72820]:         </nova:port>
Aug 27 02:20:16 user nova-compute[72820]:       </nova:ports>
Aug 27 02:20:16 user nova-compute[72820]:     </nova:instance>
Aug 27 02:20:16 user nova-compute[72820]:   </metadata>
Aug 27 02:20:16 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:20:16 user nova-compute[72820]:     <system>
Aug 27 02:20:16 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:20:16 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:20:16 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:20:16 user nova-compute[72820]:       <entry name="serial">f8f612f3-41c9-4dae-8d49-218d61720b15</entry>
Aug 27 02:20:16 user nova-compute[72820]:       <entry name="uuid">f8f612f3-41c9-4dae-8d49-218d61720b15</entry>
Aug 27 02:20:16 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:20:16 user nova-compute[72820]:     </system>
Aug 27 02:20:16 user nova-compute[72820]:   </sysinfo>
Aug 27 02:20:16 user nova-compute[72820]:   <os>
Aug 27 02:20:16 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:20:16 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:20:16 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:20:16 user nova-compute[72820]:   </os>
Aug 27 02:20:16 user nova-compute[72820]:   <features>
Aug 27 02:20:16 user nova-compute[72820]:     <acpi/>
Aug 27 02:20:16 user nova-compute[72820]:     <apic/>
Aug 27 02:20:16 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:20:16 user nova-compute[72820]:   </features>
Aug 27 02:20:16 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:20:16 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:20:16 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:20:16 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:20:16 user nova-compute[72820]:   </clock>
Aug 27 02:20:16 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:20:16 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:20:16 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:20:16 user nova-compute[72820]:   </cpu>
Aug 27 02:20:16 user nova-compute[72820]:   <devices>
Aug 27 02:20:16 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:20:16 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:20:16 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk"/>
Aug 27 02:20:16 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:20:16 user nova-compute[72820]:     </disk>
Aug 27 02:20:16 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:20:16 user nova-compute[72820]:       <mac address="fa:16:3e:64:42:e4"/>
Aug 27 02:20:16 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:20:16 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:20:16 user nova-compute[72820]:       <target dev="tap7c62328f-29"/>
Aug 27 02:20:16 user nova-compute[72820]:     </interface>
Aug 27 02:20:16 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:20:16 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/console.log" append="off"/>
Aug 27 02:20:16 user nova-compute[72820]:     </serial>
Aug 27 02:20:16 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:20:16 user nova-compute[72820]:     <video>
Aug 27 02:20:16 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:20:16 user nova-compute[72820]:     </video>
Aug 27 02:20:16 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:20:16 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:20:16 user nova-compute[72820]:     </rng>
Aug 27 02:20:16 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:20:16 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:20:16 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:20:16 user nova-compute[72820]:     </memballoon>
Aug 27 02:20:16 user nova-compute[72820]:   </devices>
Aug 27 02:20:16 user nova-compute[72820]: </domain>
Aug 27 02:20:16 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-402850353',display_name='tempest-ServerRescueNegativeTestJSON-server-402850353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-402850353',id=3,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca683dd78dbf41ec8fbe3d3f76011272',ramdisk_id='',reservation_id='r-g4u7ta58',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1600105144',owner_user_name='tempest-ServerRescueNegativeTestJSON-1600105144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:20:13Z,user_data=None,user_id='a7f59dea3a6f4315828320a9ae6c721d',uuid=f8f612f3-41c9-4dae-8d49-218d61720b15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "address": "fa:16:3e:64:42:e4", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c62328f-29", "ovs_interfaceid": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converting VIF {"id": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "address": "fa:16:3e:64:42:e4", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c62328f-29", "ovs_interfaceid": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:42:e4,bridge_name='br-int',has_traffic_filtering=True,id=7c62328f-29e6-4fbb-88c7-31c0851c5fe4,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c62328f-29') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG os_vif [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:42:e4,bridge_name='br-int',has_traffic_filtering=True,id=7c62328f-29e6-4fbb-88c7-31c0851c5fe4,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c62328f-29') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:20:17 user sudo[82156]: pam_unix(sudo:session): session closed for user root
Aug 27 02:20:17 user nova-compute[72820]: INFO oslo.privsep.daemon [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Spawned new privsep daemon via rootwrap
Aug 27 02:20:17 user nova-compute[72820]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 27 02:20:17 user nova-compute[72820]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 27 02:20:17 user nova-compute[72820]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 27 02:20:17 user nova-compute[72820]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82175
Aug 27 02:20:17 user nova-compute[72820]: WARNING oslo_privsep.priv_context [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] privsep daemon already running
Aug 27 02:20:17 user nova-compute[72820]: DEBUG nova.network.neutron [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Successfully updated port: 4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquired lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG nova.network.neutron [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG nova.compute.manager [req-0504adcc-a0db-4540-a908-9949e026e3ee req-264ad758-21a4-4f71-bd8d-46622225d9ab service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received event network-changed-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG nova.compute.manager [req-0504adcc-a0db-4540-a908-9949e026e3ee req-264ad758-21a4-4f71-bd8d-46622225d9ab service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Refreshing instance network info cache due to event network-changed-4a579280-0dce-49fb-861a-4577ba1d70a3. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0504adcc-a0db-4540-a908-9949e026e3ee req-264ad758-21a4-4f71-bd8d-46622225d9ab service nova] Acquiring lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG nova.network.neutron [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3174b771-02, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3174b771-02, col_values=(('external_ids', {'iface-id': '3174b771-02bc-4766-9e03-53c1e899b297', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:07:21', 'vm-uuid': '703a5060-dd34-4fff-9dec-6924ad018713'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:17 user nova-compute[72820]: INFO os_vif [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:07:21,bridge_name='br-int',has_traffic_filtering=True,id=3174b771-02bc-4766-9e03-53c1e899b297,network=Network(06365b03-94bf-4068-a08a-b794dc377256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3174b771-02')
Aug 27 02:20:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c62328f-29, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c62328f-29, col_values=(('external_ids', {'iface-id': '7c62328f-29e6-4fbb-88c7-31c0851c5fe4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:42:e4', 'vm-uuid': 'f8f612f3-41c9-4dae-8d49-218d61720b15'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:17 user nova-compute[72820]: INFO os_vif [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:42:e4,bridge_name='br-int',has_traffic_filtering=True,id=7c62328f-29e6-4fbb-88c7-31c0851c5fe4,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c62328f-29')
Aug 27 02:20:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] No VIF found with MAC fa:16:3e:50:07:21, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:20:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] No VIF found with MAC fa:16:3e:64:42:e4, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:20:18 user nova-compute[72820]: DEBUG nova.network.neutron [req-8e4fee67-16ee-44c2-92f5-c83de28a1e85 req-50f758ec-6594-496d-99a6-62d486362462 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Updated VIF entry in instance network info cache for port 7c62328f-29e6-4fbb-88c7-31c0851c5fe4. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:20:18 user nova-compute[72820]: DEBUG nova.network.neutron [req-8e4fee67-16ee-44c2-92f5-c83de28a1e85 req-50f758ec-6594-496d-99a6-62d486362462 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Updating instance_info_cache with network_info: [{"id": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "address": "fa:16:3e:64:42:e4", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c62328f-29", "ovs_interfaceid": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:20:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8e4fee67-16ee-44c2-92f5-c83de28a1e85 req-50f758ec-6594-496d-99a6-62d486362462 service nova] Releasing lock "refresh_cache-f8f612f3-41c9-4dae-8d49-218d61720b15" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:20:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "6f37daba-9183-4111-bd01-f30cc4b83c2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "6f37daba-9183-4111-bd01-f30cc4b83c2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:18 user nova-compute[72820]: DEBUG nova.compute.manager [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:20:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:20:18 user nova-compute[72820]: INFO nova.compute.claims [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Claim successful on node user
Aug 27 02:20:18 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:20:18 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:20:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:18 user nova-compute[72820]: DEBUG nova.compute.manager [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:20:18 user nova-compute[72820]: DEBUG nova.compute.manager [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:20:18 user nova-compute[72820]: DEBUG nova.network.neutron [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:20:18 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.compute.manager [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.compute.manager [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:20:19 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Creating image(s)
Aug 27 02:20:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "/opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "/opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.policy [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '275f713edfd042d4b4fa32620956484a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7797569db44f40f193483e6e6933a0d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.210s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.network.neutron [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Updating instance_info_cache with network_info: [{"id": "4a579280-0dce-49fb-861a-4577ba1d70a3", "address": "fa:16:3e:37:4e:12", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a579280-0d", "ovs_interfaceid": "4a579280-0dce-49fb-861a-4577ba1d70a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Releasing lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Instance network_info: |[{"id": "4a579280-0dce-49fb-861a-4577ba1d70a3", "address": "fa:16:3e:37:4e:12", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a579280-0d", "ovs_interfaceid": "4a579280-0dce-49fb-861a-4577ba1d70a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0504adcc-a0db-4540-a908-9949e026e3ee req-264ad758-21a4-4f71-bd8d-46622225d9ab service nova] Acquired lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.network.neutron [req-0504adcc-a0db-4540-a908-9949e026e3ee req-264ad758-21a4-4f71-bd8d-46622225d9ab service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Refreshing network info cache for port 4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Start _get_guest_xml network_info=[{"id": "4a579280-0dce-49fb-861a-4577ba1d70a3", "address": "fa:16:3e:37:4e:12", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a579280-0d", "ovs_interfaceid": "4a579280-0dce-49fb-861a-4577ba1d70a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:20:19 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:20:19 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1979247934',display_name='tempest-ServerRescueNegativeTestJSON-server-1979247934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1979247934',id=2,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca683dd78dbf41ec8fbe3d3f76011272',ramdisk_id='',reservation_id='r-wryc5lmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1600105144',owner_user_name='tempest-ServerRescueNegativeTestJSON-1600105144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:20:11Z,user_data=None,user_id='a7f59dea3a6f4315828320a9ae6c721d',uuid=26581695-c4b9-40b8-ab7a-34c99db0dadb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a579280-0dce-49fb-861a-4577ba1d70a3", "address": "fa:16:3e:37:4e:12", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a579280-0d", "ovs_interfaceid": "4a579280-0dce-49fb-861a-4577ba1d70a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converting VIF {"id": "4a579280-0dce-49fb-861a-4577ba1d70a3", "address": "fa:16:3e:37:4e:12", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a579280-0d", "ovs_interfaceid": "4a579280-0dce-49fb-861a-4577ba1d70a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:4e:12,bridge_name='br-int',has_traffic_filtering=True,id=4a579280-0dce-49fb-861a-4577ba1d70a3,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a579280-0d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.objects.instance [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'pci_devices' on Instance uuid 26581695-c4b9-40b8-ab7a-34c99db0dadb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:20:19 user nova-compute[72820]:   <uuid>26581695-c4b9-40b8-ab7a-34c99db0dadb</uuid>
Aug 27 02:20:19 user nova-compute[72820]:   <name>instance-00000002</name>
Aug 27 02:20:19 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:20:19 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:20:19 user nova-compute[72820]:   <metadata>
Aug 27 02:20:19 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:20:19 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:20:19 user nova-compute[72820]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1979247934</nova:name>
Aug 27 02:20:19 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:20:19</nova:creationTime>
Aug 27 02:20:19 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:20:19 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:20:19 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:20:19 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:20:19 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:20:19 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:20:19 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:20:19 user nova-compute[72820]:       <nova:owner>
Aug 27 02:20:19 user nova-compute[72820]:         <nova:user uuid="a7f59dea3a6f4315828320a9ae6c721d">tempest-ServerRescueNegativeTestJSON-1600105144-project-member</nova:user>
Aug 27 02:20:19 user nova-compute[72820]:         <nova:project uuid="ca683dd78dbf41ec8fbe3d3f76011272">tempest-ServerRescueNegativeTestJSON-1600105144</nova:project>
Aug 27 02:20:19 user nova-compute[72820]:       </nova:owner>
Aug 27 02:20:19 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:20:19 user nova-compute[72820]:       <nova:ports>
Aug 27 02:20:19 user nova-compute[72820]:         <nova:port uuid="4a579280-0dce-49fb-861a-4577ba1d70a3">
Aug 27 02:20:19 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 02:20:19 user nova-compute[72820]:         </nova:port>
Aug 27 02:20:19 user nova-compute[72820]:       </nova:ports>
Aug 27 02:20:19 user nova-compute[72820]:     </nova:instance>
Aug 27 02:20:19 user nova-compute[72820]:   </metadata>
Aug 27 02:20:19 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:20:19 user nova-compute[72820]:     <system>
Aug 27 02:20:19 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:20:19 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:20:19 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:20:19 user nova-compute[72820]:       <entry name="serial">26581695-c4b9-40b8-ab7a-34c99db0dadb</entry>
Aug 27 02:20:19 user nova-compute[72820]:       <entry name="uuid">26581695-c4b9-40b8-ab7a-34c99db0dadb</entry>
Aug 27 02:20:19 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:20:19 user nova-compute[72820]:     </system>
Aug 27 02:20:19 user nova-compute[72820]:   </sysinfo>
Aug 27 02:20:19 user nova-compute[72820]:   <os>
Aug 27 02:20:19 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:20:19 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:20:19 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:20:19 user nova-compute[72820]:   </os>
Aug 27 02:20:19 user nova-compute[72820]:   <features>
Aug 27 02:20:19 user nova-compute[72820]:     <acpi/>
Aug 27 02:20:19 user nova-compute[72820]:     <apic/>
Aug 27 02:20:19 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:20:19 user nova-compute[72820]:   </features>
Aug 27 02:20:19 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:20:19 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:20:19 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:20:19 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:20:19 user nova-compute[72820]:   </clock>
Aug 27 02:20:19 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:20:19 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:20:19 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:20:19 user nova-compute[72820]:   </cpu>
Aug 27 02:20:19 user nova-compute[72820]:   <devices>
Aug 27 02:20:19 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:20:19 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:20:19 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk"/>
Aug 27 02:20:19 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:20:19 user nova-compute[72820]:     </disk>
Aug 27 02:20:19 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:20:19 user nova-compute[72820]:       <mac address="fa:16:3e:37:4e:12"/>
Aug 27 02:20:19 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:20:19 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:20:19 user nova-compute[72820]:       <target dev="tap4a579280-0d"/>
Aug 27 02:20:19 user nova-compute[72820]:     </interface>
Aug 27 02:20:19 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:20:19 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/console.log" append="off"/>
Aug 27 02:20:19 user nova-compute[72820]:     </serial>
Aug 27 02:20:19 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:20:19 user nova-compute[72820]:     <video>
Aug 27 02:20:19 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:20:19 user nova-compute[72820]:     </video>
Aug 27 02:20:19 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:20:19 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:20:19 user nova-compute[72820]:     </rng>
Aug 27 02:20:19 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:20:19 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:20:19 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:20:19 user nova-compute[72820]:     </memballoon>
Aug 27 02:20:19 user nova-compute[72820]:   </devices>
Aug 27 02:20:19 user nova-compute[72820]: </domain>
Aug 27 02:20:19 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1979247934',display_name='tempest-ServerRescueNegativeTestJSON-server-1979247934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1979247934',id=2,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca683dd78dbf41ec8fbe3d3f76011272',ramdisk_id='',reservation_id='r-wryc5lmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1600105144',owner_user_name='tempest-ServerRescueNegativeTestJSON-1600105144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:20:11Z,user_data=None,user_id='a7f59dea3a6f4315828320a9ae6c721d',uuid=26581695-c4b9-40b8-ab7a-34c99db0dadb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a579280-0dce-49fb-861a-4577ba1d70a3", "address": "fa:16:3e:37:4e:12", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a579280-0d", "ovs_interfaceid": "4a579280-0dce-49fb-861a-4577ba1d70a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converting VIF {"id": "4a579280-0dce-49fb-861a-4577ba1d70a3", "address": "fa:16:3e:37:4e:12", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a579280-0d", "ovs_interfaceid": "4a579280-0dce-49fb-861a-4577ba1d70a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:4e:12,bridge_name='br-int',has_traffic_filtering=True,id=4a579280-0dce-49fb-861a-4577ba1d70a3,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a579280-0d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG os_vif [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:4e:12,bridge_name='br-int',has_traffic_filtering=True,id=4a579280-0dce-49fb-861a-4577ba1d70a3,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a579280-0d') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a579280-0d, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a579280-0d, col_values=(('external_ids', {'iface-id': '4a579280-0dce-49fb-861a-4577ba1d70a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:4e:12', 'vm-uuid': '26581695-c4b9-40b8-ab7a-34c99db0dadb'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.202s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:19 user nova-compute[72820]: INFO os_vif [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:4e:12,bridge_name='br-int',has_traffic_filtering=True,id=4a579280-0dce-49fb-861a-4577ba1d70a3,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a579280-0d')
Aug 27 02:20:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk 1073741824" returned: 0 in 0.049s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] No VIF found with MAC fa:16:3e:37:4e:12, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:19 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Successfully created port: dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:20:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:20 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Cannot resize image /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:20:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:20:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Ensure instance console log exists: /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:20:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:21 user nova-compute[72820]: DEBUG nova.network.neutron [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Successfully created port: a0280116-060c-4078-b415-7abd9005c221 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:20:22 user nova-compute[72820]: DEBUG nova.network.neutron [req-0504adcc-a0db-4540-a908-9949e026e3ee req-264ad758-21a4-4f71-bd8d-46622225d9ab service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Updated VIF entry in instance network info cache for port 4a579280-0dce-49fb-861a-4577ba1d70a3. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:20:22 user nova-compute[72820]: DEBUG nova.network.neutron [req-0504adcc-a0db-4540-a908-9949e026e3ee req-264ad758-21a4-4f71-bd8d-46622225d9ab service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Updating instance_info_cache with network_info: [{"id": "4a579280-0dce-49fb-861a-4577ba1d70a3", "address": "fa:16:3e:37:4e:12", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a579280-0d", "ovs_interfaceid": "4a579280-0dce-49fb-861a-4577ba1d70a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:20:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0504adcc-a0db-4540-a908-9949e026e3ee req-264ad758-21a4-4f71-bd8d-46622225d9ab service nova] Releasing lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:20:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:23 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102823.6778407, 703a5060-dd34-4fff-9dec-6924ad018713 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:20:23 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] VM Resumed (Lifecycle Event)
Aug 27 02:20:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:20:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:20:23 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Instance spawned successfully.
Aug 27 02:20:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:20:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:20:23 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:20:23 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102823.6983473, 703a5060-dd34-4fff-9dec-6924ad018713 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:20:23 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] VM Started (Lifecycle Event)
Aug 27 02:20:23 user nova-compute[72820]: INFO nova.compute.manager [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Took 16.17 seconds to spawn the instance on the hypervisor.
Aug 27 02:20:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:23 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Successfully updated port: dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:20:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:20:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:20:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquired lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:20:23 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:20:24 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:20:24 user nova-compute[72820]: INFO nova.compute.manager [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Took 17.30 seconds to build instance.
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-07630a59-d80a-4493-b6f7-a162cffe182f req-74174495-a64d-4dbe-8eb8-5fc4308ed3c2 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-changed-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-07630a59-d80a-4493-b6f7-a162cffe182f req-74174495-a64d-4dbe-8eb8-5fc4308ed3c2 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Refreshing instance network info cache due to event network-changed-dc035bdf-5877-42fe-b1e2-fa882373f836. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-07630a59-d80a-4493-b6f7-a162cffe182f req-74174495-a64d-4dbe-8eb8-5fc4308ed3c2 service nova] Acquiring lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-91a101eb-b5ab-473b-a594-b38acb88a0b3 tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "703a5060-dd34-4fff-9dec-6924ad018713" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.589s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.network.neutron [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Successfully updated port: a0280116-060c-4078-b415-7abd9005c221 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquired lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.network.neutron [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102824.389962, f8f612f3-41c9-4dae-8d49-218d61720b15 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:20:24 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] VM Resumed (Lifecycle Event)
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:20:24 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Instance spawned successfully.
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:24 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Instance spawned successfully.
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:24 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102824.3946404, f8f612f3-41c9-4dae-8d49-218d61720b15 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:20:24 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] VM Started (Lifecycle Event)
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-fe7b42ec-dbfe-4b18-b6c0-daef771ae7a3 req-96b1835d-d995-4de5-95fb-d708534ea7f8 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Received event network-changed-a0280116-060c-4078-b415-7abd9005c221 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-fe7b42ec-dbfe-4b18-b6c0-daef771ae7a3 req-96b1835d-d995-4de5-95fb-d708534ea7f8 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Refreshing instance network info cache due to event network-changed-a0280116-060c-4078-b415-7abd9005c221. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fe7b42ec-dbfe-4b18-b6c0-daef771ae7a3 req-96b1835d-d995-4de5-95fb-d708534ea7f8 service nova] Acquiring lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:20:24 user nova-compute[72820]: INFO nova.compute.manager [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Took 11.80 seconds to spawn the instance on the hypervisor.
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:24 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102824.421459, 26581695-c4b9-40b8-ab7a-34c99db0dadb => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:20:24 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] VM Resumed (Lifecycle Event)
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:20:24 user nova-compute[72820]: INFO nova.compute.manager [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Took 13.90 seconds to spawn the instance on the hypervisor.
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:24 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102824.4252412, 26581695-c4b9-40b8-ab7a-34c99db0dadb => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:20:24 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] VM Started (Lifecycle Event)
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.network.neutron [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:20:24 user nova-compute[72820]: INFO nova.compute.manager [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Took 12.75 seconds to build instance.
Aug 27 02:20:24 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:20:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d3d4e70-e2a8-4429-a68c-640d2a2f423b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.935s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:24 user nova-compute[72820]: INFO nova.compute.manager [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Took 15.13 seconds to build instance.
Aug 27 02:20:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6729ae63-1fdc-4c34-90ae-529061cfa17b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.434s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.network.neutron [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Updating instance_info_cache with network_info: [{"id": "a0280116-060c-4078-b415-7abd9005c221", "address": "fa:16:3e:dc:2f:1b", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0280116-06", "ovs_interfaceid": "a0280116-060c-4078-b415-7abd9005c221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Releasing lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Instance network_info: |[{"id": "a0280116-060c-4078-b415-7abd9005c221", "address": "fa:16:3e:dc:2f:1b", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0280116-06", "ovs_interfaceid": "a0280116-060c-4078-b415-7abd9005c221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fe7b42ec-dbfe-4b18-b6c0-daef771ae7a3 req-96b1835d-d995-4de5-95fb-d708534ea7f8 service nova] Acquired lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.network.neutron [req-fe7b42ec-dbfe-4b18-b6c0-daef771ae7a3 req-96b1835d-d995-4de5-95fb-d708534ea7f8 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Refreshing network info cache for port a0280116-060c-4078-b415-7abd9005c221 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Start _get_guest_xml network_info=[{"id": "a0280116-060c-4078-b415-7abd9005c221", "address": "fa:16:3e:dc:2f:1b", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0280116-06", "ovs_interfaceid": "a0280116-060c-4078-b415-7abd9005c221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:20:25 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:20:25 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1387597911',display_name='tempest-ServerActionsTestOtherA-server-1387597911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1387597911',id=5,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuMDNJccFoG9J2MvjXPhebjkkaCvYt2BV0fWoVRWE0WGnLVqeM0TmypkIBpwP+aIP0dc17AS8ytt0zxz7hB47f2I8lo+2akMvc3UtIkl7mLDLkN7AXVg520jT6ETK7MXw==',key_name='tempest-keypair-1957607282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7797569db44f40f193483e6e6933a0d0',ramdisk_id='',reservation_id='r-2pmbbm13',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-892102693',owner_user_name='tempest-ServerActionsTestOtherA-892102693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='275f713edfd042d4b4fa32620956484a',uuid=6f37daba-9183-4111-bd01-f30cc4b83c2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0280116-060c-4078-b415-7abd9005c221", "address": "fa:16:3e:dc:2f:1b", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0280116-06", "ovs_interfaceid": "a0280116-060c-4078-b415-7abd9005c221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converting VIF {"id": "a0280116-060c-4078-b415-7abd9005c221", "address": "fa:16:3e:dc:2f:1b", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0280116-06", "ovs_interfaceid": "a0280116-060c-4078-b415-7abd9005c221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2f:1b,bridge_name='br-int',has_traffic_filtering=True,id=a0280116-060c-4078-b415-7abd9005c221,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0280116-06') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.objects.instance [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f37daba-9183-4111-bd01-f30cc4b83c2f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:20:25 user nova-compute[72820]:   <uuid>6f37daba-9183-4111-bd01-f30cc4b83c2f</uuid>
Aug 27 02:20:25 user nova-compute[72820]:   <name>instance-00000005</name>
Aug 27 02:20:25 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:20:25 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:20:25 user nova-compute[72820]:   <metadata>
Aug 27 02:20:25 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:20:25 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:20:25 user nova-compute[72820]:       <nova:name>tempest-ServerActionsTestOtherA-server-1387597911</nova:name>
Aug 27 02:20:25 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:20:25</nova:creationTime>
Aug 27 02:20:25 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:20:25 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:20:25 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:20:25 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:20:25 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:20:25 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:20:25 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:20:25 user nova-compute[72820]:       <nova:owner>
Aug 27 02:20:25 user nova-compute[72820]:         <nova:user uuid="275f713edfd042d4b4fa32620956484a">tempest-ServerActionsTestOtherA-892102693-project-member</nova:user>
Aug 27 02:20:25 user nova-compute[72820]:         <nova:project uuid="7797569db44f40f193483e6e6933a0d0">tempest-ServerActionsTestOtherA-892102693</nova:project>
Aug 27 02:20:25 user nova-compute[72820]:       </nova:owner>
Aug 27 02:20:25 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:20:25 user nova-compute[72820]:       <nova:ports>
Aug 27 02:20:25 user nova-compute[72820]:         <nova:port uuid="a0280116-060c-4078-b415-7abd9005c221">
Aug 27 02:20:25 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 02:20:25 user nova-compute[72820]:         </nova:port>
Aug 27 02:20:25 user nova-compute[72820]:       </nova:ports>
Aug 27 02:20:25 user nova-compute[72820]:     </nova:instance>
Aug 27 02:20:25 user nova-compute[72820]:   </metadata>
Aug 27 02:20:25 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:20:25 user nova-compute[72820]:     <system>
Aug 27 02:20:25 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:20:25 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:20:25 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:20:25 user nova-compute[72820]:       <entry name="serial">6f37daba-9183-4111-bd01-f30cc4b83c2f</entry>
Aug 27 02:20:25 user nova-compute[72820]:       <entry name="uuid">6f37daba-9183-4111-bd01-f30cc4b83c2f</entry>
Aug 27 02:20:25 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:20:25 user nova-compute[72820]:     </system>
Aug 27 02:20:25 user nova-compute[72820]:   </sysinfo>
Aug 27 02:20:25 user nova-compute[72820]:   <os>
Aug 27 02:20:25 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:20:25 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:20:25 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:20:25 user nova-compute[72820]:   </os>
Aug 27 02:20:25 user nova-compute[72820]:   <features>
Aug 27 02:20:25 user nova-compute[72820]:     <acpi/>
Aug 27 02:20:25 user nova-compute[72820]:     <apic/>
Aug 27 02:20:25 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:20:25 user nova-compute[72820]:   </features>
Aug 27 02:20:25 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:20:25 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:20:25 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:20:25 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:20:25 user nova-compute[72820]:   </clock>
Aug 27 02:20:25 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:20:25 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:20:25 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:20:25 user nova-compute[72820]:   </cpu>
Aug 27 02:20:25 user nova-compute[72820]:   <devices>
Aug 27 02:20:25 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:20:25 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:20:25 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk"/>
Aug 27 02:20:25 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:20:25 user nova-compute[72820]:     </disk>
Aug 27 02:20:25 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:20:25 user nova-compute[72820]:       <mac address="fa:16:3e:dc:2f:1b"/>
Aug 27 02:20:25 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:20:25 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:20:25 user nova-compute[72820]:       <target dev="tapa0280116-06"/>
Aug 27 02:20:25 user nova-compute[72820]:     </interface>
Aug 27 02:20:25 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:20:25 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/console.log" append="off"/>
Aug 27 02:20:25 user nova-compute[72820]:     </serial>
Aug 27 02:20:25 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:20:25 user nova-compute[72820]:     <video>
Aug 27 02:20:25 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:20:25 user nova-compute[72820]:     </video>
Aug 27 02:20:25 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:20:25 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:20:25 user nova-compute[72820]:     </rng>
Aug 27 02:20:25 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:20:25 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:20:25 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:20:25 user nova-compute[72820]:     </memballoon>
Aug 27 02:20:25 user nova-compute[72820]:   </devices>
Aug 27 02:20:25 user nova-compute[72820]: </domain>
Aug 27 02:20:25 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1387597911',display_name='tempest-ServerActionsTestOtherA-server-1387597911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1387597911',id=5,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuMDNJccFoG9J2MvjXPhebjkkaCvYt2BV0fWoVRWE0WGnLVqeM0TmypkIBpwP+aIP0dc17AS8ytt0zxz7hB47f2I8lo+2akMvc3UtIkl7mLDLkN7AXVg520jT6ETK7MXw==',key_name='tempest-keypair-1957607282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7797569db44f40f193483e6e6933a0d0',ramdisk_id='',reservation_id='r-2pmbbm13',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-892102693',owner_user_name='tempest-ServerActionsTestOtherA-892102693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='275f713edfd042d4b4fa32620956484a',uuid=6f37daba-9183-4111-bd01-f30cc4b83c2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0280116-060c-4078-b415-7abd9005c221", "address": "fa:16:3e:dc:2f:1b", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0280116-06", "ovs_interfaceid": "a0280116-060c-4078-b415-7abd9005c221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converting VIF {"id": "a0280116-060c-4078-b415-7abd9005c221", "address": "fa:16:3e:dc:2f:1b", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0280116-06", "ovs_interfaceid": "a0280116-060c-4078-b415-7abd9005c221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2f:1b,bridge_name='br-int',has_traffic_filtering=True,id=a0280116-060c-4078-b415-7abd9005c221,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0280116-06') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG os_vif [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2f:1b,bridge_name='br-int',has_traffic_filtering=True,id=a0280116-060c-4078-b415-7abd9005c221,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0280116-06') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0280116-06, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0280116-06, col_values=(('external_ids', {'iface-id': 'a0280116-060c-4078-b415-7abd9005c221', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:2f:1b', 'vm-uuid': '6f37daba-9183-4111-bd01-f30cc4b83c2f'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:20:25 user nova-compute[72820]: INFO os_vif [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2f:1b,bridge_name='br-int',has_traffic_filtering=True,id=a0280116-060c-4078-b415-7abd9005c221,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0280116-06')
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:20:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] No VIF found with MAC fa:16:3e:dc:2f:1b, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Updating instance_info_cache with network_info: [{"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Releasing lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Instance network_info: |[{"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-07630a59-d80a-4493-b6f7-a162cffe182f req-74174495-a64d-4dbe-8eb8-5fc4308ed3c2 service nova] Acquired lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.network.neutron [req-07630a59-d80a-4493-b6f7-a162cffe182f req-74174495-a64d-4dbe-8eb8-5fc4308ed3c2 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Refreshing network info cache for port dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Start _get_guest_xml network_info=[{"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:20:26 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:20:26 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1676535291',display_name='tempest-ServerStableDeviceRescueTest-server-1676535291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1676535291',id=4,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB04yomk5T62vZJSVvoxy9wjx2XDDI3YyI0pgcUSmDJzHCnRqd17erEpyE4qTQ4t3kM+pbWYbc4lokzsskTc9ooGBqn+1IPsE5tH8dB/xD77C2OIF0/l2pafnLZ4Fi0WQ==',key_name='tempest-keypair-2001966138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2f0d3ebcd3c470c8927c690914135d9',ramdisk_id='',reservation_id='r-ku0xay81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-561556641',owner_user_name='tempest-ServerStableDeviceRescueTest-561556641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:20:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250575b5f1464f97b2e95bb1c8e46dbd',uuid=6ed3c12e-96a8-4a32-8089-f04eba608663,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Converting VIF {"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:6b:e8,bridge_name='br-int',has_traffic_filtering=True,id=dc035bdf-5877-42fe-b1e2-fa882373f836,network=Network(d4eb66d2-6165-4b86-b42b-f2f65c5e97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc035bdf-58') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.objects.instance [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ed3c12e-96a8-4a32-8089-f04eba608663 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:20:26 user nova-compute[72820]:   <uuid>6ed3c12e-96a8-4a32-8089-f04eba608663</uuid>
Aug 27 02:20:26 user nova-compute[72820]:   <name>instance-00000004</name>
Aug 27 02:20:26 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:20:26 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:20:26 user nova-compute[72820]:   <metadata>
Aug 27 02:20:26 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:20:26 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:20:26 user nova-compute[72820]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1676535291</nova:name>
Aug 27 02:20:26 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:20:26</nova:creationTime>
Aug 27 02:20:26 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:20:26 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:20:26 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:20:26 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:20:26 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:20:26 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:20:26 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:20:26 user nova-compute[72820]:       <nova:owner>
Aug 27 02:20:26 user nova-compute[72820]:         <nova:user uuid="250575b5f1464f97b2e95bb1c8e46dbd">tempest-ServerStableDeviceRescueTest-561556641-project-member</nova:user>
Aug 27 02:20:26 user nova-compute[72820]:         <nova:project uuid="b2f0d3ebcd3c470c8927c690914135d9">tempest-ServerStableDeviceRescueTest-561556641</nova:project>
Aug 27 02:20:26 user nova-compute[72820]:       </nova:owner>
Aug 27 02:20:26 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:20:26 user nova-compute[72820]:       <nova:ports>
Aug 27 02:20:26 user nova-compute[72820]:         <nova:port uuid="dc035bdf-5877-42fe-b1e2-fa882373f836">
Aug 27 02:20:26 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 02:20:26 user nova-compute[72820]:         </nova:port>
Aug 27 02:20:26 user nova-compute[72820]:       </nova:ports>
Aug 27 02:20:26 user nova-compute[72820]:     </nova:instance>
Aug 27 02:20:26 user nova-compute[72820]:   </metadata>
Aug 27 02:20:26 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:20:26 user nova-compute[72820]:     <system>
Aug 27 02:20:26 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:20:26 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:20:26 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:20:26 user nova-compute[72820]:       <entry name="serial">6ed3c12e-96a8-4a32-8089-f04eba608663</entry>
Aug 27 02:20:26 user nova-compute[72820]:       <entry name="uuid">6ed3c12e-96a8-4a32-8089-f04eba608663</entry>
Aug 27 02:20:26 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:20:26 user nova-compute[72820]:     </system>
Aug 27 02:20:26 user nova-compute[72820]:   </sysinfo>
Aug 27 02:20:26 user nova-compute[72820]:   <os>
Aug 27 02:20:26 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:20:26 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:20:26 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:20:26 user nova-compute[72820]:   </os>
Aug 27 02:20:26 user nova-compute[72820]:   <features>
Aug 27 02:20:26 user nova-compute[72820]:     <acpi/>
Aug 27 02:20:26 user nova-compute[72820]:     <apic/>
Aug 27 02:20:26 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:20:26 user nova-compute[72820]:   </features>
Aug 27 02:20:26 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:20:26 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:20:26 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:20:26 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:20:26 user nova-compute[72820]:   </clock>
Aug 27 02:20:26 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:20:26 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:20:26 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:20:26 user nova-compute[72820]:   </cpu>
Aug 27 02:20:26 user nova-compute[72820]:   <devices>
Aug 27 02:20:26 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:20:26 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:20:26 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk"/>
Aug 27 02:20:26 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:20:26 user nova-compute[72820]:     </disk>
Aug 27 02:20:26 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:20:26 user nova-compute[72820]:       <mac address="fa:16:3e:67:6b:e8"/>
Aug 27 02:20:26 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:20:26 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:20:26 user nova-compute[72820]:       <target dev="tapdc035bdf-58"/>
Aug 27 02:20:26 user nova-compute[72820]:     </interface>
Aug 27 02:20:26 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:20:26 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/console.log" append="off"/>
Aug 27 02:20:26 user nova-compute[72820]:     </serial>
Aug 27 02:20:26 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:20:26 user nova-compute[72820]:     <video>
Aug 27 02:20:26 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:20:26 user nova-compute[72820]:     </video>
Aug 27 02:20:26 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:20:26 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:20:26 user nova-compute[72820]:     </rng>
Aug 27 02:20:26 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:20:26 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:20:26 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:20:26 user nova-compute[72820]:     </memballoon>
Aug 27 02:20:26 user nova-compute[72820]:   </devices>
Aug 27 02:20:26 user nova-compute[72820]: </domain>
Aug 27 02:20:26 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1676535291',display_name='tempest-ServerStableDeviceRescueTest-server-1676535291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1676535291',id=4,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB04yomk5T62vZJSVvoxy9wjx2XDDI3YyI0pgcUSmDJzHCnRqd17erEpyE4qTQ4t3kM+pbWYbc4lokzsskTc9ooGBqn+1IPsE5tH8dB/xD77C2OIF0/l2pafnLZ4Fi0WQ==',key_name='tempest-keypair-2001966138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2f0d3ebcd3c470c8927c690914135d9',ramdisk_id='',reservation_id='r-ku0xay81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-561556641',owner_user_name='tempest-ServerStableDeviceRescueTest-561556641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:20:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250575b5f1464f97b2e95bb1c8e46dbd',uuid=6ed3c12e-96a8-4a32-8089-f04eba608663,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Converting VIF {"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:6b:e8,bridge_name='br-int',has_traffic_filtering=True,id=dc035bdf-5877-42fe-b1e2-fa882373f836,network=Network(d4eb66d2-6165-4b86-b42b-f2f65c5e97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc035bdf-58') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG os_vif [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:6b:e8,bridge_name='br-int',has_traffic_filtering=True,id=dc035bdf-5877-42fe-b1e2-fa882373f836,network=Network(d4eb66d2-6165-4b86-b42b-f2f65c5e97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc035bdf-58') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc035bdf-58, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc035bdf-58, col_values=(('external_ids', {'iface-id': 'dc035bdf-5877-42fe-b1e2-fa882373f836', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:6b:e8', 'vm-uuid': '6ed3c12e-96a8-4a32-8089-f04eba608663'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:26 user nova-compute[72820]: INFO os_vif [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:6b:e8,bridge_name='br-int',has_traffic_filtering=True,id=dc035bdf-5877-42fe-b1e2-fa882373f836,network=Network(d4eb66d2-6165-4b86-b42b-f2f65c5e97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc035bdf-58')
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] No VIF found with MAC fa:16:3e:67:6b:e8, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.network.neutron [req-fe7b42ec-dbfe-4b18-b6c0-daef771ae7a3 req-96b1835d-d995-4de5-95fb-d708534ea7f8 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Updated VIF entry in instance network info cache for port a0280116-060c-4078-b415-7abd9005c221. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG nova.network.neutron [req-fe7b42ec-dbfe-4b18-b6c0-daef771ae7a3 req-96b1835d-d995-4de5-95fb-d708534ea7f8 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Updating instance_info_cache with network_info: [{"id": "a0280116-060c-4078-b415-7abd9005c221", "address": "fa:16:3e:dc:2f:1b", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0280116-06", "ovs_interfaceid": "a0280116-060c-4078-b415-7abd9005c221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:20:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fe7b42ec-dbfe-4b18-b6c0-daef771ae7a3 req-96b1835d-d995-4de5-95fb-d708534ea7f8 service nova] Releasing lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:20:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:27 user nova-compute[72820]: DEBUG nova.network.neutron [req-07630a59-d80a-4493-b6f7-a162cffe182f req-74174495-a64d-4dbe-8eb8-5fc4308ed3c2 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Updated VIF entry in instance network info cache for port dc035bdf-5877-42fe-b1e2-fa882373f836. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:20:27 user nova-compute[72820]: DEBUG nova.network.neutron [req-07630a59-d80a-4493-b6f7-a162cffe182f req-74174495-a64d-4dbe-8eb8-5fc4308ed3c2 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Updating instance_info_cache with network_info: [{"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:20:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-07630a59-d80a-4493-b6f7-a162cffe182f req-74174495-a64d-4dbe-8eb8-5fc4308ed3c2 service nova] Releasing lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:20:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-5be1c8a1-fa7a-45c6-8cd3-9d0795d4a486 req-efe69a2c-f073-4570-be7b-38142b74a5b5 service nova] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Received event network-vif-plugged-3174b771-02bc-4766-9e03-53c1e899b297 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5be1c8a1-fa7a-45c6-8cd3-9d0795d4a486 req-efe69a2c-f073-4570-be7b-38142b74a5b5 service nova] Acquiring lock "703a5060-dd34-4fff-9dec-6924ad018713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5be1c8a1-fa7a-45c6-8cd3-9d0795d4a486 req-efe69a2c-f073-4570-be7b-38142b74a5b5 service nova] Lock "703a5060-dd34-4fff-9dec-6924ad018713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5be1c8a1-fa7a-45c6-8cd3-9d0795d4a486 req-efe69a2c-f073-4570-be7b-38142b74a5b5 service nova] Lock "703a5060-dd34-4fff-9dec-6924ad018713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-5be1c8a1-fa7a-45c6-8cd3-9d0795d4a486 req-efe69a2c-f073-4570-be7b-38142b74a5b5 service nova] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] No waiting events found dispatching network-vif-plugged-3174b771-02bc-4766-9e03-53c1e899b297 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:20:31 user nova-compute[72820]: WARNING nova.compute.manager [req-5be1c8a1-fa7a-45c6-8cd3-9d0795d4a486 req-efe69a2c-f073-4570-be7b-38142b74a5b5 service nova] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Received unexpected event network-vif-plugged-3174b771-02bc-4766-9e03-53c1e899b297 for instance with vm_state active and task_state None.
Aug 27 02:20:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102833.2820537, 6f37daba-9183-4111-bd01-f30cc4b83c2f => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:20:33 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] VM Resumed (Lifecycle Event)
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:20:33 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Instance spawned successfully.
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:20:33 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Instance spawned successfully.
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:20:33 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102833.3014874, 6f37daba-9183-4111-bd01-f30cc4b83c2f => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:20:33 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] VM Started (Lifecycle Event)
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:33 user nova-compute[72820]: INFO nova.compute.manager [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Took 14.34 seconds to spawn the instance on the hypervisor.
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:20:33 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102833.3826256, 6ed3c12e-96a8-4a32-8089-f04eba608663 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:20:33 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] VM Resumed (Lifecycle Event)
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.compute.manager [req-407168c5-61a2-41d1-8cc6-a2ca6ee6cf18 req-ee77c591-ff74-46ab-8620-1e401b316a9c service nova] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Received event network-vif-plugged-3174b771-02bc-4766-9e03-53c1e899b297 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-407168c5-61a2-41d1-8cc6-a2ca6ee6cf18 req-ee77c591-ff74-46ab-8620-1e401b316a9c service nova] Acquiring lock "703a5060-dd34-4fff-9dec-6924ad018713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-407168c5-61a2-41d1-8cc6-a2ca6ee6cf18 req-ee77c591-ff74-46ab-8620-1e401b316a9c service nova] Lock "703a5060-dd34-4fff-9dec-6924ad018713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-407168c5-61a2-41d1-8cc6-a2ca6ee6cf18 req-ee77c591-ff74-46ab-8620-1e401b316a9c service nova] Lock "703a5060-dd34-4fff-9dec-6924ad018713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.compute.manager [req-407168c5-61a2-41d1-8cc6-a2ca6ee6cf18 req-ee77c591-ff74-46ab-8620-1e401b316a9c service nova] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] No waiting events found dispatching network-vif-plugged-3174b771-02bc-4766-9e03-53c1e899b297 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:20:33 user nova-compute[72820]: WARNING nova.compute.manager [req-407168c5-61a2-41d1-8cc6-a2ca6ee6cf18 req-ee77c591-ff74-46ab-8620-1e401b316a9c service nova] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Received unexpected event network-vif-plugged-3174b771-02bc-4766-9e03-53c1e899b297 for instance with vm_state active and task_state None.
Aug 27 02:20:33 user nova-compute[72820]: INFO nova.compute.manager [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Took 18.21 seconds to spawn the instance on the hypervisor.
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:33 user nova-compute[72820]: INFO nova.compute.manager [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Took 15.38 seconds to build instance.
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:20:33 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102833.3846774, 6ed3c12e-96a8-4a32-8089-f04eba608663 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:20:33 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] VM Started (Lifecycle Event)
Aug 27 02:20:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1eab5efd-bff3-40fd-aaa1-5458347555d8 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "6f37daba-9183-4111-bd01-f30cc4b83c2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.548s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:20:33 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:20:34 user nova-compute[72820]: INFO nova.compute.manager [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Took 19.31 seconds to build instance.
Aug 27 02:20:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3bd2ebe3-d479-4e5c-82be-2105c60d0e7c tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.443s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:35 user nova-compute[72820]: DEBUG nova.compute.manager [req-5356ceb8-1638-4cf3-a22d-3d05868b0956 req-fcc2554f-27dc-4a18-8dcd-dd4723a4761d service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Received event network-vif-plugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5356ceb8-1638-4cf3-a22d-3d05868b0956 req-fcc2554f-27dc-4a18-8dcd-dd4723a4761d service nova] Acquiring lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5356ceb8-1638-4cf3-a22d-3d05868b0956 req-fcc2554f-27dc-4a18-8dcd-dd4723a4761d service nova] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5356ceb8-1638-4cf3-a22d-3d05868b0956 req-fcc2554f-27dc-4a18-8dcd-dd4723a4761d service nova] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:35 user nova-compute[72820]: DEBUG nova.compute.manager [req-5356ceb8-1638-4cf3-a22d-3d05868b0956 req-fcc2554f-27dc-4a18-8dcd-dd4723a4761d service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] No waiting events found dispatching network-vif-plugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:20:35 user nova-compute[72820]: WARNING nova.compute.manager [req-5356ceb8-1638-4cf3-a22d-3d05868b0956 req-fcc2554f-27dc-4a18-8dcd-dd4723a4761d service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Received unexpected event network-vif-plugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 for instance with vm_state active and task_state None.
Aug 27 02:20:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-10dfa6b5-a5d7-49f0-9d2c-af17c76229ea req-96bab67e-0198-4b15-a07a-c51a0dad5f90 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Received event network-vif-plugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-10dfa6b5-a5d7-49f0-9d2c-af17c76229ea req-96bab67e-0198-4b15-a07a-c51a0dad5f90 service nova] Acquiring lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-10dfa6b5-a5d7-49f0-9d2c-af17c76229ea req-96bab67e-0198-4b15-a07a-c51a0dad5f90 service nova] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-10dfa6b5-a5d7-49f0-9d2c-af17c76229ea req-96bab67e-0198-4b15-a07a-c51a0dad5f90 service nova] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-10dfa6b5-a5d7-49f0-9d2c-af17c76229ea req-96bab67e-0198-4b15-a07a-c51a0dad5f90 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] No waiting events found dispatching network-vif-plugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:20:37 user nova-compute[72820]: WARNING nova.compute.manager [req-10dfa6b5-a5d7-49f0-9d2c-af17c76229ea req-96bab67e-0198-4b15-a07a-c51a0dad5f90 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Received unexpected event network-vif-plugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 for instance with vm_state active and task_state None.
Aug 27 02:20:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-d220c561-cc48-40ff-916b-d5530eec450a req-d8044a7a-d502-4e86-ac1d-83a5ff3f8184 service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received event network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d220c561-cc48-40ff-916b-d5530eec450a req-d8044a7a-d502-4e86-ac1d-83a5ff3f8184 service nova] Acquiring lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d220c561-cc48-40ff-916b-d5530eec450a req-d8044a7a-d502-4e86-ac1d-83a5ff3f8184 service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d220c561-cc48-40ff-916b-d5530eec450a req-d8044a7a-d502-4e86-ac1d-83a5ff3f8184 service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-d220c561-cc48-40ff-916b-d5530eec450a req-d8044a7a-d502-4e86-ac1d-83a5ff3f8184 service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] No waiting events found dispatching network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:20:42 user nova-compute[72820]: WARNING nova.compute.manager [req-d220c561-cc48-40ff-916b-d5530eec450a req-d8044a7a-d502-4e86-ac1d-83a5ff3f8184 service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received unexpected event network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 for instance with vm_state active and task_state None.
Aug 27 02:20:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-052c4358-208a-4616-abbb-ea0de6cbe127 req-2a41dc2f-df49-4216-a4ba-5a00adb2ce85 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Received event network-vif-plugged-a0280116-060c-4078-b415-7abd9005c221 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-052c4358-208a-4616-abbb-ea0de6cbe127 req-2a41dc2f-df49-4216-a4ba-5a00adb2ce85 service nova] Acquiring lock "6f37daba-9183-4111-bd01-f30cc4b83c2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-052c4358-208a-4616-abbb-ea0de6cbe127 req-2a41dc2f-df49-4216-a4ba-5a00adb2ce85 service nova] Lock "6f37daba-9183-4111-bd01-f30cc4b83c2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-052c4358-208a-4616-abbb-ea0de6cbe127 req-2a41dc2f-df49-4216-a4ba-5a00adb2ce85 service nova] Lock "6f37daba-9183-4111-bd01-f30cc4b83c2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-052c4358-208a-4616-abbb-ea0de6cbe127 req-2a41dc2f-df49-4216-a4ba-5a00adb2ce85 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] No waiting events found dispatching network-vif-plugged-a0280116-060c-4078-b415-7abd9005c221 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:20:42 user nova-compute[72820]: WARNING nova.compute.manager [req-052c4358-208a-4616-abbb-ea0de6cbe127 req-2a41dc2f-df49-4216-a4ba-5a00adb2ce85 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Received unexpected event network-vif-plugged-a0280116-060c-4078-b415-7abd9005c221 for instance with vm_state active and task_state None.
Aug 27 02:20:44 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a130dd0-818a-4967-a58b-82206d7260d5 req-84f39804-0ba7-4435-a13d-702e17af5c7e service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received event network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a130dd0-818a-4967-a58b-82206d7260d5 req-84f39804-0ba7-4435-a13d-702e17af5c7e service nova] Acquiring lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a130dd0-818a-4967-a58b-82206d7260d5 req-84f39804-0ba7-4435-a13d-702e17af5c7e service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a130dd0-818a-4967-a58b-82206d7260d5 req-84f39804-0ba7-4435-a13d-702e17af5c7e service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:44 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a130dd0-818a-4967-a58b-82206d7260d5 req-84f39804-0ba7-4435-a13d-702e17af5c7e service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] No waiting events found dispatching network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:20:44 user nova-compute[72820]: WARNING nova.compute.manager [req-0a130dd0-818a-4967-a58b-82206d7260d5 req-84f39804-0ba7-4435-a13d-702e17af5c7e service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received unexpected event network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 for instance with vm_state active and task_state None.
Aug 27 02:20:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Acquiring lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:44 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:20:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:20:44 user nova-compute[72820]: INFO nova.compute.claims [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Claim successful on node user
Aug 27 02:20:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-5e11b2b0-4698-4f61-9f9b-42bbd78f138c req-b9a3c055-bcbe-4c2c-b5a0-3329697e76f4 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Received event network-vif-plugged-a0280116-060c-4078-b415-7abd9005c221 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5e11b2b0-4698-4f61-9f9b-42bbd78f138c req-b9a3c055-bcbe-4c2c-b5a0-3329697e76f4 service nova] Acquiring lock "6f37daba-9183-4111-bd01-f30cc4b83c2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5e11b2b0-4698-4f61-9f9b-42bbd78f138c req-b9a3c055-bcbe-4c2c-b5a0-3329697e76f4 service nova] Lock "6f37daba-9183-4111-bd01-f30cc4b83c2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5e11b2b0-4698-4f61-9f9b-42bbd78f138c req-b9a3c055-bcbe-4c2c-b5a0-3329697e76f4 service nova] Lock "6f37daba-9183-4111-bd01-f30cc4b83c2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-5e11b2b0-4698-4f61-9f9b-42bbd78f138c req-b9a3c055-bcbe-4c2c-b5a0-3329697e76f4 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] No waiting events found dispatching network-vif-plugged-a0280116-060c-4078-b415-7abd9005c221 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:20:45 user nova-compute[72820]: WARNING nova.compute.manager [req-5e11b2b0-4698-4f61-9f9b-42bbd78f138c req-b9a3c055-bcbe-4c2c-b5a0-3329697e76f4 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Received unexpected event network-vif-plugged-a0280116-060c-4078-b415-7abd9005c221 for instance with vm_state active and task_state None.
Aug 27 02:20:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-5e11b2b0-4698-4f61-9f9b-42bbd78f138c req-b9a3c055-bcbe-4c2c-b5a0-3329697e76f4 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5e11b2b0-4698-4f61-9f9b-42bbd78f138c req-b9a3c055-bcbe-4c2c-b5a0-3329697e76f4 service nova] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5e11b2b0-4698-4f61-9f9b-42bbd78f138c req-b9a3c055-bcbe-4c2c-b5a0-3329697e76f4 service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5e11b2b0-4698-4f61-9f9b-42bbd78f138c req-b9a3c055-bcbe-4c2c-b5a0-3329697e76f4 service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-5e11b2b0-4698-4f61-9f9b-42bbd78f138c req-b9a3c055-bcbe-4c2c-b5a0-3329697e76f4 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] No waiting events found dispatching network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:20:45 user nova-compute[72820]: WARNING nova.compute.manager [req-5e11b2b0-4698-4f61-9f9b-42bbd78f138c req-b9a3c055-bcbe-4c2c-b5a0-3329697e76f4 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received unexpected event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 for instance with vm_state active and task_state None.
Aug 27 02:20:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-5e11b2b0-4698-4f61-9f9b-42bbd78f138c req-b9a3c055-bcbe-4c2c-b5a0-3329697e76f4 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5e11b2b0-4698-4f61-9f9b-42bbd78f138c req-b9a3c055-bcbe-4c2c-b5a0-3329697e76f4 service nova] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5e11b2b0-4698-4f61-9f9b-42bbd78f138c req-b9a3c055-bcbe-4c2c-b5a0-3329697e76f4 service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5e11b2b0-4698-4f61-9f9b-42bbd78f138c req-b9a3c055-bcbe-4c2c-b5a0-3329697e76f4 service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-5e11b2b0-4698-4f61-9f9b-42bbd78f138c req-b9a3c055-bcbe-4c2c-b5a0-3329697e76f4 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] No waiting events found dispatching network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:20:45 user nova-compute[72820]: WARNING nova.compute.manager [req-5e11b2b0-4698-4f61-9f9b-42bbd78f138c req-b9a3c055-bcbe-4c2c-b5a0-3329697e76f4 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received unexpected event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 for instance with vm_state active and task_state None.
Aug 27 02:20:45 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG nova.network.neutron [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:20:45 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 27 02:20:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG nova.policy [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b6dde0634d4494ab5dedcfabb9871bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48503a99b8e149f7bf2be3b21e156014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:20:45 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Creating image(s)
Aug 27 02:20:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "/opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "/opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Acquiring lock "d4a4b85e96963070506340f91c7c8734173a931c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "d4a4b85e96963070506340f91c7c8734173a931c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c.part --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c.part --force-share --output=json" returned: 0 in 0.241s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:46 user nova-compute[72820]: DEBUG nova.virt.images [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] c45b06f8-81fd-4b51-8680-d726d017e203 was qcow2, converting to raw {{(pid=72820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 02:20:46 user nova-compute[72820]: DEBUG nova.privsep.utils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 02:20:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c.part /opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c.converted {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:46 user nova-compute[72820]: DEBUG nova.network.neutron [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Successfully created port: 82d087af-c0f8-4c88-904c-4afbf9c5239d {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:20:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c.part /opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c.converted" returned: 0 in 0.256s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c.converted --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c.converted --force-share --output=json" returned: 0 in 0.224s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "d4a4b85e96963070506340f91c7c8734173a931c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.313s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c --force-share --output=json" returned: 0 in 0.223s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Acquiring lock "d4a4b85e96963070506340f91c7c8734173a931c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "d4a4b85e96963070506340f91c7c8734173a931c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "1246d21d-b797-4c76-b282-83e17e6bf06a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c --force-share --output=json" returned: 0 in 0.200s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c,backing_fmt=raw /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c,backing_fmt=raw /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk 1073741824" returned: 0 in 0.073s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "d4a4b85e96963070506340f91c7c8734173a931c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:20:47 user nova-compute[72820]: INFO nova.compute.claims [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Claim successful on node user
Aug 27 02:20:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c --force-share --output=json" returned: 0 in 0.233s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:20:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.network.neutron [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Successfully updated port: 82d087af-c0f8-4c88-904c-4afbf9c5239d {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Acquiring lock "refresh_cache-8ae21d01-4c7c-4926-9868-cf8786e59d4d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Acquired lock "refresh_cache-8ae21d01-4c7c-4926-9868-cf8786e59d4d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.network.neutron [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Cannot resize image /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Ensure instance console log exists: /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-6ae5172a-c57c-4700-be95-c44a6cf8fe26 req-528dfaee-e088-47d0-bdce-df9a5ec6d92e service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Received event network-changed-82d087af-c0f8-4c88-904c-4afbf9c5239d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-6ae5172a-c57c-4700-be95-c44a6cf8fe26 req-528dfaee-e088-47d0-bdce-df9a5ec6d92e service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Refreshing instance network info cache due to event network-changed-82d087af-c0f8-4c88-904c-4afbf9c5239d. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6ae5172a-c57c-4700-be95-c44a6cf8fe26 req-528dfaee-e088-47d0-bdce-df9a5ec6d92e service nova] Acquiring lock "refresh_cache-8ae21d01-4c7c-4926-9868-cf8786e59d4d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.network.neutron [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.network.neutron [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:20:48 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.network.neutron [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Updating instance_info_cache with network_info: [{"id": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "address": "fa:16:3e:b2:10:8f", "network": {"id": "bcd471a8-51e4-4484-9152-d414438c0997", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1786754798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48503a99b8e149f7bf2be3b21e156014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82d087af-c0", "ovs_interfaceid": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Releasing lock "refresh_cache-8ae21d01-4c7c-4926-9868-cf8786e59d4d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Instance network_info: |[{"id": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "address": "fa:16:3e:b2:10:8f", "network": {"id": "bcd471a8-51e4-4484-9152-d414438c0997", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1786754798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48503a99b8e149f7bf2be3b21e156014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82d087af-c0", "ovs_interfaceid": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6ae5172a-c57c-4700-be95-c44a6cf8fe26 req-528dfaee-e088-47d0-bdce-df9a5ec6d92e service nova] Acquired lock "refresh_cache-8ae21d01-4c7c-4926-9868-cf8786e59d4d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.network.neutron [req-6ae5172a-c57c-4700-be95-c44a6cf8fe26 req-528dfaee-e088-47d0-bdce-df9a5ec6d92e service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Refreshing network info cache for port 82d087af-c0f8-4c88-904c-4afbf9c5239d {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Start _get_guest_xml network_info=[{"id": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "address": "fa:16:3e:b2:10:8f", "network": {"id": "bcd471a8-51e4-4484-9152-d414438c0997", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1786754798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48503a99b8e149f7bf2be3b21e156014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82d087af-c0", "ovs_interfaceid": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:20:32Z,direct_url=<?>,disk_format='qcow2',id=c45b06f8-81fd-4b51-8680-d726d017e203,min_disk=0,min_ram=0,name='',owner='28b4f65f64bf4ce1b48abc2baa53532d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:20:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/sda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'scsi', 'image_id': 'c45b06f8-81fd-4b51-8680-d726d017e203'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:20:48 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:20:48 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:20:32Z,direct_url=<?>,disk_format='qcow2',id=c45b06f8-81fd-4b51-8680-d726d017e203,min_disk=0,min_ram=0,name='',owner='28b4f65f64bf4ce1b48abc2baa53532d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:20:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-253085215',display_name='tempest-AttachSCSIVolumeTestJSON-server-253085215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-253085215',id=6,image_ref='c45b06f8-81fd-4b51-8680-d726d017e203',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3KSyCyo5TVWqbGYf7C7dAxNibvz6IcOcDQ7omQ0j/Bhga7OA4HIQWZAXZCLCxgNv3fMMmYzYkemiDw4xM9YYw043DyGaX/iSCw9d7R7v5KqAi3YWz7pYTjc0mUIA8g1A==',key_name='tempest-keypair-1136723862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48503a99b8e149f7bf2be3b21e156014',ramdisk_id='',reservation_id='r-ru8kbb3d',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c45b06f8-81fd-4b51-8680-d726d017e203',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-65283222',owner_user_name='tempest-AttachSCSIVolumeTestJSON-65283222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b6dde0634d4494ab5dedcfabb9871bf',uuid=8ae21d01-4c7c-4926-9868-cf8786e59d4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "address": "fa:16:3e:b2:10:8f", "network": {"id": "bcd471a8-51e4-4484-9152-d414438c0997", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1786754798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48503a99b8e149f7bf2be3b21e156014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82d087af-c0", "ovs_interfaceid": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Converting VIF {"id": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "address": "fa:16:3e:b2:10:8f", "network": {"id": "bcd471a8-51e4-4484-9152-d414438c0997", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1786754798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48503a99b8e149f7bf2be3b21e156014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82d087af-c0", "ovs_interfaceid": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:10:8f,bridge_name='br-int',has_traffic_filtering=True,id=82d087af-c0f8-4c88-904c-4afbf9c5239d,network=Network(bcd471a8-51e4-4484-9152-d414438c0997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82d087af-c0') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.objects.instance [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ae21d01-4c7c-4926-9868-cf8786e59d4d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:20:48 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Creating image(s)
Aug 27 02:20:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "/opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "/opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "/opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:20:48 user nova-compute[72820]:   <uuid>8ae21d01-4c7c-4926-9868-cf8786e59d4d</uuid>
Aug 27 02:20:48 user nova-compute[72820]:   <name>instance-00000006</name>
Aug 27 02:20:48 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:20:48 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:20:48 user nova-compute[72820]:   <metadata>
Aug 27 02:20:48 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:20:48 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:20:48 user nova-compute[72820]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-253085215</nova:name>
Aug 27 02:20:48 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:20:48</nova:creationTime>
Aug 27 02:20:48 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:20:48 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:20:48 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:20:48 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:20:48 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:20:48 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:20:48 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:20:48 user nova-compute[72820]:       <nova:owner>
Aug 27 02:20:48 user nova-compute[72820]:         <nova:user uuid="7b6dde0634d4494ab5dedcfabb9871bf">tempest-AttachSCSIVolumeTestJSON-65283222-project-member</nova:user>
Aug 27 02:20:48 user nova-compute[72820]:         <nova:project uuid="48503a99b8e149f7bf2be3b21e156014">tempest-AttachSCSIVolumeTestJSON-65283222</nova:project>
Aug 27 02:20:48 user nova-compute[72820]:       </nova:owner>
Aug 27 02:20:48 user nova-compute[72820]:       <nova:root type="image" uuid="c45b06f8-81fd-4b51-8680-d726d017e203"/>
Aug 27 02:20:48 user nova-compute[72820]:       <nova:ports>
Aug 27 02:20:48 user nova-compute[72820]:         <nova:port uuid="82d087af-c0f8-4c88-904c-4afbf9c5239d">
Aug 27 02:20:48 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 02:20:48 user nova-compute[72820]:         </nova:port>
Aug 27 02:20:48 user nova-compute[72820]:       </nova:ports>
Aug 27 02:20:48 user nova-compute[72820]:     </nova:instance>
Aug 27 02:20:48 user nova-compute[72820]:   </metadata>
Aug 27 02:20:48 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:20:48 user nova-compute[72820]:     <system>
Aug 27 02:20:48 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:20:48 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:20:48 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:20:48 user nova-compute[72820]:       <entry name="serial">8ae21d01-4c7c-4926-9868-cf8786e59d4d</entry>
Aug 27 02:20:48 user nova-compute[72820]:       <entry name="uuid">8ae21d01-4c7c-4926-9868-cf8786e59d4d</entry>
Aug 27 02:20:48 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:20:48 user nova-compute[72820]:     </system>
Aug 27 02:20:48 user nova-compute[72820]:   </sysinfo>
Aug 27 02:20:48 user nova-compute[72820]:   <os>
Aug 27 02:20:48 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:20:48 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:20:48 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:20:48 user nova-compute[72820]:   </os>
Aug 27 02:20:48 user nova-compute[72820]:   <features>
Aug 27 02:20:48 user nova-compute[72820]:     <acpi/>
Aug 27 02:20:48 user nova-compute[72820]:     <apic/>
Aug 27 02:20:48 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:20:48 user nova-compute[72820]:   </features>
Aug 27 02:20:48 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:20:48 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:20:48 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:20:48 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:20:48 user nova-compute[72820]:   </clock>
Aug 27 02:20:48 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:20:48 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:20:48 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:20:48 user nova-compute[72820]:   </cpu>
Aug 27 02:20:48 user nova-compute[72820]:   <devices>
Aug 27 02:20:48 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:20:48 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:20:48 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk"/>
Aug 27 02:20:48 user nova-compute[72820]:       <target dev="sda" bus="scsi"/>
Aug 27 02:20:48 user nova-compute[72820]:       <address type="drive" controller="0" unit="0"/>
Aug 27 02:20:48 user nova-compute[72820]:     </disk>
Aug 27 02:20:48 user nova-compute[72820]:     <disk type="file" device="cdrom">
Aug 27 02:20:48 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 02:20:48 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk.config"/>
Aug 27 02:20:48 user nova-compute[72820]:       <target dev="sdb" bus="scsi"/>
Aug 27 02:20:48 user nova-compute[72820]:       <address type="drive" controller="0" unit="1"/>
Aug 27 02:20:48 user nova-compute[72820]:     </disk>
Aug 27 02:20:48 user nova-compute[72820]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 27 02:20:48 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:20:48 user nova-compute[72820]:       <mac address="fa:16:3e:b2:10:8f"/>
Aug 27 02:20:48 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:20:48 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:20:48 user nova-compute[72820]:       <target dev="tap82d087af-c0"/>
Aug 27 02:20:48 user nova-compute[72820]:     </interface>
Aug 27 02:20:48 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:20:48 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/console.log" append="off"/>
Aug 27 02:20:48 user nova-compute[72820]:     </serial>
Aug 27 02:20:48 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:20:48 user nova-compute[72820]:     <video>
Aug 27 02:20:48 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:20:48 user nova-compute[72820]:     </video>
Aug 27 02:20:48 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:20:48 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:20:48 user nova-compute[72820]:     </rng>
Aug 27 02:20:48 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:20:48 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:20:48 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:20:48 user nova-compute[72820]:     </memballoon>
Aug 27 02:20:48 user nova-compute[72820]:   </devices>
Aug 27 02:20:48 user nova-compute[72820]: </domain>
Aug 27 02:20:48 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-253085215',display_name='tempest-AttachSCSIVolumeTestJSON-server-253085215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-253085215',id=6,image_ref='c45b06f8-81fd-4b51-8680-d726d017e203',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3KSyCyo5TVWqbGYf7C7dAxNibvz6IcOcDQ7omQ0j/Bhga7OA4HIQWZAXZCLCxgNv3fMMmYzYkemiDw4xM9YYw043DyGaX/iSCw9d7R7v5KqAi3YWz7pYTjc0mUIA8g1A==',key_name='tempest-keypair-1136723862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48503a99b8e149f7bf2be3b21e156014',ramdisk_id='',reservation_id='r-ru8kbb3d',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c45b06f8-81fd-4b51-8680-d726d017e203',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-65283222',owner_user_name='tempest-AttachSCSIVolumeTestJSON-65283222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b6dde0634d4494ab5dedcfabb9871bf',uuid=8ae21d01-4c7c-4926-9868-cf8786e59d4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "address": "fa:16:3e:b2:10:8f", "network": {"id": "bcd471a8-51e4-4484-9152-d414438c0997", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1786754798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48503a99b8e149f7bf2be3b21e156014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82d087af-c0", "ovs_interfaceid": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Converting VIF {"id": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "address": "fa:16:3e:b2:10:8f", "network": {"id": "bcd471a8-51e4-4484-9152-d414438c0997", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1786754798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48503a99b8e149f7bf2be3b21e156014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82d087af-c0", "ovs_interfaceid": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:10:8f,bridge_name='br-int',has_traffic_filtering=True,id=82d087af-c0f8-4c88-904c-4afbf9c5239d,network=Network(bcd471a8-51e4-4484-9152-d414438c0997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82d087af-c0') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG os_vif [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:10:8f,bridge_name='br-int',has_traffic_filtering=True,id=82d087af-c0f8-4c88-904c-4afbf9c5239d,network=Network(bcd471a8-51e4-4484-9152-d414438c0997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82d087af-c0') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82d087af-c0, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap82d087af-c0, col_values=(('external_ids', {'iface-id': '82d087af-c0f8-4c88-904c-4afbf9c5239d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:10:8f', 'vm-uuid': '8ae21d01-4c7c-4926-9868-cf8786e59d4d'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.policy [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d17e388756d462da4e6d144b73085fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34aba94505ec4710a8a30e50cae8d4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:48 user nova-compute[72820]: INFO os_vif [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:10:8f,bridge_name='br-int',has_traffic_filtering=True,id=82d087af-c0f8-4c88-904c-4afbf9c5239d,network=Network(bcd471a8-51e4-4484-9152-d414438c0997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82d087af-c0')
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] No BDM found with device name sda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] No VIF found with MAC fa:16:3e:b2:10:8f, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:20:48 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Using config drive
Aug 27 02:20:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.231s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.248s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk 1073741824" returned: 0 in 0.075s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.234s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Cannot resize image /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Ensure instance console log exists: /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:49 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Creating config drive at /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk.config
Aug 27 02:20:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpt22pdk38 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG nova.network.neutron [req-6ae5172a-c57c-4700-be95-c44a6cf8fe26 req-528dfaee-e088-47d0-bdce-df9a5ec6d92e service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Updated VIF entry in instance network info cache for port 82d087af-c0f8-4c88-904c-4afbf9c5239d. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG nova.network.neutron [req-6ae5172a-c57c-4700-be95-c44a6cf8fe26 req-528dfaee-e088-47d0-bdce-df9a5ec6d92e service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Updating instance_info_cache with network_info: [{"id": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "address": "fa:16:3e:b2:10:8f", "network": {"id": "bcd471a8-51e4-4484-9152-d414438c0997", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1786754798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48503a99b8e149f7bf2be3b21e156014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82d087af-c0", "ovs_interfaceid": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Acquiring lock "abe48a87-2a54-468d-98e5-afae2577e541" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "abe48a87-2a54-468d-98e5-afae2577e541" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpt22pdk38" returned: 0 in 0.084s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6ae5172a-c57c-4700-be95-c44a6cf8fe26 req-528dfaee-e088-47d0-bdce-df9a5ec6d92e service nova] Releasing lock "refresh_cache-8ae21d01-4c7c-4926-9868-cf8786e59d4d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:20:49 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:20:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:50 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:20:50 user nova-compute[72820]: INFO nova.compute.claims [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Claim successful on node user
Aug 27 02:20:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Successfully created port: 52e755c8-03a4-4255-a48d-414e0a1ba26a {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:20:50 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:20:50 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:20:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.668s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:20:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:20:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:20:50 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:20:51 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG nova.policy [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17f292f6541f4b77a29c3b48933ecddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390ad1b0be83481fa07c91e508c5cfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:20:51 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Creating image(s)
Aug 27 02:20:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Acquiring lock "/opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "/opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "/opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG nova.network.neutron [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Successfully updated port: 52e755c8-03a4-4255-a48d-414e0a1ba26a {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "refresh_cache-1246d21d-b797-4c76-b282-83e17e6bf06a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquired lock "refresh_cache-1246d21d-b797-4c76-b282-83e17e6bf06a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG nova.network.neutron [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-89c1d74f-4127-4565-9723-c951681e67dd req-422a45e9-0cc6-40db-b6c6-6b37f6af0c85 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received event network-changed-52e755c8-03a4-4255-a48d-414e0a1ba26a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-89c1d74f-4127-4565-9723-c951681e67dd req-422a45e9-0cc6-40db-b6c6-6b37f6af0c85 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Refreshing instance network info cache due to event network-changed-52e755c8-03a4-4255-a48d-414e0a1ba26a. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-89c1d74f-4127-4565-9723-c951681e67dd req-422a45e9-0cc6-40db-b6c6-6b37f6af0c85 service nova] Acquiring lock "refresh_cache-1246d21d-b797-4c76-b282-83e17e6bf06a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.308s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG nova.network.neutron [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.283s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk 1073741824" returned: 0 in 0.069s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:51 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.274s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Checking if we can resize image /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Cannot resize image /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Ensure instance console log exists: /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-a0544736-d817-4b0a-907b-62eab48ce959 req-d3ead94f-fc18-4c40-a58d-76b3752100ec service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Received event network-vif-plugged-82d087af-c0f8-4c88-904c-4afbf9c5239d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a0544736-d817-4b0a-907b-62eab48ce959 req-d3ead94f-fc18-4c40-a58d-76b3752100ec service nova] Acquiring lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a0544736-d817-4b0a-907b-62eab48ce959 req-d3ead94f-fc18-4c40-a58d-76b3752100ec service nova] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a0544736-d817-4b0a-907b-62eab48ce959 req-d3ead94f-fc18-4c40-a58d-76b3752100ec service nova] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-a0544736-d817-4b0a-907b-62eab48ce959 req-d3ead94f-fc18-4c40-a58d-76b3752100ec service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] No waiting events found dispatching network-vif-plugged-82d087af-c0f8-4c88-904c-4afbf9c5239d {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:20:52 user nova-compute[72820]: WARNING nova.compute.manager [req-a0544736-d817-4b0a-907b-62eab48ce959 req-d3ead94f-fc18-4c40-a58d-76b3752100ec service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Received unexpected event network-vif-plugged-82d087af-c0f8-4c88-904c-4afbf9c5239d for instance with vm_state building and task_state spawning.
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.network.neutron [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Successfully created port: 7f134260-3849-4dea-bc03-f14fa02d4e17 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.network.neutron [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Updating instance_info_cache with network_info: [{"id": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "address": "fa:16:3e:50:f4:e0", "network": {"id": "acc49577-9bcb-4da3-ad31-4ecf60e14ce6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2140276278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e755c8-03", "ovs_interfaceid": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Releasing lock "refresh_cache-1246d21d-b797-4c76-b282-83e17e6bf06a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.compute.manager [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Instance network_info: |[{"id": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "address": "fa:16:3e:50:f4:e0", "network": {"id": "acc49577-9bcb-4da3-ad31-4ecf60e14ce6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2140276278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e755c8-03", "ovs_interfaceid": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-89c1d74f-4127-4565-9723-c951681e67dd req-422a45e9-0cc6-40db-b6c6-6b37f6af0c85 service nova] Acquired lock "refresh_cache-1246d21d-b797-4c76-b282-83e17e6bf06a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.network.neutron [req-89c1d74f-4127-4565-9723-c951681e67dd req-422a45e9-0cc6-40db-b6c6-6b37f6af0c85 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Refreshing network info cache for port 52e755c8-03a4-4255-a48d-414e0a1ba26a {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Start _get_guest_xml network_info=[{"id": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "address": "fa:16:3e:50:f4:e0", "network": {"id": "acc49577-9bcb-4da3-ad31-4ecf60e14ce6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2140276278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e755c8-03", "ovs_interfaceid": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:52 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:20:52 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-763202852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-763202852',id=7,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp8SE+60pO/iSvH/3MlKKhub1Bt3pIV43ycpm9UNaf+uwVjtT/lwbZQdwY4vF2RtnbJSES0rieVwtxnV3XLrYsdPch9SnMxc7EdoRqFhT0gE3l0qDEzBd0M43h/WvHElA==',key_name='tempest-keypair-1710782008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34aba94505ec4710a8a30e50cae8d4df',ramdisk_id='',reservation_id='r-vu1svk2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-634168039',owner_user_name='tempest-TaggedAttachmentsTest-634168039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:20:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d17e388756d462da4e6d144b73085fa',uuid=1246d21d-b797-4c76-b282-83e17e6bf06a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "address": "fa:16:3e:50:f4:e0", "network": {"id": "acc49577-9bcb-4da3-ad31-4ecf60e14ce6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2140276278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e755c8-03", "ovs_interfaceid": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Converting VIF {"id": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "address": "fa:16:3e:50:f4:e0", "network": {"id": "acc49577-9bcb-4da3-ad31-4ecf60e14ce6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2140276278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e755c8-03", "ovs_interfaceid": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:f4:e0,bridge_name='br-int',has_traffic_filtering=True,id=52e755c8-03a4-4255-a48d-414e0a1ba26a,network=Network(acc49577-9bcb-4da3-ad31-4ecf60e14ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e755c8-03') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.objects.instance [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lazy-loading 'pci_devices' on Instance uuid 1246d21d-b797-4c76-b282-83e17e6bf06a {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:20:52 user nova-compute[72820]:   <uuid>1246d21d-b797-4c76-b282-83e17e6bf06a</uuid>
Aug 27 02:20:52 user nova-compute[72820]:   <name>instance-00000007</name>
Aug 27 02:20:52 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:20:52 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:20:52 user nova-compute[72820]:   <metadata>
Aug 27 02:20:52 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:20:52 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:20:52 user nova-compute[72820]:       <nova:name>tempest-device-tagging-server-763202852</nova:name>
Aug 27 02:20:52 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:20:52</nova:creationTime>
Aug 27 02:20:52 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:20:52 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:20:52 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:20:52 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:20:52 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:20:52 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:20:52 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:20:52 user nova-compute[72820]:       <nova:owner>
Aug 27 02:20:52 user nova-compute[72820]:         <nova:user uuid="6d17e388756d462da4e6d144b73085fa">tempest-TaggedAttachmentsTest-634168039-project-member</nova:user>
Aug 27 02:20:52 user nova-compute[72820]:         <nova:project uuid="34aba94505ec4710a8a30e50cae8d4df">tempest-TaggedAttachmentsTest-634168039</nova:project>
Aug 27 02:20:52 user nova-compute[72820]:       </nova:owner>
Aug 27 02:20:52 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:20:52 user nova-compute[72820]:       <nova:ports>
Aug 27 02:20:52 user nova-compute[72820]:         <nova:port uuid="52e755c8-03a4-4255-a48d-414e0a1ba26a">
Aug 27 02:20:52 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 02:20:52 user nova-compute[72820]:         </nova:port>
Aug 27 02:20:52 user nova-compute[72820]:       </nova:ports>
Aug 27 02:20:52 user nova-compute[72820]:     </nova:instance>
Aug 27 02:20:52 user nova-compute[72820]:   </metadata>
Aug 27 02:20:52 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:20:52 user nova-compute[72820]:     <system>
Aug 27 02:20:52 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:20:52 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:20:52 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:20:52 user nova-compute[72820]:       <entry name="serial">1246d21d-b797-4c76-b282-83e17e6bf06a</entry>
Aug 27 02:20:52 user nova-compute[72820]:       <entry name="uuid">1246d21d-b797-4c76-b282-83e17e6bf06a</entry>
Aug 27 02:20:52 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:20:52 user nova-compute[72820]:     </system>
Aug 27 02:20:52 user nova-compute[72820]:   </sysinfo>
Aug 27 02:20:52 user nova-compute[72820]:   <os>
Aug 27 02:20:52 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:20:52 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:20:52 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:20:52 user nova-compute[72820]:   </os>
Aug 27 02:20:52 user nova-compute[72820]:   <features>
Aug 27 02:20:52 user nova-compute[72820]:     <acpi/>
Aug 27 02:20:52 user nova-compute[72820]:     <apic/>
Aug 27 02:20:52 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:20:52 user nova-compute[72820]:   </features>
Aug 27 02:20:52 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:20:52 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:20:52 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:20:52 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:20:52 user nova-compute[72820]:   </clock>
Aug 27 02:20:52 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:20:52 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:20:52 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:20:52 user nova-compute[72820]:   </cpu>
Aug 27 02:20:52 user nova-compute[72820]:   <devices>
Aug 27 02:20:52 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:20:52 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:20:52 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk"/>
Aug 27 02:20:52 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:20:52 user nova-compute[72820]:     </disk>
Aug 27 02:20:52 user nova-compute[72820]:     <disk type="file" device="cdrom">
Aug 27 02:20:52 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 02:20:52 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk.config"/>
Aug 27 02:20:52 user nova-compute[72820]:       <target dev="hda" bus="ide"/>
Aug 27 02:20:52 user nova-compute[72820]:     </disk>
Aug 27 02:20:52 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:20:52 user nova-compute[72820]:       <mac address="fa:16:3e:50:f4:e0"/>
Aug 27 02:20:52 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:20:52 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:20:52 user nova-compute[72820]:       <target dev="tap52e755c8-03"/>
Aug 27 02:20:52 user nova-compute[72820]:     </interface>
Aug 27 02:20:52 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:20:52 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/console.log" append="off"/>
Aug 27 02:20:52 user nova-compute[72820]:     </serial>
Aug 27 02:20:52 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:20:52 user nova-compute[72820]:     <video>
Aug 27 02:20:52 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:20:52 user nova-compute[72820]:     </video>
Aug 27 02:20:52 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:20:52 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:20:52 user nova-compute[72820]:     </rng>
Aug 27 02:20:52 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:20:52 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:20:52 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:20:52 user nova-compute[72820]:     </memballoon>
Aug 27 02:20:52 user nova-compute[72820]:   </devices>
Aug 27 02:20:52 user nova-compute[72820]: </domain>
Aug 27 02:20:52 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-763202852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-763202852',id=7,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp8SE+60pO/iSvH/3MlKKhub1Bt3pIV43ycpm9UNaf+uwVjtT/lwbZQdwY4vF2RtnbJSES0rieVwtxnV3XLrYsdPch9SnMxc7EdoRqFhT0gE3l0qDEzBd0M43h/WvHElA==',key_name='tempest-keypair-1710782008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34aba94505ec4710a8a30e50cae8d4df',ramdisk_id='',reservation_id='r-vu1svk2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-634168039',owner_user_name='tempest-TaggedAttachmentsTest-634168039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:20:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d17e388756d462da4e6d144b73085fa',uuid=1246d21d-b797-4c76-b282-83e17e6bf06a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "address": "fa:16:3e:50:f4:e0", "network": {"id": "acc49577-9bcb-4da3-ad31-4ecf60e14ce6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2140276278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e755c8-03", "ovs_interfaceid": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Converting VIF {"id": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "address": "fa:16:3e:50:f4:e0", "network": {"id": "acc49577-9bcb-4da3-ad31-4ecf60e14ce6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2140276278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e755c8-03", "ovs_interfaceid": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:f4:e0,bridge_name='br-int',has_traffic_filtering=True,id=52e755c8-03a4-4255-a48d-414e0a1ba26a,network=Network(acc49577-9bcb-4da3-ad31-4ecf60e14ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e755c8-03') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG os_vif [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:f4:e0,bridge_name='br-int',has_traffic_filtering=True,id=52e755c8-03a4-4255-a48d-414e0a1ba26a,network=Network(acc49577-9bcb-4da3-ad31-4ecf60e14ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e755c8-03') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52e755c8-03, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap52e755c8-03, col_values=(('external_ids', {'iface-id': '52e755c8-03a4-4255-a48d-414e0a1ba26a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:f4:e0', 'vm-uuid': '1246d21d-b797-4c76-b282-83e17e6bf06a'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:52 user nova-compute[72820]: INFO os_vif [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:f4:e0,bridge_name='br-int',has_traffic_filtering=True,id=52e755c8-03a4-4255-a48d-414e0a1ba26a,network=Network(acc49577-9bcb-4da3-ad31-4ecf60e14ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e755c8-03')
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] No BDM found with device name hda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:20:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] No VIF found with MAC fa:16:3e:50:f4:e0, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:20:52 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Using config drive
Aug 27 02:20:53 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Creating config drive at /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk.config
Aug 27 02:20:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpozr2as7i {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:20:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpozr2as7i" returned: 0 in 0.072s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:20:53 user nova-compute[72820]: DEBUG nova.network.neutron [req-89c1d74f-4127-4565-9723-c951681e67dd req-422a45e9-0cc6-40db-b6c6-6b37f6af0c85 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Updated VIF entry in instance network info cache for port 52e755c8-03a4-4255-a48d-414e0a1ba26a. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:20:53 user nova-compute[72820]: DEBUG nova.network.neutron [req-89c1d74f-4127-4565-9723-c951681e67dd req-422a45e9-0cc6-40db-b6c6-6b37f6af0c85 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Updating instance_info_cache with network_info: [{"id": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "address": "fa:16:3e:50:f4:e0", "network": {"id": "acc49577-9bcb-4da3-ad31-4ecf60e14ce6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2140276278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e755c8-03", "ovs_interfaceid": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:20:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-89c1d74f-4127-4565-9723-c951681e67dd req-422a45e9-0cc6-40db-b6c6-6b37f6af0c85 service nova] Releasing lock "refresh_cache-1246d21d-b797-4c76-b282-83e17e6bf06a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.network.neutron [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Successfully updated port: 7f134260-3849-4dea-bc03-f14fa02d4e17 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Acquiring lock "refresh_cache-abe48a87-2a54-468d-98e5-afae2577e541" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Acquired lock "refresh_cache-abe48a87-2a54-468d-98e5-afae2577e541" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.network.neutron [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.network.neutron [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-e29507f3-84b6-4868-8d6c-bd734e5bb9e1 req-3cab5551-44bb-41de-ac4f-72b9ebd7f139 service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Received event network-vif-plugged-82d087af-c0f8-4c88-904c-4afbf9c5239d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e29507f3-84b6-4868-8d6c-bd734e5bb9e1 req-3cab5551-44bb-41de-ac4f-72b9ebd7f139 service nova] Acquiring lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e29507f3-84b6-4868-8d6c-bd734e5bb9e1 req-3cab5551-44bb-41de-ac4f-72b9ebd7f139 service nova] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e29507f3-84b6-4868-8d6c-bd734e5bb9e1 req-3cab5551-44bb-41de-ac4f-72b9ebd7f139 service nova] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-e29507f3-84b6-4868-8d6c-bd734e5bb9e1 req-3cab5551-44bb-41de-ac4f-72b9ebd7f139 service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] No waiting events found dispatching network-vif-plugged-82d087af-c0f8-4c88-904c-4afbf9c5239d {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:20:54 user nova-compute[72820]: WARNING nova.compute.manager [req-e29507f3-84b6-4868-8d6c-bd734e5bb9e1 req-3cab5551-44bb-41de-ac4f-72b9ebd7f139 service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Received unexpected event network-vif-plugged-82d087af-c0f8-4c88-904c-4afbf9c5239d for instance with vm_state building and task_state spawning.
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-e29507f3-84b6-4868-8d6c-bd734e5bb9e1 req-3cab5551-44bb-41de-ac4f-72b9ebd7f139 service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Received event network-changed-7f134260-3849-4dea-bc03-f14fa02d4e17 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-e29507f3-84b6-4868-8d6c-bd734e5bb9e1 req-3cab5551-44bb-41de-ac4f-72b9ebd7f139 service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Refreshing instance network info cache due to event network-changed-7f134260-3849-4dea-bc03-f14fa02d4e17. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e29507f3-84b6-4868-8d6c-bd734e5bb9e1 req-3cab5551-44bb-41de-ac4f-72b9ebd7f139 service nova] Acquiring lock "refresh_cache-abe48a87-2a54-468d-98e5-afae2577e541" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.network.neutron [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Updating instance_info_cache with network_info: [{"id": "7f134260-3849-4dea-bc03-f14fa02d4e17", "address": "fa:16:3e:fc:a5:b0", "network": {"id": "fe558211-ecb3-4bc8-b195-e03c52142d69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-252580199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390ad1b0be83481fa07c91e508c5cfd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f134260-38", "ovs_interfaceid": "7f134260-3849-4dea-bc03-f14fa02d4e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Releasing lock "refresh_cache-abe48a87-2a54-468d-98e5-afae2577e541" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Instance network_info: |[{"id": "7f134260-3849-4dea-bc03-f14fa02d4e17", "address": "fa:16:3e:fc:a5:b0", "network": {"id": "fe558211-ecb3-4bc8-b195-e03c52142d69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-252580199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390ad1b0be83481fa07c91e508c5cfd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f134260-38", "ovs_interfaceid": "7f134260-3849-4dea-bc03-f14fa02d4e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e29507f3-84b6-4868-8d6c-bd734e5bb9e1 req-3cab5551-44bb-41de-ac4f-72b9ebd7f139 service nova] Acquired lock "refresh_cache-abe48a87-2a54-468d-98e5-afae2577e541" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.network.neutron [req-e29507f3-84b6-4868-8d6c-bd734e5bb9e1 req-3cab5551-44bb-41de-ac4f-72b9ebd7f139 service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Refreshing network info cache for port 7f134260-3849-4dea-bc03-f14fa02d4e17 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Start _get_guest_xml network_info=[{"id": "7f134260-3849-4dea-bc03-f14fa02d4e17", "address": "fa:16:3e:fc:a5:b0", "network": {"id": "fe558211-ecb3-4bc8-b195-e03c52142d69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-252580199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390ad1b0be83481fa07c91e508c5cfd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f134260-38", "ovs_interfaceid": "7f134260-3849-4dea-bc03-f14fa02d4e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:20:54 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:20:54 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-953097995',display_name='tempest-TestVolumeSwap-server-953097995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-953097995',id=8,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoz2u142IJT8XJGXdw3UfSoburxqSszh/xiQAXLHnK60gdoLcZzd2wDn3FqLScZkoDc+5ULhfLQbYXGZdmf1WgEDwkXl5ztutqIReCYhQBSjYZooP1j3oPXiY5cpJDCkQ==',key_name='tempest-keypair-1244368154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='390ad1b0be83481fa07c91e508c5cfd8',ramdisk_id='',reservation_id='r-17m3skli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1356089657',owner_user_name='tempest-TestVolumeSwap-1356089657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17f292f6541f4b77a29c3b48933ecddb',uuid=abe48a87-2a54-468d-98e5-afae2577e541,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f134260-3849-4dea-bc03-f14fa02d4e17", "address": "fa:16:3e:fc:a5:b0", "network": {"id": "fe558211-ecb3-4bc8-b195-e03c52142d69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-252580199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390ad1b0be83481fa07c91e508c5cfd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f134260-38", "ovs_interfaceid": "7f134260-3849-4dea-bc03-f14fa02d4e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Converting VIF {"id": "7f134260-3849-4dea-bc03-f14fa02d4e17", "address": "fa:16:3e:fc:a5:b0", "network": {"id": "fe558211-ecb3-4bc8-b195-e03c52142d69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-252580199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390ad1b0be83481fa07c91e508c5cfd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f134260-38", "ovs_interfaceid": "7f134260-3849-4dea-bc03-f14fa02d4e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:a5:b0,bridge_name='br-int',has_traffic_filtering=True,id=7f134260-3849-4dea-bc03-f14fa02d4e17,network=Network(fe558211-ecb3-4bc8-b195-e03c52142d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f134260-38') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.objects.instance [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lazy-loading 'pci_devices' on Instance uuid abe48a87-2a54-468d-98e5-afae2577e541 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:20:54 user nova-compute[72820]:   <uuid>abe48a87-2a54-468d-98e5-afae2577e541</uuid>
Aug 27 02:20:54 user nova-compute[72820]:   <name>instance-00000008</name>
Aug 27 02:20:54 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:20:54 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:20:54 user nova-compute[72820]:   <metadata>
Aug 27 02:20:54 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:20:54 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:20:54 user nova-compute[72820]:       <nova:name>tempest-TestVolumeSwap-server-953097995</nova:name>
Aug 27 02:20:54 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:20:54</nova:creationTime>
Aug 27 02:20:54 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:20:54 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:20:54 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:20:54 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:20:54 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:20:54 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:20:54 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:20:54 user nova-compute[72820]:       <nova:owner>
Aug 27 02:20:54 user nova-compute[72820]:         <nova:user uuid="17f292f6541f4b77a29c3b48933ecddb">tempest-TestVolumeSwap-1356089657-project-member</nova:user>
Aug 27 02:20:54 user nova-compute[72820]:         <nova:project uuid="390ad1b0be83481fa07c91e508c5cfd8">tempest-TestVolumeSwap-1356089657</nova:project>
Aug 27 02:20:54 user nova-compute[72820]:       </nova:owner>
Aug 27 02:20:54 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:20:54 user nova-compute[72820]:       <nova:ports>
Aug 27 02:20:54 user nova-compute[72820]:         <nova:port uuid="7f134260-3849-4dea-bc03-f14fa02d4e17">
Aug 27 02:20:54 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 02:20:54 user nova-compute[72820]:         </nova:port>
Aug 27 02:20:54 user nova-compute[72820]:       </nova:ports>
Aug 27 02:20:54 user nova-compute[72820]:     </nova:instance>
Aug 27 02:20:54 user nova-compute[72820]:   </metadata>
Aug 27 02:20:54 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:20:54 user nova-compute[72820]:     <system>
Aug 27 02:20:54 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:20:54 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:20:54 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:20:54 user nova-compute[72820]:       <entry name="serial">abe48a87-2a54-468d-98e5-afae2577e541</entry>
Aug 27 02:20:54 user nova-compute[72820]:       <entry name="uuid">abe48a87-2a54-468d-98e5-afae2577e541</entry>
Aug 27 02:20:54 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:20:54 user nova-compute[72820]:     </system>
Aug 27 02:20:54 user nova-compute[72820]:   </sysinfo>
Aug 27 02:20:54 user nova-compute[72820]:   <os>
Aug 27 02:20:54 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:20:54 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:20:54 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:20:54 user nova-compute[72820]:   </os>
Aug 27 02:20:54 user nova-compute[72820]:   <features>
Aug 27 02:20:54 user nova-compute[72820]:     <acpi/>
Aug 27 02:20:54 user nova-compute[72820]:     <apic/>
Aug 27 02:20:54 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:20:54 user nova-compute[72820]:   </features>
Aug 27 02:20:54 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:20:54 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:20:54 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:20:54 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:20:54 user nova-compute[72820]:   </clock>
Aug 27 02:20:54 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:20:54 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:20:54 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:20:54 user nova-compute[72820]:   </cpu>
Aug 27 02:20:54 user nova-compute[72820]:   <devices>
Aug 27 02:20:54 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:20:54 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:20:54 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk"/>
Aug 27 02:20:54 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:20:54 user nova-compute[72820]:     </disk>
Aug 27 02:20:54 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:20:54 user nova-compute[72820]:       <mac address="fa:16:3e:fc:a5:b0"/>
Aug 27 02:20:54 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:20:54 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:20:54 user nova-compute[72820]:       <target dev="tap7f134260-38"/>
Aug 27 02:20:54 user nova-compute[72820]:     </interface>
Aug 27 02:20:54 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:20:54 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/console.log" append="off"/>
Aug 27 02:20:54 user nova-compute[72820]:     </serial>
Aug 27 02:20:54 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:20:54 user nova-compute[72820]:     <video>
Aug 27 02:20:54 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:20:54 user nova-compute[72820]:     </video>
Aug 27 02:20:54 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:20:54 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:20:54 user nova-compute[72820]:     </rng>
Aug 27 02:20:54 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:20:54 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:20:54 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:20:54 user nova-compute[72820]:     </memballoon>
Aug 27 02:20:54 user nova-compute[72820]:   </devices>
Aug 27 02:20:54 user nova-compute[72820]: </domain>
Aug 27 02:20:54 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-953097995',display_name='tempest-TestVolumeSwap-server-953097995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-953097995',id=8,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoz2u142IJT8XJGXdw3UfSoburxqSszh/xiQAXLHnK60gdoLcZzd2wDn3FqLScZkoDc+5ULhfLQbYXGZdmf1WgEDwkXl5ztutqIReCYhQBSjYZooP1j3oPXiY5cpJDCkQ==',key_name='tempest-keypair-1244368154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='390ad1b0be83481fa07c91e508c5cfd8',ramdisk_id='',reservation_id='r-17m3skli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1356089657',owner_user_name='tempest-TestVolumeSwap-1356089657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17f292f6541f4b77a29c3b48933ecddb',uuid=abe48a87-2a54-468d-98e5-afae2577e541,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f134260-3849-4dea-bc03-f14fa02d4e17", "address": "fa:16:3e:fc:a5:b0", "network": {"id": "fe558211-ecb3-4bc8-b195-e03c52142d69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-252580199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390ad1b0be83481fa07c91e508c5cfd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f134260-38", "ovs_interfaceid": "7f134260-3849-4dea-bc03-f14fa02d4e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Converting VIF {"id": "7f134260-3849-4dea-bc03-f14fa02d4e17", "address": "fa:16:3e:fc:a5:b0", "network": {"id": "fe558211-ecb3-4bc8-b195-e03c52142d69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-252580199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390ad1b0be83481fa07c91e508c5cfd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f134260-38", "ovs_interfaceid": "7f134260-3849-4dea-bc03-f14fa02d4e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:a5:b0,bridge_name='br-int',has_traffic_filtering=True,id=7f134260-3849-4dea-bc03-f14fa02d4e17,network=Network(fe558211-ecb3-4bc8-b195-e03c52142d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f134260-38') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG os_vif [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:a5:b0,bridge_name='br-int',has_traffic_filtering=True,id=7f134260-3849-4dea-bc03-f14fa02d4e17,network=Network(fe558211-ecb3-4bc8-b195-e03c52142d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f134260-38') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f134260-38, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f134260-38, col_values=(('external_ids', {'iface-id': '7f134260-3849-4dea-bc03-f14fa02d4e17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:a5:b0', 'vm-uuid': 'abe48a87-2a54-468d-98e5-afae2577e541'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:54 user nova-compute[72820]: INFO os_vif [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:a5:b0,bridge_name='br-int',has_traffic_filtering=True,id=7f134260-3849-4dea-bc03-f14fa02d4e17,network=Network(fe558211-ecb3-4bc8-b195-e03c52142d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f134260-38')
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102854.9154105, 8ae21d01-4c7c-4926-9868-cf8786e59d4d => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:20:54 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] VM Resumed (Lifecycle Event)
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:20:54 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Instance spawned successfully.
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:20:55 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:20:55 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102854.9215643, 8ae21d01-4c7c-4926-9868-cf8786e59d4d => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:20:55 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] VM Started (Lifecycle Event)
Aug 27 02:20:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:20:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] No VIF found with MAC fa:16:3e:fc:a5:b0, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:20:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:20:55 user nova-compute[72820]: INFO nova.compute.manager [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Took 9.35 seconds to spawn the instance on the hypervisor.
Aug 27 02:20:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:55 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:20:55 user nova-compute[72820]: INFO nova.compute.manager [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Took 10.50 seconds to build instance.
Aug 27 02:20:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e1977997-5d26-4411-a7a7-31982419a7a5 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.714s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:55 user nova-compute[72820]: DEBUG nova.network.neutron [req-e29507f3-84b6-4868-8d6c-bd734e5bb9e1 req-3cab5551-44bb-41de-ac4f-72b9ebd7f139 service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Updated VIF entry in instance network info cache for port 7f134260-3849-4dea-bc03-f14fa02d4e17. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:20:55 user nova-compute[72820]: DEBUG nova.network.neutron [req-e29507f3-84b6-4868-8d6c-bd734e5bb9e1 req-3cab5551-44bb-41de-ac4f-72b9ebd7f139 service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Updating instance_info_cache with network_info: [{"id": "7f134260-3849-4dea-bc03-f14fa02d4e17", "address": "fa:16:3e:fc:a5:b0", "network": {"id": "fe558211-ecb3-4bc8-b195-e03c52142d69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-252580199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390ad1b0be83481fa07c91e508c5cfd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f134260-38", "ovs_interfaceid": "7f134260-3849-4dea-bc03-f14fa02d4e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:20:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e29507f3-84b6-4868-8d6c-bd734e5bb9e1 req-3cab5551-44bb-41de-ac4f-72b9ebd7f139 service nova] Releasing lock "refresh_cache-abe48a87-2a54-468d-98e5-afae2577e541" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:20:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-a86fc572-6d11-4b45-bc85-792de85c756e req-b338f656-0071-4f97-a424-489e953685a2 service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Received event network-vif-plugged-7f134260-3849-4dea-bc03-f14fa02d4e17 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a86fc572-6d11-4b45-bc85-792de85c756e req-b338f656-0071-4f97-a424-489e953685a2 service nova] Acquiring lock "abe48a87-2a54-468d-98e5-afae2577e541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a86fc572-6d11-4b45-bc85-792de85c756e req-b338f656-0071-4f97-a424-489e953685a2 service nova] Lock "abe48a87-2a54-468d-98e5-afae2577e541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a86fc572-6d11-4b45-bc85-792de85c756e req-b338f656-0071-4f97-a424-489e953685a2 service nova] Lock "abe48a87-2a54-468d-98e5-afae2577e541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-a86fc572-6d11-4b45-bc85-792de85c756e req-b338f656-0071-4f97-a424-489e953685a2 service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] No waiting events found dispatching network-vif-plugged-7f134260-3849-4dea-bc03-f14fa02d4e17 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:20:57 user nova-compute[72820]: WARNING nova.compute.manager [req-a86fc572-6d11-4b45-bc85-792de85c756e req-b338f656-0071-4f97-a424-489e953685a2 service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Received unexpected event network-vif-plugged-7f134260-3849-4dea-bc03-f14fa02d4e17 for instance with vm_state building and task_state spawning.
Aug 27 02:20:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:20:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 02:20:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] There are 0 instances to clean {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 02:20:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:20:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 02:20:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Acquiring lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:20:59 user nova-compute[72820]: INFO nova.compute.claims [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Claim successful on node user
Aug 27 02:20:59 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102859.4893332, 1246d21d-b797-4c76-b282-83e17e6bf06a => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:20:59 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] VM Resumed (Lifecycle Event)
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:20:59 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Instance spawned successfully.
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:20:59 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102859.492857, 1246d21d-b797-4c76-b282-83e17e6bf06a => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:20:59 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] VM Started (Lifecycle Event)
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:20:59 user nova-compute[72820]: INFO nova.compute.manager [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Took 11.03 seconds to spawn the instance on the hypervisor.
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:20:59 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-7e28a668-fd60-42bb-9f0e-97890ce6741a req-ec6fcb9d-5804-4acd-bbf5-a7c6684a39f1 service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Received event network-vif-plugged-7f134260-3849-4dea-bc03-f14fa02d4e17 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7e28a668-fd60-42bb-9f0e-97890ce6741a req-ec6fcb9d-5804-4acd-bbf5-a7c6684a39f1 service nova] Acquiring lock "abe48a87-2a54-468d-98e5-afae2577e541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7e28a668-fd60-42bb-9f0e-97890ce6741a req-ec6fcb9d-5804-4acd-bbf5-a7c6684a39f1 service nova] Lock "abe48a87-2a54-468d-98e5-afae2577e541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7e28a668-fd60-42bb-9f0e-97890ce6741a req-ec6fcb9d-5804-4acd-bbf5-a7c6684a39f1 service nova] Lock "abe48a87-2a54-468d-98e5-afae2577e541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-7e28a668-fd60-42bb-9f0e-97890ce6741a req-ec6fcb9d-5804-4acd-bbf5-a7c6684a39f1 service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] No waiting events found dispatching network-vif-plugged-7f134260-3849-4dea-bc03-f14fa02d4e17 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:20:59 user nova-compute[72820]: WARNING nova.compute.manager [req-7e28a668-fd60-42bb-9f0e-97890ce6741a req-ec6fcb9d-5804-4acd-bbf5-a7c6684a39f1 service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Received unexpected event network-vif-plugged-7f134260-3849-4dea-bc03-f14fa02d4e17 for instance with vm_state building and task_state spawning.
Aug 27 02:20:59 user nova-compute[72820]: INFO nova.compute.manager [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Took 12.11 seconds to build instance.
Aug 27 02:20:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-99380073-2dc2-4ab7-add3-10128e919d8a tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.372s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102859.9734728, abe48a87-2a54-468d-98e5-afae2577e541 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:20:59 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: abe48a87-2a54-468d-98e5-afae2577e541] VM Resumed (Lifecycle Event)
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:20:59 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Instance spawned successfully.
Aug 27 02:20:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:21:00 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: abe48a87-2a54-468d-98e5-afae2577e541] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102859.9745615, abe48a87-2a54-468d-98e5-afae2577e541 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:21:00 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: abe48a87-2a54-468d-98e5-afae2577e541] VM Started (Lifecycle Event)
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:21:00 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: abe48a87-2a54-468d-98e5-afae2577e541] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:21:00 user nova-compute[72820]: INFO nova.compute.manager [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Took 9.02 seconds to spawn the instance on the hypervisor.
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.979s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.compute.manager [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:21:00 user nova-compute[72820]: INFO nova.compute.manager [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Took 10.27 seconds to build instance.
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.compute.manager [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.network.neutron [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2716caad-6f52-4362-830e-fc8ccea4e98e tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "abe48a87-2a54-468d-98e5-afae2577e541" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.461s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:21:00 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.compute.manager [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.policy [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae40392499a646ef81a346ecbd78ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea4a72361814294b5a2378a8512abe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.compute.manager [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:21:00 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Creating image(s)
Aug 27 02:21:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Lock "/opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Lock "/opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.274s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:21:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.247s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk 1073741824" returned: 0 in 0.063s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.005s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.335s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG nova.network.neutron [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Successfully created port: ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Cannot resize image /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Ensure instance console log exists: /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:21:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:21:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:02 user nova-compute[72820]: DEBUG nova.network.neutron [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Successfully updated port: ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:21:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Acquiring lock "refresh_cache-0d99438e-e6d1-4fc3-a399-7e844c8f9538" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:21:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Acquired lock "refresh_cache-0d99438e-e6d1-4fc3-a399-7e844c8f9538" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:21:02 user nova-compute[72820]: DEBUG nova.network.neutron [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:21:02 user nova-compute[72820]: DEBUG nova.compute.manager [req-b6cbe97f-116a-4ee6-9091-92f8d9ce34b8 req-ce8dfccf-8a69-46f3-9928-2d129018dfca service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Received event network-changed-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:21:02 user nova-compute[72820]: DEBUG nova.compute.manager [req-b6cbe97f-116a-4ee6-9091-92f8d9ce34b8 req-ce8dfccf-8a69-46f3-9928-2d129018dfca service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Refreshing instance network info cache due to event network-changed-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:21:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b6cbe97f-116a-4ee6-9091-92f8d9ce34b8 req-ce8dfccf-8a69-46f3-9928-2d129018dfca service nova] Acquiring lock "refresh_cache-0d99438e-e6d1-4fc3-a399-7e844c8f9538" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:21:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:02 user nova-compute[72820]: DEBUG nova.network.neutron [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.network.neutron [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Updating instance_info_cache with network_info: [{"id": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "address": "fa:16:3e:80:50:5b", "network": {"id": "1d1b3f8c-f7ac-48bc-a3af-2a801a350494", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688950999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aea4a72361814294b5a2378a8512abe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc3b16a-3f", "ovs_interfaceid": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Releasing lock "refresh_cache-0d99438e-e6d1-4fc3-a399-7e844c8f9538" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.compute.manager [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Instance network_info: |[{"id": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "address": "fa:16:3e:80:50:5b", "network": {"id": "1d1b3f8c-f7ac-48bc-a3af-2a801a350494", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688950999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aea4a72361814294b5a2378a8512abe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc3b16a-3f", "ovs_interfaceid": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b6cbe97f-116a-4ee6-9091-92f8d9ce34b8 req-ce8dfccf-8a69-46f3-9928-2d129018dfca service nova] Acquired lock "refresh_cache-0d99438e-e6d1-4fc3-a399-7e844c8f9538" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.network.neutron [req-b6cbe97f-116a-4ee6-9091-92f8d9ce34b8 req-ce8dfccf-8a69-46f3-9928-2d129018dfca service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Refreshing network info cache for port ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Start _get_guest_xml network_info=[{"id": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "address": "fa:16:3e:80:50:5b", "network": {"id": "1d1b3f8c-f7ac-48bc-a3af-2a801a350494", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688950999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aea4a72361814294b5a2378a8512abe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc3b16a-3f", "ovs_interfaceid": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:21:03 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:21:03 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1963514045',display_name='tempest-VolumesAssistedSnapshotsTest-server-1963514045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1963514045',id=9,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXv+c34RRrCHLc+b6QpJfvO893JppETFZUVjrO70UAa/IZhb6GBiUPm6I9aGeFzlnNa+OXRZLuih7+/EhiDwces1R9sbMqZD1npqXkONZMa5n+1nla4qb+OsrsNRnz3Iw==',key_name='tempest-keypair-256567050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aea4a72361814294b5a2378a8512abe6',ramdisk_id='',reservation_id='r-5739cepl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1276797688',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1276797688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:21:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae40392499a646ef81a346ecbd78ec91',uuid=0d99438e-e6d1-4fc3-a399-7e844c8f9538,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "address": "fa:16:3e:80:50:5b", "network": {"id": "1d1b3f8c-f7ac-48bc-a3af-2a801a350494", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688950999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aea4a72361814294b5a2378a8512abe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc3b16a-3f", "ovs_interfaceid": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Converting VIF {"id": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "address": "fa:16:3e:80:50:5b", "network": {"id": "1d1b3f8c-f7ac-48bc-a3af-2a801a350494", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688950999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aea4a72361814294b5a2378a8512abe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc3b16a-3f", "ovs_interfaceid": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:50:5b,bridge_name='br-int',has_traffic_filtering=True,id=ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14,network=Network(1d1b3f8c-f7ac-48bc-a3af-2a801a350494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc3b16a-3f') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.objects.instance [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d99438e-e6d1-4fc3-a399-7e844c8f9538 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:21:03 user nova-compute[72820]:   <uuid>0d99438e-e6d1-4fc3-a399-7e844c8f9538</uuid>
Aug 27 02:21:03 user nova-compute[72820]:   <name>instance-00000009</name>
Aug 27 02:21:03 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:21:03 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:21:03 user nova-compute[72820]:   <metadata>
Aug 27 02:21:03 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:21:03 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:21:03 user nova-compute[72820]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1963514045</nova:name>
Aug 27 02:21:03 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:21:03</nova:creationTime>
Aug 27 02:21:03 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:21:03 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:21:03 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:21:03 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:21:03 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:21:03 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:21:03 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:21:03 user nova-compute[72820]:       <nova:owner>
Aug 27 02:21:03 user nova-compute[72820]:         <nova:user uuid="ae40392499a646ef81a346ecbd78ec91">tempest-VolumesAssistedSnapshotsTest-1276797688-project-member</nova:user>
Aug 27 02:21:03 user nova-compute[72820]:         <nova:project uuid="aea4a72361814294b5a2378a8512abe6">tempest-VolumesAssistedSnapshotsTest-1276797688</nova:project>
Aug 27 02:21:03 user nova-compute[72820]:       </nova:owner>
Aug 27 02:21:03 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:21:03 user nova-compute[72820]:       <nova:ports>
Aug 27 02:21:03 user nova-compute[72820]:         <nova:port uuid="ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14">
Aug 27 02:21:03 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 02:21:03 user nova-compute[72820]:         </nova:port>
Aug 27 02:21:03 user nova-compute[72820]:       </nova:ports>
Aug 27 02:21:03 user nova-compute[72820]:     </nova:instance>
Aug 27 02:21:03 user nova-compute[72820]:   </metadata>
Aug 27 02:21:03 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:21:03 user nova-compute[72820]:     <system>
Aug 27 02:21:03 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:21:03 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:21:03 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:21:03 user nova-compute[72820]:       <entry name="serial">0d99438e-e6d1-4fc3-a399-7e844c8f9538</entry>
Aug 27 02:21:03 user nova-compute[72820]:       <entry name="uuid">0d99438e-e6d1-4fc3-a399-7e844c8f9538</entry>
Aug 27 02:21:03 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:21:03 user nova-compute[72820]:     </system>
Aug 27 02:21:03 user nova-compute[72820]:   </sysinfo>
Aug 27 02:21:03 user nova-compute[72820]:   <os>
Aug 27 02:21:03 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:21:03 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:21:03 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:21:03 user nova-compute[72820]:   </os>
Aug 27 02:21:03 user nova-compute[72820]:   <features>
Aug 27 02:21:03 user nova-compute[72820]:     <acpi/>
Aug 27 02:21:03 user nova-compute[72820]:     <apic/>
Aug 27 02:21:03 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:21:03 user nova-compute[72820]:   </features>
Aug 27 02:21:03 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:21:03 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:21:03 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:21:03 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:21:03 user nova-compute[72820]:   </clock>
Aug 27 02:21:03 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:21:03 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:21:03 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:21:03 user nova-compute[72820]:   </cpu>
Aug 27 02:21:03 user nova-compute[72820]:   <devices>
Aug 27 02:21:03 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:21:03 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:21:03 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk"/>
Aug 27 02:21:03 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:21:03 user nova-compute[72820]:     </disk>
Aug 27 02:21:03 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:21:03 user nova-compute[72820]:       <mac address="fa:16:3e:80:50:5b"/>
Aug 27 02:21:03 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:21:03 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:21:03 user nova-compute[72820]:       <target dev="tapebc3b16a-3f"/>
Aug 27 02:21:03 user nova-compute[72820]:     </interface>
Aug 27 02:21:03 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:21:03 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/console.log" append="off"/>
Aug 27 02:21:03 user nova-compute[72820]:     </serial>
Aug 27 02:21:03 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:21:03 user nova-compute[72820]:     <video>
Aug 27 02:21:03 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:21:03 user nova-compute[72820]:     </video>
Aug 27 02:21:03 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:21:03 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:21:03 user nova-compute[72820]:     </rng>
Aug 27 02:21:03 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:21:03 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:21:03 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:21:03 user nova-compute[72820]:     </memballoon>
Aug 27 02:21:03 user nova-compute[72820]:   </devices>
Aug 27 02:21:03 user nova-compute[72820]: </domain>
Aug 27 02:21:03 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1963514045',display_name='tempest-VolumesAssistedSnapshotsTest-server-1963514045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1963514045',id=9,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXv+c34RRrCHLc+b6QpJfvO893JppETFZUVjrO70UAa/IZhb6GBiUPm6I9aGeFzlnNa+OXRZLuih7+/EhiDwces1R9sbMqZD1npqXkONZMa5n+1nla4qb+OsrsNRnz3Iw==',key_name='tempest-keypair-256567050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aea4a72361814294b5a2378a8512abe6',ramdisk_id='',reservation_id='r-5739cepl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1276797688',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1276797688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:21:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae40392499a646ef81a346ecbd78ec91',uuid=0d99438e-e6d1-4fc3-a399-7e844c8f9538,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "address": "fa:16:3e:80:50:5b", "network": {"id": "1d1b3f8c-f7ac-48bc-a3af-2a801a350494", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688950999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aea4a72361814294b5a2378a8512abe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc3b16a-3f", "ovs_interfaceid": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Converting VIF {"id": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "address": "fa:16:3e:80:50:5b", "network": {"id": "1d1b3f8c-f7ac-48bc-a3af-2a801a350494", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688950999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aea4a72361814294b5a2378a8512abe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc3b16a-3f", "ovs_interfaceid": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:50:5b,bridge_name='br-int',has_traffic_filtering=True,id=ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14,network=Network(1d1b3f8c-f7ac-48bc-a3af-2a801a350494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc3b16a-3f') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG os_vif [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:50:5b,bridge_name='br-int',has_traffic_filtering=True,id=ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14,network=Network(1d1b3f8c-f7ac-48bc-a3af-2a801a350494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc3b16a-3f') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebc3b16a-3f, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapebc3b16a-3f, col_values=(('external_ids', {'iface-id': 'ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:50:5b', 'vm-uuid': '0d99438e-e6d1-4fc3-a399-7e844c8f9538'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:03 user nova-compute[72820]: INFO os_vif [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:50:5b,bridge_name='br-int',has_traffic_filtering=True,id=ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14,network=Network(1d1b3f8c-f7ac-48bc-a3af-2a801a350494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc3b16a-3f')
Aug 27 02:21:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:21:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] No VIF found with MAC fa:16:3e:80:50:5b, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:21:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:04 user nova-compute[72820]: DEBUG nova.network.neutron [req-b6cbe97f-116a-4ee6-9091-92f8d9ce34b8 req-ce8dfccf-8a69-46f3-9928-2d129018dfca service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Updated VIF entry in instance network info cache for port ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:21:04 user nova-compute[72820]: DEBUG nova.network.neutron [req-b6cbe97f-116a-4ee6-9091-92f8d9ce34b8 req-ce8dfccf-8a69-46f3-9928-2d129018dfca service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Updating instance_info_cache with network_info: [{"id": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "address": "fa:16:3e:80:50:5b", "network": {"id": "1d1b3f8c-f7ac-48bc-a3af-2a801a350494", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688950999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aea4a72361814294b5a2378a8512abe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc3b16a-3f", "ovs_interfaceid": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:21:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b6cbe97f-116a-4ee6-9091-92f8d9ce34b8 req-ce8dfccf-8a69-46f3-9928-2d129018dfca service nova] Releasing lock "refresh_cache-0d99438e-e6d1-4fc3-a399-7e844c8f9538" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:21:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk --force-share --output=json" returned: 0 in 0.394s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102868.6605372, 0d99438e-e6d1-4fc3-a399-7e844c8f9538 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:21:09 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] VM Resumed (Lifecycle Event)
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:21:09 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:21:09 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7684MB free_disk=25.636356353759766GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:21:09 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Instance spawned successfully.
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:21:09 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102868.6652982, 0d99438e-e6d1-4fc3-a399-7e844c8f9538 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:21:09 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] VM Started (Lifecycle Event)
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:21:09 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:21:09 user nova-compute[72820]: INFO nova.compute.manager [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Took 8.84 seconds to spawn the instance on the hypervisor.
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:21:09 user nova-compute[72820]: INFO nova.compute.manager [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Took 10.42 seconds to build instance.
Aug 27 02:21:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d6131c33-a2d4-4c9a-abeb-bd2192e72e6a tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.604s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 703a5060-dd34-4fff-9dec-6924ad018713 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 26581695-c4b9-40b8-ab7a-34c99db0dadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f8f612f3-41c9-4dae-8d49-218d61720b15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6ed3c12e-96a8-4a32-8089-f04eba608663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 8ae21d01-4c7c-4926-9868-cf8786e59d4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1246d21d-b797-4c76-b282-83e17e6bf06a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance abe48a87-2a54-468d-98e5-afae2577e541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 0d99438e-e6d1-4fc3-a399-7e844c8f9538 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing inventories for resource provider a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Updating ProviderTree inventory for provider a962b30a-2750-431c-be10-075d0f991065 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Updating inventory in ProviderTree for provider a962b30a-2750-431c-be10-075d0f991065 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 02:21:09 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing aggregate associations for resource provider a962b30a-2750-431c-be10-075d0f991065, aggregates: None {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 02:21:10 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing trait associations for resource provider a962b30a-2750-431c-be10-075d0f991065, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 02:21:10 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:21:10 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:21:10 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:21:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.313s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:21:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-98b4f081-3465-4cf7-80cb-5eda5bddcb7a req-60359c90-7464-4ff9-87c7-65d0857d3e97 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received event network-vif-plugged-52e755c8-03a4-4255-a48d-414e0a1ba26a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:21:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-98b4f081-3465-4cf7-80cb-5eda5bddcb7a req-60359c90-7464-4ff9-87c7-65d0857d3e97 service nova] Acquiring lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:21:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-98b4f081-3465-4cf7-80cb-5eda5bddcb7a req-60359c90-7464-4ff9-87c7-65d0857d3e97 service nova] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:21:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-98b4f081-3465-4cf7-80cb-5eda5bddcb7a req-60359c90-7464-4ff9-87c7-65d0857d3e97 service nova] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:21:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-98b4f081-3465-4cf7-80cb-5eda5bddcb7a req-60359c90-7464-4ff9-87c7-65d0857d3e97 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] No waiting events found dispatching network-vif-plugged-52e755c8-03a4-4255-a48d-414e0a1ba26a {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:21:11 user nova-compute[72820]: WARNING nova.compute.manager [req-98b4f081-3465-4cf7-80cb-5eda5bddcb7a req-60359c90-7464-4ff9-87c7-65d0857d3e97 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received unexpected event network-vif-plugged-52e755c8-03a4-4255-a48d-414e0a1ba26a for instance with vm_state active and task_state None.
Aug 27 02:21:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:21:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:21:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:21:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 02:21:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-703a5060-dd34-4fff-9dec-6924ad018713" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:21:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-703a5060-dd34-4fff-9dec-6924ad018713" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:21:11 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:21:11 user nova-compute[72820]: DEBUG nova.objects.instance [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lazy-loading 'info_cache' on Instance uuid 703a5060-dd34-4fff-9dec-6924ad018713 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:21:12 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Updating instance_info_cache with network_info: [{"id": "3174b771-02bc-4766-9e03-53c1e899b297", "address": "fa:16:3e:50:07:21", "network": {"id": "06365b03-94bf-4068-a08a-b794dc377256", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1090515065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87dab14feca44a93aaf191cedb1b0a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3174b771-02", "ovs_interfaceid": "3174b771-02bc-4766-9e03-53c1e899b297", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:21:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-703a5060-dd34-4fff-9dec-6924ad018713" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:21:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:21:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:21:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:21:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-ea9dceea-4c09-4d15-a310-828f77d04424 req-a18963aa-f931-4b66-a407-8abc7f892efc service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received event network-vif-plugged-52e755c8-03a4-4255-a48d-414e0a1ba26a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:21:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ea9dceea-4c09-4d15-a310-828f77d04424 req-a18963aa-f931-4b66-a407-8abc7f892efc service nova] Acquiring lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:21:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ea9dceea-4c09-4d15-a310-828f77d04424 req-a18963aa-f931-4b66-a407-8abc7f892efc service nova] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:21:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ea9dceea-4c09-4d15-a310-828f77d04424 req-a18963aa-f931-4b66-a407-8abc7f892efc service nova] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:21:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-ea9dceea-4c09-4d15-a310-828f77d04424 req-a18963aa-f931-4b66-a407-8abc7f892efc service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] No waiting events found dispatching network-vif-plugged-52e755c8-03a4-4255-a48d-414e0a1ba26a {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:21:13 user nova-compute[72820]: WARNING nova.compute.manager [req-ea9dceea-4c09-4d15-a310-828f77d04424 req-a18963aa-f931-4b66-a407-8abc7f892efc service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received unexpected event network-vif-plugged-52e755c8-03a4-4255-a48d-414e0a1ba26a for instance with vm_state active and task_state None.
Aug 27 02:21:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-ea9dceea-4c09-4d15-a310-828f77d04424 req-a18963aa-f931-4b66-a407-8abc7f892efc service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Received event network-vif-plugged-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:21:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ea9dceea-4c09-4d15-a310-828f77d04424 req-a18963aa-f931-4b66-a407-8abc7f892efc service nova] Acquiring lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:21:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ea9dceea-4c09-4d15-a310-828f77d04424 req-a18963aa-f931-4b66-a407-8abc7f892efc service nova] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:21:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ea9dceea-4c09-4d15-a310-828f77d04424 req-a18963aa-f931-4b66-a407-8abc7f892efc service nova] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:21:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-ea9dceea-4c09-4d15-a310-828f77d04424 req-a18963aa-f931-4b66-a407-8abc7f892efc service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] No waiting events found dispatching network-vif-plugged-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:21:13 user nova-compute[72820]: WARNING nova.compute.manager [req-ea9dceea-4c09-4d15-a310-828f77d04424 req-a18963aa-f931-4b66-a407-8abc7f892efc service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Received unexpected event network-vif-plugged-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 for instance with vm_state active and task_state None.
Aug 27 02:21:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-ea9dceea-4c09-4d15-a310-828f77d04424 req-a18963aa-f931-4b66-a407-8abc7f892efc service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Received event network-vif-plugged-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:21:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ea9dceea-4c09-4d15-a310-828f77d04424 req-a18963aa-f931-4b66-a407-8abc7f892efc service nova] Acquiring lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:21:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ea9dceea-4c09-4d15-a310-828f77d04424 req-a18963aa-f931-4b66-a407-8abc7f892efc service nova] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:21:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ea9dceea-4c09-4d15-a310-828f77d04424 req-a18963aa-f931-4b66-a407-8abc7f892efc service nova] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:21:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-ea9dceea-4c09-4d15-a310-828f77d04424 req-a18963aa-f931-4b66-a407-8abc7f892efc service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] No waiting events found dispatching network-vif-plugged-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:21:13 user nova-compute[72820]: WARNING nova.compute.manager [req-ea9dceea-4c09-4d15-a310-828f77d04424 req-a18963aa-f931-4b66-a407-8abc7f892efc service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Received unexpected event network-vif-plugged-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 for instance with vm_state active and task_state None.
Aug 27 02:21:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:21:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:21:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:21:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:21:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:21:45 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:21:45 user nova-compute[72820]: INFO nova.compute.claims [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Claim successful on node user
Aug 27 02:21:45 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:21:45 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:21:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:21:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:21:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:21:45 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:21:45 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:21:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:21:45 user nova-compute[72820]: INFO nova.virt.block_device [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Booting with volume e0408d30-fda0-45f6-856a-de9a2a75572b at /dev/vda
Aug 27 02:21:46 user nova-compute[72820]: DEBUG nova.policy [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db576ff11e7a4258a2f2a5961a06bf89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e3cfb8d39743be8aeac5c6c2a665c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:21:46 user nova-compute[72820]: DEBUG os_brick.utils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:21:46 user nova-compute[72820]: INFO oslo.privsep.daemon [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpgaf2hmze/privsep.sock']
Aug 27 02:21:46 user sudo[84022]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpgaf2hmze/privsep.sock
Aug 27 02:21:46 user sudo[84022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 27 02:21:46 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Successfully created port: 73dd97ef-6247-4cbb-bfe3-834c7abd5361 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:21:47 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Successfully created port: d213a9b4-5eaf-476b-9577-d9583e26a6b0 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:21:47 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Successfully created port: 6a8419c8-b3eb-40ec-8f50-2eebcf714f9f {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:21:47 user sudo[84022]: pam_unix(sudo:session): session closed for user root
Aug 27 02:21:47 user nova-compute[72820]: INFO oslo.privsep.daemon [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Spawned new privsep daemon via rootwrap
Aug 27 02:21:47 user nova-compute[72820]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 27 02:21:47 user nova-compute[72820]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 27 02:21:47 user nova-compute[72820]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 27 02:21:47 user nova-compute[72820]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84057
Aug 27 02:21:47 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[616b2170-37ef-458c-b79c-6b46d8ebc602]: (2,) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a6aa81-15e9-43da-8845-ea2516a04a1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:21:48 user nova-compute[72820]: WARNING os_brick.initiator.connectors.nvmeof [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 27 02:21:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff75926-2433-4d5e-8623-2ca93117ad50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[784fe9cc-ca98-4cc6-83c4-c9ea3aac321f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[88481d8b-d8e6-4b6b-884e-42f34ea286fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:21:48 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:21:48 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b0a093-5c2d-4e78-a72e-781d539c80c1]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG os_brick.utils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] <== get_connector_properties: return (2191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updating existing volume attachment record: 447558fa-41ff-4780-afb6-19e285a28e7a {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:21:48 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Successfully created port: 9405c97c-5de6-43e5-b9f1-b8cff3272472 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:21:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:21:49 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Successfully created port: 8c2ad90b-3b97-42d3-ab37-bcc1e83feb03 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:21:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Successfully updated port: 73dd97ef-6247-4cbb-bfe3-834c7abd5361 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:21:50 user nova-compute[72820]: DEBUG nova.compute.manager [req-7e66bd7c-0824-421e-8a42-61805788fc41 req-d833c6a2-6b2c-47d9-b7ee-2590a95084c8 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-changed-73dd97ef-6247-4cbb-bfe3-834c7abd5361 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:21:50 user nova-compute[72820]: DEBUG nova.compute.manager [req-7e66bd7c-0824-421e-8a42-61805788fc41 req-d833c6a2-6b2c-47d9-b7ee-2590a95084c8 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Refreshing instance network info cache due to event network-changed-73dd97ef-6247-4cbb-bfe3-834c7abd5361. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:21:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7e66bd7c-0824-421e-8a42-61805788fc41 req-d833c6a2-6b2c-47d9-b7ee-2590a95084c8 service nova] Acquiring lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:21:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7e66bd7c-0824-421e-8a42-61805788fc41 req-d833c6a2-6b2c-47d9-b7ee-2590a95084c8 service nova] Acquired lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:21:50 user nova-compute[72820]: DEBUG nova.network.neutron [req-7e66bd7c-0824-421e-8a42-61805788fc41 req-d833c6a2-6b2c-47d9-b7ee-2590a95084c8 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Refreshing network info cache for port 73dd97ef-6247-4cbb-bfe3-834c7abd5361 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:21:50 user nova-compute[72820]: DEBUG nova.network.neutron [req-7e66bd7c-0824-421e-8a42-61805788fc41 req-d833c6a2-6b2c-47d9-b7ee-2590a95084c8 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:21:50 user nova-compute[72820]: DEBUG nova.network.neutron [req-7e66bd7c-0824-421e-8a42-61805788fc41 req-d833c6a2-6b2c-47d9-b7ee-2590a95084c8 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:21:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7e66bd7c-0824-421e-8a42-61805788fc41 req-d833c6a2-6b2c-47d9-b7ee-2590a95084c8 service nova] Releasing lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:21:51 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Successfully updated port: 23374c0c-55bc-488f-89ec-741193010838 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:21:51 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Successfully updated port: d5633b66-cc90-48c4-becc-c7e78219cb29 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:21:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-9b733b72-84da-4f5b-8046-9c47365da9ec req-930b56de-1b28-4341-9df1-1e5d29704f39 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-changed-23374c0c-55bc-488f-89ec-741193010838 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:21:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-9b733b72-84da-4f5b-8046-9c47365da9ec req-930b56de-1b28-4341-9df1-1e5d29704f39 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Refreshing instance network info cache due to event network-changed-23374c0c-55bc-488f-89ec-741193010838. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:21:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9b733b72-84da-4f5b-8046-9c47365da9ec req-930b56de-1b28-4341-9df1-1e5d29704f39 service nova] Acquiring lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:21:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9b733b72-84da-4f5b-8046-9c47365da9ec req-930b56de-1b28-4341-9df1-1e5d29704f39 service nova] Acquired lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:21:52 user nova-compute[72820]: DEBUG nova.network.neutron [req-9b733b72-84da-4f5b-8046-9c47365da9ec req-930b56de-1b28-4341-9df1-1e5d29704f39 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Refreshing network info cache for port 23374c0c-55bc-488f-89ec-741193010838 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:21:52 user nova-compute[72820]: DEBUG nova.network.neutron [req-9b733b72-84da-4f5b-8046-9c47365da9ec req-930b56de-1b28-4341-9df1-1e5d29704f39 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:21:52 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Successfully updated port: d213a9b4-5eaf-476b-9577-d9583e26a6b0 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:21:52 user nova-compute[72820]: DEBUG nova.network.neutron [req-9b733b72-84da-4f5b-8046-9c47365da9ec req-930b56de-1b28-4341-9df1-1e5d29704f39 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:21:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9b733b72-84da-4f5b-8046-9c47365da9ec req-930b56de-1b28-4341-9df1-1e5d29704f39 service nova] Releasing lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:21:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-9b733b72-84da-4f5b-8046-9c47365da9ec req-930b56de-1b28-4341-9df1-1e5d29704f39 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-changed-d5633b66-cc90-48c4-becc-c7e78219cb29 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:21:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-9b733b72-84da-4f5b-8046-9c47365da9ec req-930b56de-1b28-4341-9df1-1e5d29704f39 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Refreshing instance network info cache due to event network-changed-d5633b66-cc90-48c4-becc-c7e78219cb29. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:21:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9b733b72-84da-4f5b-8046-9c47365da9ec req-930b56de-1b28-4341-9df1-1e5d29704f39 service nova] Acquiring lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:21:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9b733b72-84da-4f5b-8046-9c47365da9ec req-930b56de-1b28-4341-9df1-1e5d29704f39 service nova] Acquired lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:21:52 user nova-compute[72820]: DEBUG nova.network.neutron [req-9b733b72-84da-4f5b-8046-9c47365da9ec req-930b56de-1b28-4341-9df1-1e5d29704f39 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Refreshing network info cache for port d5633b66-cc90-48c4-becc-c7e78219cb29 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:21:52 user nova-compute[72820]: DEBUG nova.network.neutron [req-9b733b72-84da-4f5b-8046-9c47365da9ec req-930b56de-1b28-4341-9df1-1e5d29704f39 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:21:53 user nova-compute[72820]: DEBUG nova.network.neutron [req-9b733b72-84da-4f5b-8046-9c47365da9ec req-930b56de-1b28-4341-9df1-1e5d29704f39 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:21:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9b733b72-84da-4f5b-8046-9c47365da9ec req-930b56de-1b28-4341-9df1-1e5d29704f39 service nova] Releasing lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:21:53 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Successfully updated port: 6a8419c8-b3eb-40ec-8f50-2eebcf714f9f {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-99f8a4d6-8fe1-4a63-a4c5-d7bd25221c43 req-33f53efa-9813-4e3d-83f9-e895360047db service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-changed-d213a9b4-5eaf-476b-9577-d9583e26a6b0 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-99f8a4d6-8fe1-4a63-a4c5-d7bd25221c43 req-33f53efa-9813-4e3d-83f9-e895360047db service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Refreshing instance network info cache due to event network-changed-d213a9b4-5eaf-476b-9577-d9583e26a6b0. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-99f8a4d6-8fe1-4a63-a4c5-d7bd25221c43 req-33f53efa-9813-4e3d-83f9-e895360047db service nova] Acquiring lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-99f8a4d6-8fe1-4a63-a4c5-d7bd25221c43 req-33f53efa-9813-4e3d-83f9-e895360047db service nova] Acquired lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG nova.network.neutron [req-99f8a4d6-8fe1-4a63-a4c5-d7bd25221c43 req-33f53efa-9813-4e3d-83f9-e895360047db service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Refreshing network info cache for port d213a9b4-5eaf-476b-9577-d9583e26a6b0 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG nova.network.neutron [req-99f8a4d6-8fe1-4a63-a4c5-d7bd25221c43 req-33f53efa-9813-4e3d-83f9-e895360047db service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Successfully updated port: 9405c97c-5de6-43e5-b9f1-b8cff3272472 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG nova.network.neutron [req-99f8a4d6-8fe1-4a63-a4c5-d7bd25221c43 req-33f53efa-9813-4e3d-83f9-e895360047db service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-99f8a4d6-8fe1-4a63-a4c5-d7bd25221c43 req-33f53efa-9813-4e3d-83f9-e895360047db service nova] Releasing lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-99f8a4d6-8fe1-4a63-a4c5-d7bd25221c43 req-33f53efa-9813-4e3d-83f9-e895360047db service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-changed-6a8419c8-b3eb-40ec-8f50-2eebcf714f9f {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-99f8a4d6-8fe1-4a63-a4c5-d7bd25221c43 req-33f53efa-9813-4e3d-83f9-e895360047db service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Refreshing instance network info cache due to event network-changed-6a8419c8-b3eb-40ec-8f50-2eebcf714f9f. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-99f8a4d6-8fe1-4a63-a4c5-d7bd25221c43 req-33f53efa-9813-4e3d-83f9-e895360047db service nova] Acquiring lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-99f8a4d6-8fe1-4a63-a4c5-d7bd25221c43 req-33f53efa-9813-4e3d-83f9-e895360047db service nova] Acquired lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:21:54 user nova-compute[72820]: DEBUG nova.network.neutron [req-99f8a4d6-8fe1-4a63-a4c5-d7bd25221c43 req-33f53efa-9813-4e3d-83f9-e895360047db service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Refreshing network info cache for port 6a8419c8-b3eb-40ec-8f50-2eebcf714f9f {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:21:55 user nova-compute[72820]: DEBUG nova.network.neutron [req-99f8a4d6-8fe1-4a63-a4c5-d7bd25221c43 req-33f53efa-9813-4e3d-83f9-e895360047db service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:21:55 user nova-compute[72820]: DEBUG nova.network.neutron [req-99f8a4d6-8fe1-4a63-a4c5-d7bd25221c43 req-33f53efa-9813-4e3d-83f9-e895360047db service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:21:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-99f8a4d6-8fe1-4a63-a4c5-d7bd25221c43 req-33f53efa-9813-4e3d-83f9-e895360047db service nova] Releasing lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:21:55 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Successfully updated port: 8c2ad90b-3b97-42d3-ab37-bcc1e83feb03 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:21:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Acquiring lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:21:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Acquired lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:21:55 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:21:55 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:21:56 user nova-compute[72820]: DEBUG nova.compute.manager [req-4f648017-86d5-47b7-858c-24433471832a req-010cd2b9-2ead-4207-96e8-50330bb16085 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-changed-9405c97c-5de6-43e5-b9f1-b8cff3272472 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:21:56 user nova-compute[72820]: DEBUG nova.compute.manager [req-4f648017-86d5-47b7-858c-24433471832a req-010cd2b9-2ead-4207-96e8-50330bb16085 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Refreshing instance network info cache due to event network-changed-9405c97c-5de6-43e5-b9f1-b8cff3272472. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:21:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4f648017-86d5-47b7-858c-24433471832a req-010cd2b9-2ead-4207-96e8-50330bb16085 service nova] Acquiring lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:21:58 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updating instance_info_cache with network_info: [{"id": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "address": "fa:16:3e:1e:15:71", "network": {"id": "e238ffcb-d9ec-4d89-830a-0347bcade186", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1932493438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dd97ef-62", "ovs_interfaceid": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23374c0c-55bc-488f-89ec-741193010838", "address": "fa:16:3e:f3:3d:f2", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23374c0c-55", "ovs_interfaceid": "23374c0c-55bc-488f-89ec-741193010838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5633b66-cc90-48c4-becc-c7e78219cb29", "address": "fa:16:3e:c2:bf:70", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5633b66-cc", "ovs_interfaceid": "d5633b66-cc90-48c4-becc-c7e78219cb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "address": "fa:16:3e:33:0f:06", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd213a9b4-5e", "ovs_interfaceid": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "address": "fa:16:3e:70:8d:6d", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8419c8-b3", "ovs_interfaceid": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "address": "fa:16:3e:33:d5:c4", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9405c97c-5d", "ovs_interfaceid": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "address": "fa:16:3e:73:59:e0", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2ad90b-3b", "ovs_interfaceid": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:21:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Releasing lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:21:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Instance network_info: |[{"id": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "address": "fa:16:3e:1e:15:71", "network": {"id": "e238ffcb-d9ec-4d89-830a-0347bcade186", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1932493438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dd97ef-62", "ovs_interfaceid": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23374c0c-55bc-488f-89ec-741193010838", "address": "fa:16:3e:f3:3d:f2", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23374c0c-55", "ovs_interfaceid": "23374c0c-55bc-488f-89ec-741193010838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5633b66-cc90-48c4-becc-c7e78219cb29", "address": "fa:16:3e:c2:bf:70", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5633b66-cc", "ovs_interfaceid": "d5633b66-cc90-48c4-becc-c7e78219cb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "address": "fa:16:3e:33:0f:06", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd213a9b4-5e", "ovs_interfaceid": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "address": "fa:16:3e:70:8d:6d", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8419c8-b3", "ovs_interfaceid": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "address": "fa:16:3e:33:d5:c4", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9405c97c-5d", "ovs_interfaceid": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "address": "fa:16:3e:73:59:e0", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2ad90b-3b", "ovs_interfaceid": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:21:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4f648017-86d5-47b7-858c-24433471832a req-010cd2b9-2ead-4207-96e8-50330bb16085 service nova] Acquired lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:21:58 user nova-compute[72820]: DEBUG nova.network.neutron [req-4f648017-86d5-47b7-858c-24433471832a req-010cd2b9-2ead-4207-96e8-50330bb16085 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Refreshing network info cache for port 9405c97c-5de6-43e5-b9f1-b8cff3272472 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:21:58 user nova-compute[72820]: DEBUG nova.network.neutron [req-4f648017-86d5-47b7-858c-24433471832a req-010cd2b9-2ead-4207-96e8-50330bb16085 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updated VIF entry in instance network info cache for port 9405c97c-5de6-43e5-b9f1-b8cff3272472. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:21:58 user nova-compute[72820]: DEBUG nova.network.neutron [req-4f648017-86d5-47b7-858c-24433471832a req-010cd2b9-2ead-4207-96e8-50330bb16085 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updating instance_info_cache with network_info: [{"id": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "address": "fa:16:3e:1e:15:71", "network": {"id": "e238ffcb-d9ec-4d89-830a-0347bcade186", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1932493438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dd97ef-62", "ovs_interfaceid": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23374c0c-55bc-488f-89ec-741193010838", "address": "fa:16:3e:f3:3d:f2", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23374c0c-55", "ovs_interfaceid": "23374c0c-55bc-488f-89ec-741193010838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5633b66-cc90-48c4-becc-c7e78219cb29", "address": "fa:16:3e:c2:bf:70", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5633b66-cc", "ovs_interfaceid": "d5633b66-cc90-48c4-becc-c7e78219cb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "address": "fa:16:3e:33:0f:06", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd213a9b4-5e", "ovs_interfaceid": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "address": "fa:16:3e:70:8d:6d", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8419c8-b3", "ovs_interfaceid": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "address": "fa:16:3e:33:d5:c4", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9405c97c-5d", "ovs_interfaceid": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "address": "fa:16:3e:73:59:e0", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2ad90b-3b", "ovs_interfaceid": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:21:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4f648017-86d5-47b7-858c-24433471832a req-010cd2b9-2ead-4207-96e8-50330bb16085 service nova] Releasing lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:21:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-4f648017-86d5-47b7-858c-24433471832a req-010cd2b9-2ead-4207-96e8-50330bb16085 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-changed-8c2ad90b-3b97-42d3-ab37-bcc1e83feb03 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:21:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-4f648017-86d5-47b7-858c-24433471832a req-010cd2b9-2ead-4207-96e8-50330bb16085 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Refreshing instance network info cache due to event network-changed-8c2ad90b-3b97-42d3-ab37-bcc1e83feb03. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:21:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4f648017-86d5-47b7-858c-24433471832a req-010cd2b9-2ead-4207-96e8-50330bb16085 service nova] Acquiring lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:21:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4f648017-86d5-47b7-858c-24433471832a req-010cd2b9-2ead-4207-96e8-50330bb16085 service nova] Acquired lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:21:58 user nova-compute[72820]: DEBUG nova.network.neutron [req-4f648017-86d5-47b7-858c-24433471832a req-010cd2b9-2ead-4207-96e8-50330bb16085 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Refreshing network info cache for port 8c2ad90b-3b97-42d3-ab37-bcc1e83feb03 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:21:59 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:21:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:21:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:21:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:21:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:21:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:21:59 user nova-compute[72820]: DEBUG nova.network.neutron [req-4f648017-86d5-47b7-858c-24433471832a req-010cd2b9-2ead-4207-96e8-50330bb16085 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updated VIF entry in instance network info cache for port 8c2ad90b-3b97-42d3-ab37-bcc1e83feb03. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:21:59 user nova-compute[72820]: DEBUG nova.network.neutron [req-4f648017-86d5-47b7-858c-24433471832a req-010cd2b9-2ead-4207-96e8-50330bb16085 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updating instance_info_cache with network_info: [{"id": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "address": "fa:16:3e:1e:15:71", "network": {"id": "e238ffcb-d9ec-4d89-830a-0347bcade186", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1932493438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dd97ef-62", "ovs_interfaceid": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23374c0c-55bc-488f-89ec-741193010838", "address": "fa:16:3e:f3:3d:f2", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23374c0c-55", "ovs_interfaceid": "23374c0c-55bc-488f-89ec-741193010838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5633b66-cc90-48c4-becc-c7e78219cb29", "address": "fa:16:3e:c2:bf:70", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5633b66-cc", "ovs_interfaceid": "d5633b66-cc90-48c4-becc-c7e78219cb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "address": "fa:16:3e:33:0f:06", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd213a9b4-5e", "ovs_interfaceid": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "address": "fa:16:3e:70:8d:6d", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8419c8-b3", "ovs_interfaceid": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "address": "fa:16:3e:33:d5:c4", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9405c97c-5d", "ovs_interfaceid": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "address": "fa:16:3e:73:59:e0", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2ad90b-3b", "ovs_interfaceid": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:21:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4f648017-86d5-47b7-858c-24433471832a req-010cd2b9-2ead-4207-96e8-50330bb16085 service nova] Releasing lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:22:00 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Acquiring lock "703a5060-dd34-4fff-9dec-6924ad018713" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "703a5060-dd34-4fff-9dec-6924ad018713" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG nova.objects.instance [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lazy-loading 'flavor' on Instance uuid 703a5060-dd34-4fff-9dec-6924ad018713 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "703a5060-dd34-4fff-9dec-6924ad018713" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:01 user nova-compute[72820]: INFO nova.virt.block_device [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Booting with volume 36f67fa6-d4bc-404b-bd73-6c4f14bff633 at /dev/vdb
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG os_brick.utils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e621b8-ba60-4269-b7c9-bd9ea6ad7dec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba1bd3f-0ae9-4ad5-8eac-a90647a55e5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c060108-de4d-4c2a-91c6-f3d2814ba495]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e49bfe-fb02-4381-aa8b-36258d16ca4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:22:01 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d32113-b60e-4d93-8885-67afba3a519e]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG os_brick.utils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updating existing volume attachment record: 1d2c9275-45b9-4e93-8836-52668b888dfa {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Acquiring lock "703a5060-dd34-4fff-9dec-6924ad018713" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "703a5060-dd34-4fff-9dec-6924ad018713" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:01 user nova-compute[72820]: INFO nova.compute.manager [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Attaching volume 839365f7-b328-45bd-95ac-e5fe53fee68d to /dev/vdb
Aug 27 02:22:01 user nova-compute[72820]: DEBUG os_brick.utils [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d510e372-88f7-43dd-a1d1-890dac7d6abe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[788dd299-4ac7-4cdf-a291-26ef5b6ddd92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8335f3-71be-4158-80a3-bccf985fc32a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b2e6d4-2161-43ee-b6ff-6cfd06ee8bb0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:22:01 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a542d65b-764c-48a6-9c91-037123fab92b]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG os_brick.utils [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Updating existing volume attachment record: 4708c92d-69f7-4a5a-ba6f-3a2dc0d5c573 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:02 user nova-compute[72820]: INFO nova.compute.manager [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Rescuing
Aug 27 02:22:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "refresh_cache-f8f612f3-41c9-4dae-8d49-218d61720b15" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:22:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquired lock "refresh_cache-f8f612f3-41c9-4dae-8d49-218d61720b15" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:22:02 user nova-compute[72820]: DEBUG nova.network.neutron [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:22:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:02 user nova-compute[72820]: DEBUG nova.network.neutron [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Updating instance_info_cache with network_info: [{"id": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "address": "fa:16:3e:64:42:e4", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c62328f-29", "ovs_interfaceid": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Releasing lock "refresh_cache-f8f612f3-41c9-4dae-8d49-218d61720b15" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:03 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Instance destroyed successfully.
Aug 27 02:22:03 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Attempting rescue
Aug 27 02:22:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72820) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Instance directory exists: not creating {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 02:22:03 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Creating image(s)
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "/opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "/opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG nova.objects.instance [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'trusted_certs' on Instance uuid f8f612f3-41c9-4dae-8d49-218d61720b15 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG nova.compute.manager [req-0e4726d3-651a-42d3-82ef-a027b7730737 req-e4a86aeb-3fcb-4cd9-851a-754738986e9c service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Received event network-vif-unplugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0e4726d3-651a-42d3-82ef-a027b7730737 req-e4a86aeb-3fcb-4cd9-851a-754738986e9c service nova] Acquiring lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0e4726d3-651a-42d3-82ef-a027b7730737 req-e4a86aeb-3fcb-4cd9-851a-754738986e9c service nova] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0e4726d3-651a-42d3-82ef-a027b7730737 req-e4a86aeb-3fcb-4cd9-851a-754738986e9c service nova] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG nova.compute.manager [req-0e4726d3-651a-42d3-82ef-a027b7730737 req-e4a86aeb-3fcb-4cd9-851a-754738986e9c service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] No waiting events found dispatching network-vif-unplugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:03 user nova-compute[72820]: WARNING nova.compute.manager [req-0e4726d3-651a-42d3-82ef-a027b7730737 req-e4a86aeb-3fcb-4cd9-851a-754738986e9c service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Received unexpected event network-vif-unplugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 for instance with vm_state active and task_state rescuing.
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.247s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue" returned: 0 in 0.050s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.objects.instance [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'migration_context' on Instance uuid f8f612f3-41c9-4dae-8d49-218d61720b15 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.objects.base [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Object Instance<f8f612f3-41c9-4dae-8d49-218d61720b15> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Start _get_guest_xml network_info=[{"id": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "address": "fa:16:3e:64:42:e4", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "vif_mac": "fa:16:3e:64:42:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c62328f-29", "ovs_interfaceid": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.objects.instance [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'resources' on Instance uuid f8f612f3-41c9-4dae-8d49-218d61720b15 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.objects.base [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Object Instance<f8f612f3-41c9-4dae-8d49-218d61720b15> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.objects.instance [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'numa_topology' on Instance uuid f8f612f3-41c9-4dae-8d49-218d61720b15 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.objects.base [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Object Instance<f8f612f3-41c9-4dae-8d49-218d61720b15> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:22:04 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:22:04 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.objects.instance [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'vcpu_model' on Instance uuid f8f612f3-41c9-4dae-8d49-218d61720b15 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.objects.base [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Object Instance<f8f612f3-41c9-4dae-8d49-218d61720b15> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-402850353',display_name='tempest-ServerRescueNegativeTestJSON-server-402850353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-402850353',id=3,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:20:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca683dd78dbf41ec8fbe3d3f76011272',ramdisk_id='',reservation_id='r-g4u7ta58',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1600105144',owner_user_name='tempest-ServerRescueNegativeTestJSON-1600105144-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:20:25Z,user_data=None,user_id='a7f59dea3a6f4315828320a9ae6c721d',uuid=f8f612f3-41c9-4dae-8d49-218d61720b15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "address": "fa:16:3e:64:42:e4", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "vif_mac": "fa:16:3e:64:42:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c62328f-29", "ovs_interfaceid": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converting VIF {"id": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "address": "fa:16:3e:64:42:e4", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "vif_mac": "fa:16:3e:64:42:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c62328f-29", "ovs_interfaceid": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:42:e4,bridge_name='br-int',has_traffic_filtering=True,id=7c62328f-29e6-4fbb-88c7-31c0851c5fe4,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c62328f-29') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.objects.instance [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'pci_devices' on Instance uuid f8f612f3-41c9-4dae-8d49-218d61720b15 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.objects.base [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Object Instance<f8f612f3-41c9-4dae-8d49-218d61720b15> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:22:04 user nova-compute[72820]:   <uuid>f8f612f3-41c9-4dae-8d49-218d61720b15</uuid>
Aug 27 02:22:04 user nova-compute[72820]:   <name>instance-00000003</name>
Aug 27 02:22:04 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:22:04 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:22:04 user nova-compute[72820]:   <metadata>
Aug 27 02:22:04 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:22:04 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:22:04 user nova-compute[72820]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-402850353</nova:name>
Aug 27 02:22:04 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:22:04</nova:creationTime>
Aug 27 02:22:04 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:22:04 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:22:04 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:22:04 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:22:04 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:22:04 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:22:04 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:22:04 user nova-compute[72820]:       <nova:owner>
Aug 27 02:22:04 user nova-compute[72820]:         <nova:user uuid="a7f59dea3a6f4315828320a9ae6c721d">tempest-ServerRescueNegativeTestJSON-1600105144-project-member</nova:user>
Aug 27 02:22:04 user nova-compute[72820]:         <nova:project uuid="ca683dd78dbf41ec8fbe3d3f76011272">tempest-ServerRescueNegativeTestJSON-1600105144</nova:project>
Aug 27 02:22:04 user nova-compute[72820]:       </nova:owner>
Aug 27 02:22:04 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:22:04 user nova-compute[72820]:       <nova:ports>
Aug 27 02:22:04 user nova-compute[72820]:         <nova:port uuid="7c62328f-29e6-4fbb-88c7-31c0851c5fe4">
Aug 27 02:22:04 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 02:22:04 user nova-compute[72820]:         </nova:port>
Aug 27 02:22:04 user nova-compute[72820]:       </nova:ports>
Aug 27 02:22:04 user nova-compute[72820]:     </nova:instance>
Aug 27 02:22:04 user nova-compute[72820]:   </metadata>
Aug 27 02:22:04 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:22:04 user nova-compute[72820]:     <system>
Aug 27 02:22:04 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:22:04 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:22:04 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:22:04 user nova-compute[72820]:       <entry name="serial">f8f612f3-41c9-4dae-8d49-218d61720b15</entry>
Aug 27 02:22:04 user nova-compute[72820]:       <entry name="uuid">f8f612f3-41c9-4dae-8d49-218d61720b15</entry>
Aug 27 02:22:04 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:22:04 user nova-compute[72820]:     </system>
Aug 27 02:22:04 user nova-compute[72820]:   </sysinfo>
Aug 27 02:22:04 user nova-compute[72820]:   <os>
Aug 27 02:22:04 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:22:04 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:22:04 user nova-compute[72820]:   </os>
Aug 27 02:22:04 user nova-compute[72820]:   <features>
Aug 27 02:22:04 user nova-compute[72820]:     <acpi/>
Aug 27 02:22:04 user nova-compute[72820]:     <apic/>
Aug 27 02:22:04 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:22:04 user nova-compute[72820]:   </features>
Aug 27 02:22:04 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:22:04 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:22:04 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:22:04 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:22:04 user nova-compute[72820]:   </clock>
Aug 27 02:22:04 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:22:04 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:22:04 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:22:04 user nova-compute[72820]:   </cpu>
Aug 27 02:22:04 user nova-compute[72820]:   <devices>
Aug 27 02:22:04 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:22:04 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:22:04 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue"/>
Aug 27 02:22:04 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:22:04 user nova-compute[72820]:     </disk>
Aug 27 02:22:04 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:22:04 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:22:04 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk"/>
Aug 27 02:22:04 user nova-compute[72820]:       <target dev="vdb" bus="virtio"/>
Aug 27 02:22:04 user nova-compute[72820]:     </disk>
Aug 27 02:22:04 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:22:04 user nova-compute[72820]:       <mac address="fa:16:3e:64:42:e4"/>
Aug 27 02:22:04 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:22:04 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:22:04 user nova-compute[72820]:       <target dev="tap7c62328f-29"/>
Aug 27 02:22:04 user nova-compute[72820]:     </interface>
Aug 27 02:22:04 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:22:04 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/console.log" append="off"/>
Aug 27 02:22:04 user nova-compute[72820]:     </serial>
Aug 27 02:22:04 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:22:04 user nova-compute[72820]:     <video>
Aug 27 02:22:04 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:22:04 user nova-compute[72820]:     </video>
Aug 27 02:22:04 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:22:04 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:22:04 user nova-compute[72820]:     </rng>
Aug 27 02:22:04 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:22:04 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:22:04 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:22:04 user nova-compute[72820]:     </memballoon>
Aug 27 02:22:04 user nova-compute[72820]:   </devices>
Aug 27 02:22:04 user nova-compute[72820]: </domain>
Aug 27 02:22:04 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:22:04 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Instance destroyed successfully.
Aug 27 02:22:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] No VIF found with MAC fa:16:3e:64:42:e4, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-56a039ab-18a0-42af-bb94-4e2846374038 req-cf375609-4e0a-40c5-9086-03555936e8d6 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Received event network-vif-plugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-56a039ab-18a0-42af-bb94-4e2846374038 req-cf375609-4e0a-40c5-9086-03555936e8d6 service nova] Acquiring lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-56a039ab-18a0-42af-bb94-4e2846374038 req-cf375609-4e0a-40c5-9086-03555936e8d6 service nova] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-56a039ab-18a0-42af-bb94-4e2846374038 req-cf375609-4e0a-40c5-9086-03555936e8d6 service nova] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-56a039ab-18a0-42af-bb94-4e2846374038 req-cf375609-4e0a-40c5-9086-03555936e8d6 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] No waiting events found dispatching network-vif-plugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:06 user nova-compute[72820]: WARNING nova.compute.manager [req-56a039ab-18a0-42af-bb94-4e2846374038 req-cf375609-4e0a-40c5-9086-03555936e8d6 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Received unexpected event network-vif-plugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 for instance with vm_state active and task_state rescuing.
Aug 27 02:22:06 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:22:06 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:22:06 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7050MB free_disk=25.53561019897461GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 703a5060-dd34-4fff-9dec-6924ad018713 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 26581695-c4b9-40b8-ab7a-34c99db0dadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f8f612f3-41c9-4dae-8d49-218d61720b15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6ed3c12e-96a8-4a32-8089-f04eba608663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 8ae21d01-4c7c-4926-9868-cf8786e59d4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1246d21d-b797-4c76-b282-83e17e6bf06a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance abe48a87-2a54-468d-98e5-afae2577e541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 0d99438e-e6d1-4fc3-a399-7e844c8f9538 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance c0644b77-33ce-46e4-a6cb-b6322bdc6a9e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:22:06 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:22:07 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:22:07 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:22:07 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:22:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.733s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-3dd8d96b-f01e-46d2-bdad-fb4f5ad15626 req-55c985a0-5d76-44b1-a9da-80fcddc5a29d service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-changed-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-3dd8d96b-f01e-46d2-bdad-fb4f5ad15626 req-55c985a0-5d76-44b1-a9da-80fcddc5a29d service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Refreshing instance network info cache due to event network-changed-dc035bdf-5877-42fe-b1e2-fa882373f836. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:22:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3dd8d96b-f01e-46d2-bdad-fb4f5ad15626 req-55c985a0-5d76-44b1-a9da-80fcddc5a29d service nova] Acquiring lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:22:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3dd8d96b-f01e-46d2-bdad-fb4f5ad15626 req-55c985a0-5d76-44b1-a9da-80fcddc5a29d service nova] Acquired lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:22:07 user nova-compute[72820]: DEBUG nova.network.neutron [req-3dd8d96b-f01e-46d2-bdad-fb4f5ad15626 req-55c985a0-5d76-44b1-a9da-80fcddc5a29d service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Refreshing network info cache for port dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:22:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-95575bfd-ff02-47d5-a907-0534fb1ae6b0 req-89bf8d44-2beb-4b29-a84d-f1d3874a4113 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Received event network-vif-plugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-95575bfd-ff02-47d5-a907-0534fb1ae6b0 req-89bf8d44-2beb-4b29-a84d-f1d3874a4113 service nova] Acquiring lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-95575bfd-ff02-47d5-a907-0534fb1ae6b0 req-89bf8d44-2beb-4b29-a84d-f1d3874a4113 service nova] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-95575bfd-ff02-47d5-a907-0534fb1ae6b0 req-89bf8d44-2beb-4b29-a84d-f1d3874a4113 service nova] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-95575bfd-ff02-47d5-a907-0534fb1ae6b0 req-89bf8d44-2beb-4b29-a84d-f1d3874a4113 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] No waiting events found dispatching network-vif-plugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:07 user nova-compute[72820]: WARNING nova.compute.manager [req-95575bfd-ff02-47d5-a907-0534fb1ae6b0 req-89bf8d44-2beb-4b29-a84d-f1d3874a4113 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Received unexpected event network-vif-plugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 for instance with vm_state active and task_state rescuing.
Aug 27 02:22:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-95575bfd-ff02-47d5-a907-0534fb1ae6b0 req-89bf8d44-2beb-4b29-a84d-f1d3874a4113 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Received event network-vif-plugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-95575bfd-ff02-47d5-a907-0534fb1ae6b0 req-89bf8d44-2beb-4b29-a84d-f1d3874a4113 service nova] Acquiring lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-95575bfd-ff02-47d5-a907-0534fb1ae6b0 req-89bf8d44-2beb-4b29-a84d-f1d3874a4113 service nova] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-95575bfd-ff02-47d5-a907-0534fb1ae6b0 req-89bf8d44-2beb-4b29-a84d-f1d3874a4113 service nova] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-95575bfd-ff02-47d5-a907-0534fb1ae6b0 req-89bf8d44-2beb-4b29-a84d-f1d3874a4113 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] No waiting events found dispatching network-vif-plugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:07 user nova-compute[72820]: WARNING nova.compute.manager [req-95575bfd-ff02-47d5-a907-0534fb1ae6b0 req-89bf8d44-2beb-4b29-a84d-f1d3874a4113 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Received unexpected event network-vif-plugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 for instance with vm_state active and task_state rescuing.
Aug 27 02:22:08 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:22:08 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:22:08 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:22:08 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:22:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:22:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:22:08 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:22:08 user nova-compute[72820]: DEBUG nova.network.neutron [req-3dd8d96b-f01e-46d2-bdad-fb4f5ad15626 req-55c985a0-5d76-44b1-a9da-80fcddc5a29d service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Updated VIF entry in instance network info cache for port dc035bdf-5877-42fe-b1e2-fa882373f836. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:22:08 user nova-compute[72820]: DEBUG nova.network.neutron [req-3dd8d96b-f01e-46d2-bdad-fb4f5ad15626 req-55c985a0-5d76-44b1-a9da-80fcddc5a29d service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Updating instance_info_cache with network_info: [{"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:22:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3dd8d96b-f01e-46d2-bdad-fb4f5ad15626 req-55c985a0-5d76-44b1-a9da-80fcddc5a29d service nova] Releasing lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:22:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Removed pending event for f8f612f3-41c9-4dae-8d49-218d61720b15 due to event {{(pid=72820) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 02:22:08 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102928.9172008, f8f612f3-41c9-4dae-8d49-218d61720b15 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:22:08 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] VM Resumed (Lifecycle Event)
Aug 27 02:22:08 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ae085128-79f8-4274-a646-508c55a90b73 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:22:08 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:22:08 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:22:08 user nova-compute[72820]: DEBUG nova.compute.manager [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:22:09 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 02:22:09 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102928.918131, f8f612f3-41c9-4dae-8d49-218d61720b15 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:22:09 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] VM Started (Lifecycle Event)
Aug 27 02:22:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:22:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:22:09 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 02:22:09 user nova-compute[72820]: INFO nova.compute.manager [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] instance snapshotting
Aug 27 02:22:09 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Beginning live snapshot process
Aug 27 02:22:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json -f qcow2 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:09 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Updating instance_info_cache with network_info: [{"id": "4a579280-0dce-49fb-861a-4577ba1d70a3", "address": "fa:16:3e:37:4e:12", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a579280-0d", "ovs_interfaceid": "4a579280-0dce-49fb-861a-4577ba1d70a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:22:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:22:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:22:09 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:22:09 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:22:09 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:22:09 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:22:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:22:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json -f qcow2" returned: 0 in 0.225s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json -f qcow2 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json -f qcow2" returned: 0 in 0.240s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.225s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzi76gp56/4bd87a5d615a4f05b7ea220c64d8ce5e.delta 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzi76gp56/4bd87a5d615a4f05b7ea220c64d8ce5e.delta 1073741824" returned: 0 in 0.135s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:10 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 02:22:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72820) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 27 02:22:10 user nova-compute[72820]: INFO nova.virt.libvirt.host [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] UEFI support detected
Aug 27 02:22:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-7cca171c-cf10-4045-b57a-c5ab9521b45a req-e3cbee01-6ee4-4fc1-9142-40e4035639d5 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Received event network-changed-a0280116-060c-4078-b415-7abd9005c221 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-7cca171c-cf10-4045-b57a-c5ab9521b45a req-e3cbee01-6ee4-4fc1-9142-40e4035639d5 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Refreshing instance network info cache due to event network-changed-a0280116-060c-4078-b415-7abd9005c221. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:22:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7cca171c-cf10-4045-b57a-c5ab9521b45a req-e3cbee01-6ee4-4fc1-9142-40e4035639d5 service nova] Acquiring lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:22:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7cca171c-cf10-4045-b57a-c5ab9521b45a req-e3cbee01-6ee4-4fc1-9142-40e4035639d5 service nova] Acquired lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:22:10 user nova-compute[72820]: DEBUG nova.network.neutron [req-7cca171c-cf10-4045-b57a-c5ab9521b45a req-e3cbee01-6ee4-4fc1-9142-40e4035639d5 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Refreshing network info cache for port a0280116-060c-4078-b415-7abd9005c221 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:22:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:22:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:22:11 user nova-compute[72820]: DEBUG nova.network.neutron [req-7cca171c-cf10-4045-b57a-c5ab9521b45a req-e3cbee01-6ee4-4fc1-9142-40e4035639d5 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Updated VIF entry in instance network info cache for port a0280116-060c-4078-b415-7abd9005c221. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:22:11 user nova-compute[72820]: DEBUG nova.network.neutron [req-7cca171c-cf10-4045-b57a-c5ab9521b45a req-e3cbee01-6ee4-4fc1-9142-40e4035639d5 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Updating instance_info_cache with network_info: [{"id": "a0280116-060c-4078-b415-7abd9005c221", "address": "fa:16:3e:dc:2f:1b", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0280116-06", "ovs_interfaceid": "a0280116-060c-4078-b415-7abd9005c221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:22:11 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 02:22:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7cca171c-cf10-4045-b57a-c5ab9521b45a req-e3cbee01-6ee4-4fc1-9142-40e4035639d5 service nova] Releasing lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:22:11 user nova-compute[72820]: DEBUG nova.privsep.utils [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 02:22:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzi76gp56/4bd87a5d615a4f05b7ea220c64d8ce5e.delta /opt/stack/data/nova/instances/snapshots/tmpzi76gp56/4bd87a5d615a4f05b7ea220c64d8ce5e {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzi76gp56/4bd87a5d615a4f05b7ea220c64d8ce5e.delta /opt/stack/data/nova/instances/snapshots/tmpzi76gp56/4bd87a5d615a4f05b7ea220c64d8ce5e" returned: 0 in 0.396s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:12 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Snapshot extracted, beginning image upload
Aug 27 02:22:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:15 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Snapshot image upload complete
Aug 27 02:22:15 user nova-compute[72820]: INFO nova.compute.manager [None req-25796c29-ed41-40a3-9ca0-658fc43048a8 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Took 6.41 seconds to snapshot the instance on the hypervisor.
Aug 27 02:22:16 user nova-compute[72820]: INFO nova.virt.block_device [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Booting with volume 58a485c5-4b50-4a42-93e1-cac518f86341 at /dev/vdc
Aug 27 02:22:16 user nova-compute[72820]: DEBUG os_brick.utils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2846b17-0646-4155-9e84-ba99173823da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[733ee83c-bd53-4b30-b297-5229fe01cb01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b337658-fcdc-4643-a13a-2c64cac44b15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdbf0f9-f091-4c04-9e72-d2c94bbf5045]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:22:16 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:22:16 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[676feef5-23dd-42ae-b3fa-2691e3540207]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG os_brick.utils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updating existing volume attachment record: 3949841b-6801-47f7-aff0-4d08d6865eee {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:22:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Acquiring lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:27 user nova-compute[72820]: DEBUG nova.compute.manager [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:22:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:22:27 user nova-compute[72820]: INFO nova.compute.claims [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Claim successful on node user
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:22:28 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Creating image(s)
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Did not create local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Ensure instance console log exists: /opt/stack/data/nova/instances/c0644b77-33ce-46e4-a6cb-b6322bdc6a9e/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Start _get_guest_xml network_info=[{"id": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "address": "fa:16:3e:1e:15:71", "network": {"id": "e238ffcb-d9ec-4d89-830a-0347bcade186", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1932493438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dd97ef-62", "ovs_interfaceid": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23374c0c-55bc-488f-89ec-741193010838", "address": "fa:16:3e:f3:3d:f2", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23374c0c-55", "ovs_interfaceid": "23374c0c-55bc-488f-89ec-741193010838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5633b66-cc90-48c4-becc-c7e78219cb29", "address": "fa:16:3e:c2:bf:70", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5633b66-cc", "ovs_interfaceid": "d5633b66-cc90-48c4-becc-c7e78219cb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "address": "fa:16:3e:33:0f:06", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd213a9b4-5e", "ovs_interfaceid": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "address": "fa:16:3e:70:8d:6d", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8419c8-b3", "ovs_interfaceid": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "address": "fa:16:3e:33:d5:c4", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9405c97c-5d", "ovs_interfaceid": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "address": "fa:16:3e:73:59:e0", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2ad90b-3b", "ovs_interfaceid": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '447558fa-41ff-4780-afb6-19e285a28e7a', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBRYCMQi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c0644b77-33ce-46e4-a6cb-b6322bdc6a9e', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0408d30-fda0-45f6-856a-de9a2a75572b', 'serial': 'e0408d30-fda0-45f6-856a-de9a2a75572b'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '1d2c9275-45b9-4e93-8836-52668b888dfa', 'mount_device': '/dev/vdb', 'boot_index': 1, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCgiXwAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c0644b77-33ce-46e4-a6cb-b6322bdc6a9e', 'attached_at': '', 'detached_at': '', 'volume_id': '36f67fa6-d4bc-404b-bd73-6c4f14bff633', 'serial': '36f67fa6-d4bc-404b-bd73-6c4f14bff633'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '3949841b-6801-47f7-aff0-4d08d6865eee', 'mount_device': '/dev/vdc', 'boot_index': 2, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyLPZnjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c0644b77-33ce-46e4-a6cb-b6322bdc6a9e', 'attached_at': '', 'detached_at': '', 'volume_id': '58a485c5-4b50-4a42-93e1-cac518f86341', 'serial': '58a485c5-4b50-4a42-93e1-cac518f86341'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:22:28 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:22:28 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connector [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Factory for ISCSI on None {{(pid=72820) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBRYCMQi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:22:28 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:22:28 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:22:28 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9af663-41e5-402c-9634-79efaa549801]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:22:28 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca7b2ca-d050-4a9d-9314-d86c31e37e5a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b] added
Aug 27 02:22:28 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6d815c-796e-44a1-b82e-7f3e74322f65]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[29604006-3d8d-44d4-963c-0fcd2b7a1eab]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pBRYCMQi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pBRYCMQi" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b0bd79-c259-4287-bbe7-e8c94c319f03]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pBRYCMQi'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.network.neutron [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c610536-3bd8-4703-aa75-8e302a92e1d7]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:28 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c01c7a-78f1-4f06-98a6-21e2567ea563]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 02:22:28 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 02:22:28 user nova-compute[72820]:  {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:22:28 user nova-compute[72820]: WARNING os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 02:22:28 user nova-compute[72820]: 
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b354ded-dfcd-47ca-a651-51178e402f0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b, portal: 172.16.0.220,3260]
Aug 27 02:22:28 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b, portal: 172.16.0.220,3260] successful.
Aug 27 02:22:28 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.policy [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a40eb2b2f734333991595552aea697d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c569ce2e5c548d891e3a20961f941c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e923e020-274d-4268-875d-0e2d440c8dbd]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85b4ffa-79aa-4f50-945c-0a9b5be278e6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:28 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:28 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:22:28 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Creating image(s)
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Acquiring lock "/opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Lock "/opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Lock "/opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d34e55-5a22-4a5c-8259-4f3ae8750088]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBRYCMQi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.193s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.181s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/disk 1073741824" returned: 0 in 0.051s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.174s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Checking if we can resize image /opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Cannot resize image /opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Ensure instance console log exists: /opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG nova.network.neutron [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Successfully created port: a4cb14fa-35f7-4063-a940-2eef65a83094 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23965663831646265', 'path': '/dev/sdb'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965663831646265', 'path': '/dev/sdb'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCgiXwAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:22:29 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:22:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:22:29 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:22:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:22:29 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32222ad-0e0e-4225-a15a-76655930ac81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:22:29 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6cf298-88ab-4ce4-ae25-9c395fcef6e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633] added
Aug 27 02:22:29 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd75a1c6-7704-44ea-b1ff-f534e0c7d827]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb74b171-e7fe-4541-a744-bada8924454d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oCgiXwAx {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oCgiXwAx" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecde8adf-88b9-480b-bd35-f4e51a8ba4ba]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oCgiXwAx'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0c34d8-fedf-42b5-b2c3-6b45cd683518]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb789269-e758-493c-b88b-a37735f15b71]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:29 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:29 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2626a3b6-a6dd-4081-8784-c8c09a4fc9a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633, portal: 172.16.0.220,3260]
Aug 27 02:22:29 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633, portal: 172.16.0.220,3260] successful.
Aug 27 02:22:29 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bc2604-413c-4532-a0ed-a4461a2fc6ae]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dba01e0-600b-4b32-ab42-685c2f81e687]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:30 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:30 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:30 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:30 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd27e35f-834b-4d52-9126-e236e9ef6251]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCgiXwAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'klNbhwnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:22:30 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:22:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.network.neutron [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Successfully updated port: a4cb14fa-35f7-4063-a940-2eef65a83094 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Acquiring lock "refresh_cache-717fb1d8-6d09-440b-bc50-7132a8ebe8d9" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Acquired lock "refresh_cache-717fb1d8-6d09-440b-bc50-7132a8ebe8d9" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.network.neutron [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-991b87fc-2d7d-4735-b56a-afa1497c0e34 req-c6668e9a-6a54-4430-bb09-05a5e45a72d4 service nova] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Received event network-changed-a4cb14fa-35f7-4063-a940-2eef65a83094 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-991b87fc-2d7d-4735-b56a-afa1497c0e34 req-c6668e9a-6a54-4430-bb09-05a5e45a72d4 service nova] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Refreshing instance network info cache due to event network-changed-a4cb14fa-35f7-4063-a940-2eef65a83094. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-991b87fc-2d7d-4735-b56a-afa1497c0e34 req-c6668e9a-6a54-4430-bb09-05a5e45a72d4 service nova] Acquiring lock "refresh_cache-717fb1d8-6d09-440b-bc50-7132a8ebe8d9" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.network.neutron [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.network.neutron [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Updating instance_info_cache with network_info: [{"id": "a4cb14fa-35f7-4063-a940-2eef65a83094", "address": "fa:16:3e:be:1c:c8", "network": {"id": "76fd0f4e-ddb4-41ec-b2d0-ac28d7174226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553554658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c569ce2e5c548d891e3a20961f941c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb14fa-35", "ovs_interfaceid": "a4cb14fa-35f7-4063-a940-2eef65a83094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Releasing lock "refresh_cache-717fb1d8-6d09-440b-bc50-7132a8ebe8d9" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.compute.manager [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Instance network_info: |[{"id": "a4cb14fa-35f7-4063-a940-2eef65a83094", "address": "fa:16:3e:be:1c:c8", "network": {"id": "76fd0f4e-ddb4-41ec-b2d0-ac28d7174226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553554658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c569ce2e5c548d891e3a20961f941c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb14fa-35", "ovs_interfaceid": "a4cb14fa-35f7-4063-a940-2eef65a83094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-991b87fc-2d7d-4735-b56a-afa1497c0e34 req-c6668e9a-6a54-4430-bb09-05a5e45a72d4 service nova] Acquired lock "refresh_cache-717fb1d8-6d09-440b-bc50-7132a8ebe8d9" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.network.neutron [req-991b87fc-2d7d-4735-b56a-afa1497c0e34 req-c6668e9a-6a54-4430-bb09-05a5e45a72d4 service nova] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Refreshing network info cache for port a4cb14fa-35f7-4063-a940-2eef65a83094 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Start _get_guest_xml network_info=[{"id": "a4cb14fa-35f7-4063-a940-2eef65a83094", "address": "fa:16:3e:be:1c:c8", "network": {"id": "76fd0f4e-ddb4-41ec-b2d0-ac28d7174226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553554658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c569ce2e5c548d891e3a20961f941c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb14fa-35", "ovs_interfaceid": "a4cb14fa-35f7-4063-a940-2eef65a83094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:22:30 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:22:30 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1137563261',display_name='tempest-VolumesActionsTest-instance-1137563261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1137563261',id=11,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c569ce2e5c548d891e3a20961f941c4',ramdisk_id='',reservation_id='r-34wfg8qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1929444069',owner_user_name='tempest-VolumesActionsTest-1929444069-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:22:29Z,user_data=None,user_id='1a40eb2b2f734333991595552aea697d',uuid=717fb1d8-6d09-440b-bc50-7132a8ebe8d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4cb14fa-35f7-4063-a940-2eef65a83094", "address": "fa:16:3e:be:1c:c8", "network": {"id": "76fd0f4e-ddb4-41ec-b2d0-ac28d7174226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553554658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c569ce2e5c548d891e3a20961f941c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb14fa-35", "ovs_interfaceid": "a4cb14fa-35f7-4063-a940-2eef65a83094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Converting VIF {"id": "a4cb14fa-35f7-4063-a940-2eef65a83094", "address": "fa:16:3e:be:1c:c8", "network": {"id": "76fd0f4e-ddb4-41ec-b2d0-ac28d7174226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553554658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c569ce2e5c548d891e3a20961f941c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb14fa-35", "ovs_interfaceid": "a4cb14fa-35f7-4063-a940-2eef65a83094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:c8,bridge_name='br-int',has_traffic_filtering=True,id=a4cb14fa-35f7-4063-a940-2eef65a83094,network=Network(76fd0f4e-ddb4-41ec-b2d0-ac28d7174226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb14fa-35') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.objects.instance [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Lazy-loading 'pci_devices' on Instance uuid 717fb1d8-6d09-440b-bc50-7132a8ebe8d9 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:22:30 user nova-compute[72820]:   <uuid>717fb1d8-6d09-440b-bc50-7132a8ebe8d9</uuid>
Aug 27 02:22:30 user nova-compute[72820]:   <name>instance-0000000b</name>
Aug 27 02:22:30 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:22:30 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:22:30 user nova-compute[72820]:   <metadata>
Aug 27 02:22:30 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:22:30 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:22:30 user nova-compute[72820]:       <nova:name>tempest-VolumesActionsTest-instance-1137563261</nova:name>
Aug 27 02:22:30 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:22:30</nova:creationTime>
Aug 27 02:22:30 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:22:30 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:22:30 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:22:30 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:22:30 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:22:30 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:22:30 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:22:30 user nova-compute[72820]:       <nova:owner>
Aug 27 02:22:30 user nova-compute[72820]:         <nova:user uuid="1a40eb2b2f734333991595552aea697d">tempest-VolumesActionsTest-1929444069-project-member</nova:user>
Aug 27 02:22:30 user nova-compute[72820]:         <nova:project uuid="3c569ce2e5c548d891e3a20961f941c4">tempest-VolumesActionsTest-1929444069</nova:project>
Aug 27 02:22:30 user nova-compute[72820]:       </nova:owner>
Aug 27 02:22:30 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:22:30 user nova-compute[72820]:       <nova:ports>
Aug 27 02:22:30 user nova-compute[72820]:         <nova:port uuid="a4cb14fa-35f7-4063-a940-2eef65a83094">
Aug 27 02:22:30 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 02:22:30 user nova-compute[72820]:         </nova:port>
Aug 27 02:22:30 user nova-compute[72820]:       </nova:ports>
Aug 27 02:22:30 user nova-compute[72820]:     </nova:instance>
Aug 27 02:22:30 user nova-compute[72820]:   </metadata>
Aug 27 02:22:30 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:22:30 user nova-compute[72820]:     <system>
Aug 27 02:22:30 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:22:30 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:22:30 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:22:30 user nova-compute[72820]:       <entry name="serial">717fb1d8-6d09-440b-bc50-7132a8ebe8d9</entry>
Aug 27 02:22:30 user nova-compute[72820]:       <entry name="uuid">717fb1d8-6d09-440b-bc50-7132a8ebe8d9</entry>
Aug 27 02:22:30 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:22:30 user nova-compute[72820]:     </system>
Aug 27 02:22:30 user nova-compute[72820]:   </sysinfo>
Aug 27 02:22:30 user nova-compute[72820]:   <os>
Aug 27 02:22:30 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:22:30 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:22:30 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:22:30 user nova-compute[72820]:   </os>
Aug 27 02:22:30 user nova-compute[72820]:   <features>
Aug 27 02:22:30 user nova-compute[72820]:     <acpi/>
Aug 27 02:22:30 user nova-compute[72820]:     <apic/>
Aug 27 02:22:30 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:22:30 user nova-compute[72820]:   </features>
Aug 27 02:22:30 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:22:30 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:22:30 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:22:30 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:22:30 user nova-compute[72820]:   </clock>
Aug 27 02:22:30 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:22:30 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:22:30 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:22:30 user nova-compute[72820]:   </cpu>
Aug 27 02:22:30 user nova-compute[72820]:   <devices>
Aug 27 02:22:30 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:22:30 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:22:30 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/disk"/>
Aug 27 02:22:30 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:22:30 user nova-compute[72820]:     </disk>
Aug 27 02:22:30 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:22:30 user nova-compute[72820]:       <mac address="fa:16:3e:be:1c:c8"/>
Aug 27 02:22:30 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:22:30 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:22:30 user nova-compute[72820]:       <target dev="tapa4cb14fa-35"/>
Aug 27 02:22:30 user nova-compute[72820]:     </interface>
Aug 27 02:22:30 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:22:30 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/console.log" append="off"/>
Aug 27 02:22:30 user nova-compute[72820]:     </serial>
Aug 27 02:22:30 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:22:30 user nova-compute[72820]:     <video>
Aug 27 02:22:30 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:22:30 user nova-compute[72820]:     </video>
Aug 27 02:22:30 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:22:30 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:22:30 user nova-compute[72820]:     </rng>
Aug 27 02:22:30 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:22:30 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:22:30 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:22:30 user nova-compute[72820]:     </memballoon>
Aug 27 02:22:30 user nova-compute[72820]:   </devices>
Aug 27 02:22:30 user nova-compute[72820]: </domain>
Aug 27 02:22:30 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1137563261',display_name='tempest-VolumesActionsTest-instance-1137563261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1137563261',id=11,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c569ce2e5c548d891e3a20961f941c4',ramdisk_id='',reservation_id='r-34wfg8qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1929444069',owner_user_name='tempest-VolumesActionsTest-1929444069-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:22:29Z,user_data=None,user_id='1a40eb2b2f734333991595552aea697d',uuid=717fb1d8-6d09-440b-bc50-7132a8ebe8d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4cb14fa-35f7-4063-a940-2eef65a83094", "address": "fa:16:3e:be:1c:c8", "network": {"id": "76fd0f4e-ddb4-41ec-b2d0-ac28d7174226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553554658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c569ce2e5c548d891e3a20961f941c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb14fa-35", "ovs_interfaceid": "a4cb14fa-35f7-4063-a940-2eef65a83094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Converting VIF {"id": "a4cb14fa-35f7-4063-a940-2eef65a83094", "address": "fa:16:3e:be:1c:c8", "network": {"id": "76fd0f4e-ddb4-41ec-b2d0-ac28d7174226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553554658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c569ce2e5c548d891e3a20961f941c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb14fa-35", "ovs_interfaceid": "a4cb14fa-35f7-4063-a940-2eef65a83094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:c8,bridge_name='br-int',has_traffic_filtering=True,id=a4cb14fa-35f7-4063-a940-2eef65a83094,network=Network(76fd0f4e-ddb4-41ec-b2d0-ac28d7174226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb14fa-35') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG os_vif [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:c8,bridge_name='br-int',has_traffic_filtering=True,id=a4cb14fa-35f7-4063-a940-2eef65a83094,network=Network(76fd0f4e-ddb4-41ec-b2d0-ac28d7174226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb14fa-35') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4cb14fa-35, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa4cb14fa-35, col_values=(('external_ids', {'iface-id': 'a4cb14fa-35f7-4063-a940-2eef65a83094', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:1c:c8', 'vm-uuid': '717fb1d8-6d09-440b-bc50-7132a8ebe8d9'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:30 user nova-compute[72820]: INFO os_vif [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:c8,bridge_name='br-int',has_traffic_filtering=True,id=a4cb14fa-35f7-4063-a940-2eef65a83094,network=Network(76fd0f4e-ddb4-41ec-b2d0-ac28d7174226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb14fa-35')
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:22:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] No VIF found with MAC fa:16:3e:be:1c:c8, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26137343731346663', 'path': '/dev/sdc'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137343731346663', 'path': '/dev/sdc'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.879s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:22:31 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:22:31 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:22:31 user nova-compute[72820]: DEBUG nova.network.neutron [req-991b87fc-2d7d-4735-b56a-afa1497c0e34 req-c6668e9a-6a54-4430-bb09-05a5e45a72d4 service nova] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Updated VIF entry in instance network info cache for port a4cb14fa-35f7-4063-a940-2eef65a83094. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG nova.network.neutron [req-991b87fc-2d7d-4735-b56a-afa1497c0e34 req-c6668e9a-6a54-4430-bb09-05a5e45a72d4 service nova] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Updating instance_info_cache with network_info: [{"id": "a4cb14fa-35f7-4063-a940-2eef65a83094", "address": "fa:16:3e:be:1c:c8", "network": {"id": "76fd0f4e-ddb4-41ec-b2d0-ac28d7174226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553554658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c569ce2e5c548d891e3a20961f941c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb14fa-35", "ovs_interfaceid": "a4cb14fa-35f7-4063-a940-2eef65a83094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-991b87fc-2d7d-4735-b56a-afa1497c0e34 req-c6668e9a-6a54-4430-bb09-05a5e45a72d4 service nova] Releasing lock "refresh_cache-717fb1d8-6d09-440b-bc50-7132a8ebe8d9" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e07620e-ac77-47f9-becc-158b92118c2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:22:31 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyLPZnjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:22:31 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[92eb81b5-a810-44e4-b404-e9026f1a5fa9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d] added
Aug 27 02:22:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc84bef-65d3-4aa2-b381-317c2f965ecd]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0e9e30-c0dc-4513-9a50-913820298f4f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v klNbhwnX {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v klNbhwnX" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ee7d17-b7a5-4e06-8e9e-a5f03b72f282]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'klNbhwnX'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f6b0cd-129f-4470-8d46-f0ec9f7683fd]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5190c8-041c-4d61-927e-76e908850ad1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:31 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:31 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e84344-c90a-40f6-912a-4d1e30c32929]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d, portal: 172.16.0.220,3260]
Aug 27 02:22:31 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d, portal: 172.16.0.220,3260] successful.
Aug 27 02:22:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a73e56-497d-47b7-b07e-0a8b62eb7bc7]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8c4cb3-123d-42a6-95b9-20091002368b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:31 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:31 user nova-compute[72820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d (non-flash)
Aug 27 02:22:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:31 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:31 user nova-compute[72820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d (non-flash)
Aug 27 02:22:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1add442f-94bd-4416-aaa6-c4dd9489a5d9]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'klNbhwnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-d8acca9c-3faf-426b-a1bc-ce8e72176137 req-a9683647-f2eb-43dd-b132-94d13f1b6681 service nova] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Received event network-vif-plugged-a4cb14fa-35f7-4063-a940-2eef65a83094 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d8acca9c-3faf-426b-a1bc-ce8e72176137 req-a9683647-f2eb-43dd-b132-94d13f1b6681 service nova] Acquiring lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d8acca9c-3faf-426b-a1bc-ce8e72176137 req-a9683647-f2eb-43dd-b132-94d13f1b6681 service nova] Lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d8acca9c-3faf-426b-a1bc-ce8e72176137 req-a9683647-f2eb-43dd-b132-94d13f1b6681 service nova] Lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-d8acca9c-3faf-426b-a1bc-ce8e72176137 req-a9683647-f2eb-43dd-b132-94d13f1b6681 service nova] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] No waiting events found dispatching network-vif-plugged-a4cb14fa-35f7-4063-a940-2eef65a83094 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:32 user nova-compute[72820]: WARNING nova.compute.manager [req-d8acca9c-3faf-426b-a1bc-ce8e72176137 req-a9683647-f2eb-43dd-b132-94d13f1b6681 service nova] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Received unexpected event network-vif-plugged-a4cb14fa-35f7-4063-a940-2eef65a83094 for instance with vm_state building and task_state spawning.
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] <== connect_volume: return (2198ms) {'type': 'block', 'scsi_wwn': '23237376438613863', 'path': '/dev/sdd'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237376438613863', 'path': '/dev/sdd'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.289s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:22:32 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:22:32 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG nova.objects.instance [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lazy-loading 'flavor' on Instance uuid 703a5060-dd34-4fff-9dec-6924ad018713 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9668a80-b204-4164-8749-e3ca59033ac2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:22:32 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[586a83a1-a7ec-4ee1-b3d7-fc50ef7473fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341] added
Aug 27 02:22:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.075s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[394ddb08-4452-4677-aced-4f2408290cba]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:22:32 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:22:32 user nova-compute[72820]:   <source dev="/dev/sdd"/>
Aug 27 02:22:32 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:22:32 user nova-compute[72820]:   <serial>839365f7-b328-45bd-95ac-e5fe53fee68d</serial>
Aug 27 02:22:32 user nova-compute[72820]: </disk>
Aug 27 02:22:32 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[42976a49-65bd-4e33-89b4-efee62355fe2]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OyLPZnjF {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OyLPZnjF" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2537ec56-488d-42cb-8d75-f3abae6daf24]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OyLPZnjF'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd98748-9865-4633-9a25-3b50c3e40d77]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04bcea1-057c-41e9-ad5b-d18ef87a1874]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:32 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:32 user nova-compute[72820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d (non-flash)
Aug 27 02:22:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:32 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:32 user nova-compute[72820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d (non-flash)
Aug 27 02:22:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcda07c-5a9b-4ec1-95a1-e320c0c812f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341, portal: 172.16.0.220,3260]
Aug 27 02:22:32 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341, portal: 172.16.0.220,3260] successful.
Aug 27 02:22:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e569d5d-c9af-45c8-b7cd-fde6431c05f1]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ede9c32-0637-47ad-8b02-f7d9f25427c7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:32 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:32 user nova-compute[72820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d (non-flash)
Aug 27 02:22:32 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:22:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:32 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:32 user nova-compute[72820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d (non-flash)
Aug 27 02:22:32 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:22:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ad0b75-6d5c-4ebb-aa85-2310b26e57ab]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyLPZnjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:22:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] No VIF found with MAC fa:16:3e:50:07:21, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-25afa7dd-1499-4413-adc9-89270e7b1e1b tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "703a5060-dd34-4fff-9dec-6924ad018713" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.561s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Acquiring lock "703a5060-dd34-4fff-9dec-6924ad018713" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "703a5060-dd34-4fff-9dec-6924ad018713" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Acquiring lock "703a5060-dd34-4fff-9dec-6924ad018713-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "703a5060-dd34-4fff-9dec-6924ad018713-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "703a5060-dd34-4fff-9dec-6924ad018713-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:33 user nova-compute[72820]: INFO nova.compute.manager [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Terminating instance
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] <== connect_volume: return (2696ms) {'type': 'block', 'scsi_wwn': '23062346639366163', 'path': '/dev/sde'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062346639366163', 'path': '/dev/sde'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "address": "fa:16:3e:1e:15:71", "network": {"id": "e238ffcb-d9ec-4d89-830a-0347bcade186", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1932493438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dd97ef-62", "ovs_interfaceid": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "address": "fa:16:3e:1e:15:71", "network": {"id": "e238ffcb-d9ec-4d89-830a-0347bcade186", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1932493438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dd97ef-62", "ovs_interfaceid": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:15:71,bridge_name='br-int',has_traffic_filtering=True,id=73dd97ef-6247-4cbb-bfe3-834c7abd5361,network=Network(e238ffcb-d9ec-4d89-830a-0347bcade186),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73dd97ef-62') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23374c0c-55bc-488f-89ec-741193010838", "address": "fa:16:3e:f3:3d:f2", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23374c0c-55", "ovs_interfaceid": "23374c0c-55bc-488f-89ec-741193010838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "23374c0c-55bc-488f-89ec-741193010838", "address": "fa:16:3e:f3:3d:f2", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23374c0c-55", "ovs_interfaceid": "23374c0c-55bc-488f-89ec-741193010838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:f2,bridge_name='br-int',has_traffic_filtering=True,id=23374c0c-55bc-488f-89ec-741193010838,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23374c0c-55') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5633b66-cc90-48c4-becc-c7e78219cb29", "address": "fa:16:3e:c2:bf:70", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5633b66-cc", "ovs_interfaceid": "d5633b66-cc90-48c4-becc-c7e78219cb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "d5633b66-cc90-48c4-becc-c7e78219cb29", "address": "fa:16:3e:c2:bf:70", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5633b66-cc", "ovs_interfaceid": "d5633b66-cc90-48c4-becc-c7e78219cb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:bf:70,bridge_name='br-int',has_traffic_filtering=True,id=d5633b66-cc90-48c4-becc-c7e78219cb29,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5633b66-cc') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "address": "fa:16:3e:33:0f:06", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd213a9b4-5e", "ovs_interfaceid": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "address": "fa:16:3e:33:0f:06", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd213a9b4-5e", "ovs_interfaceid": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:0f:06,bridge_name='br-int',has_traffic_filtering=True,id=d213a9b4-5eaf-476b-9577-d9583e26a6b0,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd213a9b4-5e') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "address": "fa:16:3e:70:8d:6d", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8419c8-b3", "ovs_interfaceid": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "address": "fa:16:3e:70:8d:6d", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8419c8-b3", "ovs_interfaceid": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:8d:6d,bridge_name='br-int',has_traffic_filtering=True,id=6a8419c8-b3eb-40ec-8f50-2eebcf714f9f,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a8419c8-b3') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "address": "fa:16:3e:33:d5:c4", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9405c97c-5d", "ovs_interfaceid": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "address": "fa:16:3e:33:d5:c4", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9405c97c-5d", "ovs_interfaceid": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:d5:c4,bridge_name='br-int',has_traffic_filtering=True,id=9405c97c-5de6-43e5-b9f1-b8cff3272472,network=Network(123788a2-cb47-4b56-bdeb-38a7ca6cc964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9405c97c-5d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "address": "fa:16:3e:73:59:e0", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2ad90b-3b", "ovs_interfaceid": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "address": "fa:16:3e:73:59:e0", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2ad90b-3b", "ovs_interfaceid": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:59:e0,bridge_name='br-int',has_traffic_filtering=True,id=8c2ad90b-3b97-42d3-ab37-bcc1e83feb03,network=Network(123788a2-cb47-4b56-bdeb-38a7ca6cc964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c2ad90b-3b') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.objects.instance [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lazy-loading 'pci_devices' on Instance uuid c0644b77-33ce-46e4-a6cb-b6322bdc6a9e {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:22:33 user nova-compute[72820]:   <uuid>c0644b77-33ce-46e4-a6cb-b6322bdc6a9e</uuid>
Aug 27 02:22:33 user nova-compute[72820]:   <name>instance-0000000a</name>
Aug 27 02:22:33 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:22:33 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:22:33 user nova-compute[72820]:   <metadata>
Aug 27 02:22:33 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:22:33 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:22:33 user nova-compute[72820]:       <nova:name>tempest-device-tagging-server-202888074</nova:name>
Aug 27 02:22:33 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:22:28</nova:creationTime>
Aug 27 02:22:33 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:22:33 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:22:33 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:22:33 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:22:33 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:22:33 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:22:33 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:22:33 user nova-compute[72820]:       <nova:owner>
Aug 27 02:22:33 user nova-compute[72820]:         <nova:user uuid="db576ff11e7a4258a2f2a5961a06bf89">tempest-TaggedBootDevicesTest_v242-1904740609-project-member</nova:user>
Aug 27 02:22:33 user nova-compute[72820]:         <nova:project uuid="18e3cfb8d39743be8aeac5c6c2a665c8">tempest-TaggedBootDevicesTest_v242-1904740609</nova:project>
Aug 27 02:22:33 user nova-compute[72820]:       </nova:owner>
Aug 27 02:22:33 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:22:33 user nova-compute[72820]:       <nova:ports>
Aug 27 02:22:33 user nova-compute[72820]:         <nova:port uuid="73dd97ef-6247-4cbb-bfe3-834c7abd5361">
Aug 27 02:22:33 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 02:22:33 user nova-compute[72820]:         </nova:port>
Aug 27 02:22:33 user nova-compute[72820]:         <nova:port uuid="23374c0c-55bc-488f-89ec-741193010838">
Aug 27 02:22:33 user nova-compute[72820]:           <nova:ip type="fixed" address="10.1.1.4" ipVersion="4"/>
Aug 27 02:22:33 user nova-compute[72820]:         </nova:port>
Aug 27 02:22:33 user nova-compute[72820]:         <nova:port uuid="d5633b66-cc90-48c4-becc-c7e78219cb29">
Aug 27 02:22:33 user nova-compute[72820]:           <nova:ip type="fixed" address="10.1.1.175" ipVersion="4"/>
Aug 27 02:22:33 user nova-compute[72820]:         </nova:port>
Aug 27 02:22:33 user nova-compute[72820]:         <nova:port uuid="d213a9b4-5eaf-476b-9577-d9583e26a6b0">
Aug 27 02:22:33 user nova-compute[72820]:           <nova:ip type="fixed" address="10.1.1.46" ipVersion="4"/>
Aug 27 02:22:33 user nova-compute[72820]:         </nova:port>
Aug 27 02:22:33 user nova-compute[72820]:         <nova:port uuid="6a8419c8-b3eb-40ec-8f50-2eebcf714f9f">
Aug 27 02:22:33 user nova-compute[72820]:           <nova:ip type="fixed" address="10.1.1.70" ipVersion="4"/>
Aug 27 02:22:33 user nova-compute[72820]:         </nova:port>
Aug 27 02:22:33 user nova-compute[72820]:         <nova:port uuid="9405c97c-5de6-43e5-b9f1-b8cff3272472">
Aug 27 02:22:33 user nova-compute[72820]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 27 02:22:33 user nova-compute[72820]:         </nova:port>
Aug 27 02:22:33 user nova-compute[72820]:         <nova:port uuid="8c2ad90b-3b97-42d3-ab37-bcc1e83feb03">
Aug 27 02:22:33 user nova-compute[72820]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 27 02:22:33 user nova-compute[72820]:         </nova:port>
Aug 27 02:22:33 user nova-compute[72820]:       </nova:ports>
Aug 27 02:22:33 user nova-compute[72820]:     </nova:instance>
Aug 27 02:22:33 user nova-compute[72820]:   </metadata>
Aug 27 02:22:33 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:22:33 user nova-compute[72820]:     <system>
Aug 27 02:22:33 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:22:33 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:22:33 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:22:33 user nova-compute[72820]:       <entry name="serial">c0644b77-33ce-46e4-a6cb-b6322bdc6a9e</entry>
Aug 27 02:22:33 user nova-compute[72820]:       <entry name="uuid">c0644b77-33ce-46e4-a6cb-b6322bdc6a9e</entry>
Aug 27 02:22:33 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:22:33 user nova-compute[72820]:     </system>
Aug 27 02:22:33 user nova-compute[72820]:   </sysinfo>
Aug 27 02:22:33 user nova-compute[72820]:   <os>
Aug 27 02:22:33 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:22:33 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:22:33 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:22:33 user nova-compute[72820]:   </os>
Aug 27 02:22:33 user nova-compute[72820]:   <features>
Aug 27 02:22:33 user nova-compute[72820]:     <acpi/>
Aug 27 02:22:33 user nova-compute[72820]:     <apic/>
Aug 27 02:22:33 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:22:33 user nova-compute[72820]:   </features>
Aug 27 02:22:33 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:22:33 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:22:33 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:22:33 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:22:33 user nova-compute[72820]:   </clock>
Aug 27 02:22:33 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:22:33 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:22:33 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:22:33 user nova-compute[72820]:   </cpu>
Aug 27 02:22:33 user nova-compute[72820]:   <devices>
Aug 27 02:22:33 user nova-compute[72820]:     <disk type="file" device="cdrom">
Aug 27 02:22:33 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 02:22:33 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/c0644b77-33ce-46e4-a6cb-b6322bdc6a9e/disk.config"/>
Aug 27 02:22:33 user nova-compute[72820]:       <target dev="hda" bus="ide"/>
Aug 27 02:22:33 user nova-compute[72820]:     </disk>
Aug 27 02:22:33 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:22:33 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:22:33 user nova-compute[72820]:       <source dev="/dev/sdb"/>
Aug 27 02:22:33 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:22:33 user nova-compute[72820]:       <serial>e0408d30-fda0-45f6-856a-de9a2a75572b</serial>
Aug 27 02:22:33 user nova-compute[72820]:     </disk>
Aug 27 02:22:33 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:22:33 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:22:33 user nova-compute[72820]:       <source dev="/dev/sdc"/>
Aug 27 02:22:33 user nova-compute[72820]:       <target dev="vdb" bus="virtio"/>
Aug 27 02:22:33 user nova-compute[72820]:       <serial>36f67fa6-d4bc-404b-bd73-6c4f14bff633</serial>
Aug 27 02:22:33 user nova-compute[72820]:     </disk>
Aug 27 02:22:33 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:22:33 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:22:33 user nova-compute[72820]:       <source dev="/dev/sde"/>
Aug 27 02:22:33 user nova-compute[72820]:       <target dev="vdc" bus="virtio"/>
Aug 27 02:22:33 user nova-compute[72820]:       <serial>58a485c5-4b50-4a42-93e1-cac518f86341</serial>
Aug 27 02:22:33 user nova-compute[72820]:     </disk>
Aug 27 02:22:33 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:22:33 user nova-compute[72820]:       <mac address="fa:16:3e:1e:15:71"/>
Aug 27 02:22:33 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:22:33 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:22:33 user nova-compute[72820]:       <target dev="tap73dd97ef-62"/>
Aug 27 02:22:33 user nova-compute[72820]:     </interface>
Aug 27 02:22:33 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:22:33 user nova-compute[72820]:       <mac address="fa:16:3e:f3:3d:f2"/>
Aug 27 02:22:33 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:22:33 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:22:33 user nova-compute[72820]:       <target dev="tap23374c0c-55"/>
Aug 27 02:22:33 user nova-compute[72820]:     </interface>
Aug 27 02:22:33 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:22:33 user nova-compute[72820]:       <mac address="fa:16:3e:c2:bf:70"/>
Aug 27 02:22:33 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:22:33 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:22:33 user nova-compute[72820]:       <target dev="tapd5633b66-cc"/>
Aug 27 02:22:33 user nova-compute[72820]:     </interface>
Aug 27 02:22:33 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:22:33 user nova-compute[72820]:       <mac address="fa:16:3e:33:0f:06"/>
Aug 27 02:22:33 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:22:33 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:22:33 user nova-compute[72820]:       <target dev="tapd213a9b4-5e"/>
Aug 27 02:22:33 user nova-compute[72820]:     </interface>
Aug 27 02:22:33 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:22:33 user nova-compute[72820]:       <mac address="fa:16:3e:70:8d:6d"/>
Aug 27 02:22:33 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:22:33 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:22:33 user nova-compute[72820]:       <target dev="tap6a8419c8-b3"/>
Aug 27 02:22:33 user nova-compute[72820]:     </interface>
Aug 27 02:22:33 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:22:33 user nova-compute[72820]:       <mac address="fa:16:3e:33:d5:c4"/>
Aug 27 02:22:33 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:22:33 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:22:33 user nova-compute[72820]:       <target dev="tap9405c97c-5d"/>
Aug 27 02:22:33 user nova-compute[72820]:     </interface>
Aug 27 02:22:33 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:22:33 user nova-compute[72820]:       <mac address="fa:16:3e:73:59:e0"/>
Aug 27 02:22:33 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:22:33 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:22:33 user nova-compute[72820]:       <target dev="tap8c2ad90b-3b"/>
Aug 27 02:22:33 user nova-compute[72820]:     </interface>
Aug 27 02:22:33 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:22:33 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/c0644b77-33ce-46e4-a6cb-b6322bdc6a9e/console.log" append="off"/>
Aug 27 02:22:33 user nova-compute[72820]:     </serial>
Aug 27 02:22:33 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:22:33 user nova-compute[72820]:     <video>
Aug 27 02:22:33 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:22:33 user nova-compute[72820]:     </video>
Aug 27 02:22:33 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:22:33 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:22:33 user nova-compute[72820]:     </rng>
Aug 27 02:22:33 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:22:33 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:22:33 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:22:33 user nova-compute[72820]:     </memballoon>
Aug 27 02:22:33 user nova-compute[72820]:   </devices>
Aug 27 02:22:33 user nova-compute[72820]: </domain>
Aug 27 02:22:33 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "address": "fa:16:3e:1e:15:71", "network": {"id": "e238ffcb-d9ec-4d89-830a-0347bcade186", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1932493438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dd97ef-62", "ovs_interfaceid": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "address": "fa:16:3e:1e:15:71", "network": {"id": "e238ffcb-d9ec-4d89-830a-0347bcade186", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1932493438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dd97ef-62", "ovs_interfaceid": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:15:71,bridge_name='br-int',has_traffic_filtering=True,id=73dd97ef-6247-4cbb-bfe3-834c7abd5361,network=Network(e238ffcb-d9ec-4d89-830a-0347bcade186),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73dd97ef-62') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG os_vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:15:71,bridge_name='br-int',has_traffic_filtering=True,id=73dd97ef-6247-4cbb-bfe3-834c7abd5361,network=Network(e238ffcb-d9ec-4d89-830a-0347bcade186),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73dd97ef-62') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73dd97ef-62, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73dd97ef-62, col_values=(('external_ids', {'iface-id': '73dd97ef-6247-4cbb-bfe3-834c7abd5361', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:15:71', 'vm-uuid': 'c0644b77-33ce-46e4-a6cb-b6322bdc6a9e'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:33 user nova-compute[72820]: INFO os_vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:15:71,bridge_name='br-int',has_traffic_filtering=True,id=73dd97ef-6247-4cbb-bfe3-834c7abd5361,network=Network(e238ffcb-d9ec-4d89-830a-0347bcade186),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73dd97ef-62')
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23374c0c-55bc-488f-89ec-741193010838", "address": "fa:16:3e:f3:3d:f2", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23374c0c-55", "ovs_interfaceid": "23374c0c-55bc-488f-89ec-741193010838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "23374c0c-55bc-488f-89ec-741193010838", "address": "fa:16:3e:f3:3d:f2", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23374c0c-55", "ovs_interfaceid": "23374c0c-55bc-488f-89ec-741193010838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:f2,bridge_name='br-int',has_traffic_filtering=True,id=23374c0c-55bc-488f-89ec-741193010838,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23374c0c-55') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG os_vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:f2,bridge_name='br-int',has_traffic_filtering=True,id=23374c0c-55bc-488f-89ec-741193010838,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23374c0c-55') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23374c0c-55, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap23374c0c-55, col_values=(('external_ids', {'iface-id': '23374c0c-55bc-488f-89ec-741193010838', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:3d:f2', 'vm-uuid': 'c0644b77-33ce-46e4-a6cb-b6322bdc6a9e'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:33 user nova-compute[72820]: INFO os_vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:f2,bridge_name='br-int',has_traffic_filtering=True,id=23374c0c-55bc-488f-89ec-741193010838,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23374c0c-55')
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5633b66-cc90-48c4-becc-c7e78219cb29", "address": "fa:16:3e:c2:bf:70", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5633b66-cc", "ovs_interfaceid": "d5633b66-cc90-48c4-becc-c7e78219cb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "d5633b66-cc90-48c4-becc-c7e78219cb29", "address": "fa:16:3e:c2:bf:70", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5633b66-cc", "ovs_interfaceid": "d5633b66-cc90-48c4-becc-c7e78219cb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:bf:70,bridge_name='br-int',has_traffic_filtering=True,id=d5633b66-cc90-48c4-becc-c7e78219cb29,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5633b66-cc') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG os_vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:bf:70,bridge_name='br-int',has_traffic_filtering=True,id=d5633b66-cc90-48c4-becc-c7e78219cb29,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5633b66-cc') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5633b66-cc, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5633b66-cc, col_values=(('external_ids', {'iface-id': 'd5633b66-cc90-48c4-becc-c7e78219cb29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:bf:70', 'vm-uuid': 'c0644b77-33ce-46e4-a6cb-b6322bdc6a9e'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: INFO os_vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:bf:70,bridge_name='br-int',has_traffic_filtering=True,id=d5633b66-cc90-48c4-becc-c7e78219cb29,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5633b66-cc')
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "address": "fa:16:3e:33:0f:06", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd213a9b4-5e", "ovs_interfaceid": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "address": "fa:16:3e:33:0f:06", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd213a9b4-5e", "ovs_interfaceid": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:0f:06,bridge_name='br-int',has_traffic_filtering=True,id=d213a9b4-5eaf-476b-9577-d9583e26a6b0,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd213a9b4-5e') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:0f:06,bridge_name='br-int',has_traffic_filtering=True,id=d213a9b4-5eaf-476b-9577-d9583e26a6b0,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd213a9b4-5e') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd213a9b4-5e, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd213a9b4-5e, col_values=(('external_ids', {'iface-id': 'd213a9b4-5eaf-476b-9577-d9583e26a6b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:0f:06', 'vm-uuid': 'c0644b77-33ce-46e4-a6cb-b6322bdc6a9e'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: INFO os_vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:0f:06,bridge_name='br-int',has_traffic_filtering=True,id=d213a9b4-5eaf-476b-9577-d9583e26a6b0,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd213a9b4-5e')
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "address": "fa:16:3e:70:8d:6d", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8419c8-b3", "ovs_interfaceid": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "address": "fa:16:3e:70:8d:6d", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8419c8-b3", "ovs_interfaceid": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:8d:6d,bridge_name='br-int',has_traffic_filtering=True,id=6a8419c8-b3eb-40ec-8f50-2eebcf714f9f,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a8419c8-b3') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:8d:6d,bridge_name='br-int',has_traffic_filtering=True,id=6a8419c8-b3eb-40ec-8f50-2eebcf714f9f,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a8419c8-b3') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a8419c8-b3, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a8419c8-b3, col_values=(('external_ids', {'iface-id': '6a8419c8-b3eb-40ec-8f50-2eebcf714f9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:8d:6d', 'vm-uuid': 'c0644b77-33ce-46e4-a6cb-b6322bdc6a9e'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: INFO os_vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:8d:6d,bridge_name='br-int',has_traffic_filtering=True,id=6a8419c8-b3eb-40ec-8f50-2eebcf714f9f,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a8419c8-b3')
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "address": "fa:16:3e:33:d5:c4", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9405c97c-5d", "ovs_interfaceid": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "address": "fa:16:3e:33:d5:c4", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9405c97c-5d", "ovs_interfaceid": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:d5:c4,bridge_name='br-int',has_traffic_filtering=True,id=9405c97c-5de6-43e5-b9f1-b8cff3272472,network=Network(123788a2-cb47-4b56-bdeb-38a7ca6cc964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9405c97c-5d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:d5:c4,bridge_name='br-int',has_traffic_filtering=True,id=9405c97c-5de6-43e5-b9f1-b8cff3272472,network=Network(123788a2-cb47-4b56-bdeb-38a7ca6cc964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9405c97c-5d') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9405c97c-5d, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9405c97c-5d, col_values=(('external_ids', {'iface-id': '9405c97c-5de6-43e5-b9f1-b8cff3272472', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:d5:c4', 'vm-uuid': 'c0644b77-33ce-46e4-a6cb-b6322bdc6a9e'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: INFO os_vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:d5:c4,bridge_name='br-int',has_traffic_filtering=True,id=9405c97c-5de6-43e5-b9f1-b8cff3272472,network=Network(123788a2-cb47-4b56-bdeb-38a7ca6cc964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9405c97c-5d')
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "address": "fa:16:3e:73:59:e0", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2ad90b-3b", "ovs_interfaceid": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "address": "fa:16:3e:73:59:e0", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2ad90b-3b", "ovs_interfaceid": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:59:e0,bridge_name='br-int',has_traffic_filtering=True,id=8c2ad90b-3b97-42d3-ab37-bcc1e83feb03,network=Network(123788a2-cb47-4b56-bdeb-38a7ca6cc964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c2ad90b-3b') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:59:e0,bridge_name='br-int',has_traffic_filtering=True,id=8c2ad90b-3b97-42d3-ab37-bcc1e83feb03,network=Network(123788a2-cb47-4b56-bdeb-38a7ca6cc964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c2ad90b-3b') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102954.2829657, 717fb1d8-6d09-440b-bc50-7132a8ebe8d9 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:22:34 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] VM Resumed (Lifecycle Event)
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.compute.manager [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c2ad90b-3b, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c2ad90b-3b, col_values=(('external_ids', {'iface-id': '8c2ad90b-3b97-42d3-ab37-bcc1e83feb03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:59:e0', 'vm-uuid': 'c0644b77-33ce-46e4-a6cb-b6322bdc6a9e'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:22:34 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Instance spawned successfully.
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-7c55626f-d3f5-448f-b9ca-d0f1df73545d req-5bab3504-800f-444e-8fc7-ae40b51684c7 service nova] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Received event network-vif-plugged-a4cb14fa-35f7-4063-a940-2eef65a83094 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7c55626f-d3f5-448f-b9ca-d0f1df73545d req-5bab3504-800f-444e-8fc7-ae40b51684c7 service nova] Acquiring lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7c55626f-d3f5-448f-b9ca-d0f1df73545d req-5bab3504-800f-444e-8fc7-ae40b51684c7 service nova] Lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7c55626f-d3f5-448f-b9ca-d0f1df73545d req-5bab3504-800f-444e-8fc7-ae40b51684c7 service nova] Lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-7c55626f-d3f5-448f-b9ca-d0f1df73545d req-5bab3504-800f-444e-8fc7-ae40b51684c7 service nova] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] No waiting events found dispatching network-vif-plugged-a4cb14fa-35f7-4063-a940-2eef65a83094 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:34 user nova-compute[72820]: WARNING nova.compute.manager [req-7c55626f-d3f5-448f-b9ca-d0f1df73545d req-5bab3504-800f-444e-8fc7-ae40b51684c7 service nova] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Received unexpected event network-vif-plugged-a4cb14fa-35f7-4063-a940-2eef65a83094 for instance with vm_state building and task_state spawning.
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-7c55626f-d3f5-448f-b9ca-d0f1df73545d req-5bab3504-800f-444e-8fc7-ae40b51684c7 service nova] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Received event network-vif-unplugged-3174b771-02bc-4766-9e03-53c1e899b297 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7c55626f-d3f5-448f-b9ca-d0f1df73545d req-5bab3504-800f-444e-8fc7-ae40b51684c7 service nova] Acquiring lock "703a5060-dd34-4fff-9dec-6924ad018713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7c55626f-d3f5-448f-b9ca-d0f1df73545d req-5bab3504-800f-444e-8fc7-ae40b51684c7 service nova] Lock "703a5060-dd34-4fff-9dec-6924ad018713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7c55626f-d3f5-448f-b9ca-d0f1df73545d req-5bab3504-800f-444e-8fc7-ae40b51684c7 service nova] Lock "703a5060-dd34-4fff-9dec-6924ad018713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-7c55626f-d3f5-448f-b9ca-d0f1df73545d req-5bab3504-800f-444e-8fc7-ae40b51684c7 service nova] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] No waiting events found dispatching network-vif-unplugged-3174b771-02bc-4766-9e03-53c1e899b297 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-7c55626f-d3f5-448f-b9ca-d0f1df73545d req-5bab3504-800f-444e-8fc7-ae40b51684c7 service nova] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Received event network-vif-unplugged-3174b771-02bc-4766-9e03-53c1e899b297 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:22:34 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102954.283108, 717fb1d8-6d09-440b-bc50-7132a8ebe8d9 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:22:34 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] VM Started (Lifecycle Event)
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: INFO os_vif [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:59:e0,bridge_name='br-int',has_traffic_filtering=True,id=8c2ad90b-3b97-42d3-ab37-bcc1e83feb03,network=Network(123788a2-cb47-4b56-bdeb-38a7ca6cc964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c2ad90b-3b')
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:22:34 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:22:34 user nova-compute[72820]: INFO nova.compute.manager [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Took 5.89 seconds to spawn the instance on the hypervisor.
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.compute.manager [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:22:34 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Instance destroyed successfully.
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.objects.instance [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lazy-loading 'resources' on Instance uuid 703a5060-dd34-4fff-9dec-6924ad018713 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1386185593',display_name='tempest-DeleteServersTestJSON-server-1386185593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1386185593',id=1,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:20:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87dab14feca44a93aaf191cedb1b0a14',ramdisk_id='',reservation_id='r-0ctckil0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-580668285',owner_user_name='tempest-DeleteServersTestJSON-580668285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:20:24Z,user_data=None,user_id='4d23062df28045afb400b603b9defb27',uuid=703a5060-dd34-4fff-9dec-6924ad018713,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3174b771-02bc-4766-9e03-53c1e899b297", "address": "fa:16:3e:50:07:21", "network": {"id": "06365b03-94bf-4068-a08a-b794dc377256", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1090515065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87dab14feca44a93aaf191cedb1b0a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3174b771-02", "ovs_interfaceid": "3174b771-02bc-4766-9e03-53c1e899b297", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Converting VIF {"id": "3174b771-02bc-4766-9e03-53c1e899b297", "address": "fa:16:3e:50:07:21", "network": {"id": "06365b03-94bf-4068-a08a-b794dc377256", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1090515065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87dab14feca44a93aaf191cedb1b0a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3174b771-02", "ovs_interfaceid": "3174b771-02bc-4766-9e03-53c1e899b297", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:07:21,bridge_name='br-int',has_traffic_filtering=True,id=3174b771-02bc-4766-9e03-53c1e899b297,network=Network(06365b03-94bf-4068-a08a-b794dc377256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3174b771-02') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_vif [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:07:21,bridge_name='br-int',has_traffic_filtering=True,id=3174b771-02bc-4766-9e03-53c1e899b297,network=Network(06365b03-94bf-4068-a08a-b794dc377256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3174b771-02') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3174b771-02, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] No BDM found with device name hda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] No VIF found with MAC fa:16:3e:1e:15:71, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] No VIF found with MAC fa:16:3e:70:8d:6d, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:22:34 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Using config drive
Aug 27 02:22:34 user nova-compute[72820]: INFO nova.compute.manager [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Took 6.85 seconds to build instance.
Aug 27 02:22:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:34 user nova-compute[72820]: INFO os_vif [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:07:21,bridge_name='br-int',has_traffic_filtering=True,id=3174b771-02bc-4766-9e03-53c1e899b297,network=Network(06365b03-94bf-4068-a08a-b794dc377256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3174b771-02')
Aug 27 02:22:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'klNbhwnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:22:34 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-feff2821-39ae-42da-95de-1525d13dc06c tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.056s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ebee44-668a-4733-a833-2300b7d21cdd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:22:34 user nova-compute[72820]: No targets found.
Aug 27 02:22:34 user nova-compute[72820]: iSNS:
Aug 27 02:22:34 user nova-compute[72820]: No targets found.
Aug 27 02:22:34 user nova-compute[72820]: STATIC:
Aug 27 02:22:34 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d
Aug 27 02:22:34 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:22:34 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:22:34 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341
Aug 27 02:22:34 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:22:34 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:22:34 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b
Aug 27 02:22:34 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:22:34 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:22:34 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633
Aug 27 02:22:34 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:22:34 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:22:34 user nova-compute[72820]: FIRMWARE:
Aug 27 02:22:34 user nova-compute[72820]: No targets found.
Aug 27 02:22:34 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:22:34 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:22:34 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee89d18-a39f-4124-9d16-e7279cdd2cff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff28e70e-b559-4580-b185-e8cc4a1edb59]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:34 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:34 user nova-compute[72820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d (non-flash)
Aug 27 02:22:34 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:22:34 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:34 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:34 user nova-compute[72820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d (non-flash)
Aug 27 02:22:34 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:22:34 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c031c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d'): ({'sdd'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Removing single pathed devices sdd {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8d570d-8a6a-4638-a0bf-c91e3b05ce7e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcad7b8-1047-467c-8f7c-662bb524e4f8]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Flushing IO for device /dev/sdd {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[149254eb-d9a2-4e99-afbb-2ab8ea87dc4f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:34 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Creating config drive at /opt/stack/data/nova/instances/c0644b77-33ce-46e4-a6cb-b6322bdc6a9e/disk.config
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c0644b77-33ce-46e4-a6cb-b6322bdc6a9e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp69pty_w8 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd90c270-c747-44b5-875c-673dd157aa63]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c0644b77-33ce-46e4-a6cb-b6322bdc6a9e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp69pty_w8" returned: 0 in 0.054s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77d2b53-902a-463d-b2b5-19d0a4b9363f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:35 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa9ec7b-cf81-4b22-bd19-aee1ec63a295]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:35 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d, portal: 172.16.0.220,3260]
Aug 27 02:22:35 user nova-compute[72820]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d, portal: 172.16.0.220,3260] successful.
Aug 27 02:22:35 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:839365f7-b328-45bd-95ac-e5fe53fee68d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.090s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:35 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7735c317-e9bd-41d6-859e-78befc2610ce]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:35 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:35 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.468s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:22:35 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] <== disconnect_volume: return (470ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:22:35 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:22:35 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Deleting instance files /opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713_del
Aug 27 02:22:35 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Deletion of /opt/stack/data/nova/instances/703a5060-dd34-4fff-9dec-6924ad018713_del complete
Aug 27 02:22:35 user nova-compute[72820]: INFO nova.compute.manager [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Took 1.53 seconds to destroy the instance on the hypervisor.
Aug 27 02:22:35 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:22:35 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:22:35 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:22:35 user nova-compute[72820]: DEBUG nova.compute.manager [req-159da787-1d85-4ac6-ad4c-c822c46673c4 req-d4bd270d-516a-447e-b7d1-34190c17ed57 service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Received event network-changed-82d087af-c0f8-4c88-904c-4afbf9c5239d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:35 user nova-compute[72820]: DEBUG nova.compute.manager [req-159da787-1d85-4ac6-ad4c-c822c46673c4 req-d4bd270d-516a-447e-b7d1-34190c17ed57 service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Refreshing instance network info cache due to event network-changed-82d087af-c0f8-4c88-904c-4afbf9c5239d. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:22:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-159da787-1d85-4ac6-ad4c-c822c46673c4 req-d4bd270d-516a-447e-b7d1-34190c17ed57 service nova] Acquiring lock "refresh_cache-8ae21d01-4c7c-4926-9868-cf8786e59d4d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:22:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-159da787-1d85-4ac6-ad4c-c822c46673c4 req-d4bd270d-516a-447e-b7d1-34190c17ed57 service nova] Acquired lock "refresh_cache-8ae21d01-4c7c-4926-9868-cf8786e59d4d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:22:35 user nova-compute[72820]: DEBUG nova.network.neutron [req-159da787-1d85-4ac6-ad4c-c822c46673c4 req-d4bd270d-516a-447e-b7d1-34190c17ed57 service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Refreshing network info cache for port 82d087af-c0f8-4c88-904c-4afbf9c5239d {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:22:36 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:22:36 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Took 0.83 seconds to deallocate network for instance.
Aug 27 02:22:36 user nova-compute[72820]: DEBUG nova.network.neutron [req-159da787-1d85-4ac6-ad4c-c822c46673c4 req-d4bd270d-516a-447e-b7d1-34190c17ed57 service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Updated VIF entry in instance network info cache for port 82d087af-c0f8-4c88-904c-4afbf9c5239d. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:22:36 user nova-compute[72820]: DEBUG nova.network.neutron [req-159da787-1d85-4ac6-ad4c-c822c46673c4 req-d4bd270d-516a-447e-b7d1-34190c17ed57 service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Updating instance_info_cache with network_info: [{"id": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "address": "fa:16:3e:b2:10:8f", "network": {"id": "bcd471a8-51e4-4484-9152-d414438c0997", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1786754798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48503a99b8e149f7bf2be3b21e156014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82d087af-c0", "ovs_interfaceid": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:22:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-159da787-1d85-4ac6-ad4c-c822c46673c4 req-d4bd270d-516a-447e-b7d1-34190c17ed57 service nova] Releasing lock "refresh_cache-8ae21d01-4c7c-4926-9868-cf8786e59d4d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:22:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:36 user nova-compute[72820]: DEBUG nova.compute.manager [req-0b570d38-4e8d-4c1d-8163-89feba2d1fcb req-f4e983f6-6f83-4f28-9692-f17268dd0764 service nova] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Received event network-vif-plugged-3174b771-02bc-4766-9e03-53c1e899b297 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0b570d38-4e8d-4c1d-8163-89feba2d1fcb req-f4e983f6-6f83-4f28-9692-f17268dd0764 service nova] Acquiring lock "703a5060-dd34-4fff-9dec-6924ad018713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0b570d38-4e8d-4c1d-8163-89feba2d1fcb req-f4e983f6-6f83-4f28-9692-f17268dd0764 service nova] Lock "703a5060-dd34-4fff-9dec-6924ad018713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0b570d38-4e8d-4c1d-8163-89feba2d1fcb req-f4e983f6-6f83-4f28-9692-f17268dd0764 service nova] Lock "703a5060-dd34-4fff-9dec-6924ad018713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:36 user nova-compute[72820]: DEBUG nova.compute.manager [req-0b570d38-4e8d-4c1d-8163-89feba2d1fcb req-f4e983f6-6f83-4f28-9692-f17268dd0764 service nova] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] No waiting events found dispatching network-vif-plugged-3174b771-02bc-4766-9e03-53c1e899b297 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:36 user nova-compute[72820]: WARNING nova.compute.manager [req-0b570d38-4e8d-4c1d-8163-89feba2d1fcb req-f4e983f6-6f83-4f28-9692-f17268dd0764 service nova] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Received unexpected event network-vif-plugged-3174b771-02bc-4766-9e03-53c1e899b297 for instance with vm_state active and task_state deleting.
Aug 27 02:22:36 user nova-compute[72820]: DEBUG nova.compute.manager [req-0b570d38-4e8d-4c1d-8163-89feba2d1fcb req-f4e983f6-6f83-4f28-9692-f17268dd0764 service nova] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Received event network-vif-deleted-3174b771-02bc-4766-9e03-53c1e899b297 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:37 user nova-compute[72820]: INFO nova.compute.manager [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Took 0.99 seconds to detach 1 volumes for instance.
Aug 27 02:22:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-9729fd78-e5dc-4bcb-a544-da879e33356d req-3986deee-dd3d-4220-8dfb-be04828a9aad service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-d5633b66-cc90-48c4-becc-c7e78219cb29 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9729fd78-e5dc-4bcb-a544-da879e33356d req-3986deee-dd3d-4220-8dfb-be04828a9aad service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9729fd78-e5dc-4bcb-a544-da879e33356d req-3986deee-dd3d-4220-8dfb-be04828a9aad service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9729fd78-e5dc-4bcb-a544-da879e33356d req-3986deee-dd3d-4220-8dfb-be04828a9aad service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-9729fd78-e5dc-4bcb-a544-da879e33356d req-3986deee-dd3d-4220-8dfb-be04828a9aad service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-d5633b66-cc90-48c4-becc-c7e78219cb29 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:37 user nova-compute[72820]: WARNING nova.compute.manager [req-9729fd78-e5dc-4bcb-a544-da879e33356d req-3986deee-dd3d-4220-8dfb-be04828a9aad service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-d5633b66-cc90-48c4-becc-c7e78219cb29 for instance with vm_state building and task_state spawning.
Aug 27 02:22:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.608s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-4b606f63-64a9-4e96-a489-c9a63ce2d216 req-db20964b-5458-4e27-9b5d-efe7ed84638b service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-73dd97ef-6247-4cbb-bfe3-834c7abd5361 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4b606f63-64a9-4e96-a489-c9a63ce2d216 req-db20964b-5458-4e27-9b5d-efe7ed84638b service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4b606f63-64a9-4e96-a489-c9a63ce2d216 req-db20964b-5458-4e27-9b5d-efe7ed84638b service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4b606f63-64a9-4e96-a489-c9a63ce2d216 req-db20964b-5458-4e27-9b5d-efe7ed84638b service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-4b606f63-64a9-4e96-a489-c9a63ce2d216 req-db20964b-5458-4e27-9b5d-efe7ed84638b service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-73dd97ef-6247-4cbb-bfe3-834c7abd5361 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:37 user nova-compute[72820]: WARNING nova.compute.manager [req-4b606f63-64a9-4e96-a489-c9a63ce2d216 req-db20964b-5458-4e27-9b5d-efe7ed84638b service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-73dd97ef-6247-4cbb-bfe3-834c7abd5361 for instance with vm_state building and task_state spawning.
Aug 27 02:22:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-4b606f63-64a9-4e96-a489-c9a63ce2d216 req-db20964b-5458-4e27-9b5d-efe7ed84638b service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-73dd97ef-6247-4cbb-bfe3-834c7abd5361 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4b606f63-64a9-4e96-a489-c9a63ce2d216 req-db20964b-5458-4e27-9b5d-efe7ed84638b service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4b606f63-64a9-4e96-a489-c9a63ce2d216 req-db20964b-5458-4e27-9b5d-efe7ed84638b service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4b606f63-64a9-4e96-a489-c9a63ce2d216 req-db20964b-5458-4e27-9b5d-efe7ed84638b service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-4b606f63-64a9-4e96-a489-c9a63ce2d216 req-db20964b-5458-4e27-9b5d-efe7ed84638b service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-73dd97ef-6247-4cbb-bfe3-834c7abd5361 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:37 user nova-compute[72820]: WARNING nova.compute.manager [req-4b606f63-64a9-4e96-a489-c9a63ce2d216 req-db20964b-5458-4e27-9b5d-efe7ed84638b service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-73dd97ef-6247-4cbb-bfe3-834c7abd5361 for instance with vm_state building and task_state spawning.
Aug 27 02:22:37 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Deleted allocations for instance 703a5060-dd34-4fff-9dec-6924ad018713
Aug 27 02:22:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5be86bfa-61f0-4887-a548-004bf5ea576f tempest-DeleteServersTestJSON-580668285 tempest-DeleteServersTestJSON-580668285-project-member] Lock "703a5060-dd34-4fff-9dec-6924ad018713" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.290s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-b6f73282-319e-4a10-a521-8187964381fa req-2282c9ac-4abf-44d0-bbb0-293e1ae8358a service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-23374c0c-55bc-488f-89ec-741193010838 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b6f73282-319e-4a10-a521-8187964381fa req-2282c9ac-4abf-44d0-bbb0-293e1ae8358a service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b6f73282-319e-4a10-a521-8187964381fa req-2282c9ac-4abf-44d0-bbb0-293e1ae8358a service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b6f73282-319e-4a10-a521-8187964381fa req-2282c9ac-4abf-44d0-bbb0-293e1ae8358a service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-b6f73282-319e-4a10-a521-8187964381fa req-2282c9ac-4abf-44d0-bbb0-293e1ae8358a service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-23374c0c-55bc-488f-89ec-741193010838 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:38 user nova-compute[72820]: WARNING nova.compute.manager [req-b6f73282-319e-4a10-a521-8187964381fa req-2282c9ac-4abf-44d0-bbb0-293e1ae8358a service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-23374c0c-55bc-488f-89ec-741193010838 for instance with vm_state building and task_state spawning.
Aug 27 02:22:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-b6f73282-319e-4a10-a521-8187964381fa req-2282c9ac-4abf-44d0-bbb0-293e1ae8358a service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-23374c0c-55bc-488f-89ec-741193010838 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b6f73282-319e-4a10-a521-8187964381fa req-2282c9ac-4abf-44d0-bbb0-293e1ae8358a service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b6f73282-319e-4a10-a521-8187964381fa req-2282c9ac-4abf-44d0-bbb0-293e1ae8358a service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b6f73282-319e-4a10-a521-8187964381fa req-2282c9ac-4abf-44d0-bbb0-293e1ae8358a service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-b6f73282-319e-4a10-a521-8187964381fa req-2282c9ac-4abf-44d0-bbb0-293e1ae8358a service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-23374c0c-55bc-488f-89ec-741193010838 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:38 user nova-compute[72820]: WARNING nova.compute.manager [req-b6f73282-319e-4a10-a521-8187964381fa req-2282c9ac-4abf-44d0-bbb0-293e1ae8358a service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-23374c0c-55bc-488f-89ec-741193010838 for instance with vm_state building and task_state spawning.
Aug 27 02:22:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-b6f73282-319e-4a10-a521-8187964381fa req-2282c9ac-4abf-44d0-bbb0-293e1ae8358a service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-d213a9b4-5eaf-476b-9577-d9583e26a6b0 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b6f73282-319e-4a10-a521-8187964381fa req-2282c9ac-4abf-44d0-bbb0-293e1ae8358a service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b6f73282-319e-4a10-a521-8187964381fa req-2282c9ac-4abf-44d0-bbb0-293e1ae8358a service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b6f73282-319e-4a10-a521-8187964381fa req-2282c9ac-4abf-44d0-bbb0-293e1ae8358a service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-b6f73282-319e-4a10-a521-8187964381fa req-2282c9ac-4abf-44d0-bbb0-293e1ae8358a service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-d213a9b4-5eaf-476b-9577-d9583e26a6b0 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:38 user nova-compute[72820]: WARNING nova.compute.manager [req-b6f73282-319e-4a10-a521-8187964381fa req-2282c9ac-4abf-44d0-bbb0-293e1ae8358a service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-d213a9b4-5eaf-476b-9577-d9583e26a6b0 for instance with vm_state building and task_state spawning.
Aug 27 02:22:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-9ebf8173-243c-4e0a-927c-de0f17c941db req-5bc6aed6-b606-44bd-beb0-ec400048f779 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-d5633b66-cc90-48c4-becc-c7e78219cb29 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9ebf8173-243c-4e0a-927c-de0f17c941db req-5bc6aed6-b606-44bd-beb0-ec400048f779 service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9ebf8173-243c-4e0a-927c-de0f17c941db req-5bc6aed6-b606-44bd-beb0-ec400048f779 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9ebf8173-243c-4e0a-927c-de0f17c941db req-5bc6aed6-b606-44bd-beb0-ec400048f779 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-9ebf8173-243c-4e0a-927c-de0f17c941db req-5bc6aed6-b606-44bd-beb0-ec400048f779 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-d5633b66-cc90-48c4-becc-c7e78219cb29 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:39 user nova-compute[72820]: WARNING nova.compute.manager [req-9ebf8173-243c-4e0a-927c-de0f17c941db req-5bc6aed6-b606-44bd-beb0-ec400048f779 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-d5633b66-cc90-48c4-becc-c7e78219cb29 for instance with vm_state building and task_state spawning.
Aug 27 02:22:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-9ebf8173-243c-4e0a-927c-de0f17c941db req-5bc6aed6-b606-44bd-beb0-ec400048f779 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-6a8419c8-b3eb-40ec-8f50-2eebcf714f9f {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9ebf8173-243c-4e0a-927c-de0f17c941db req-5bc6aed6-b606-44bd-beb0-ec400048f779 service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9ebf8173-243c-4e0a-927c-de0f17c941db req-5bc6aed6-b606-44bd-beb0-ec400048f779 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9ebf8173-243c-4e0a-927c-de0f17c941db req-5bc6aed6-b606-44bd-beb0-ec400048f779 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-9ebf8173-243c-4e0a-927c-de0f17c941db req-5bc6aed6-b606-44bd-beb0-ec400048f779 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-6a8419c8-b3eb-40ec-8f50-2eebcf714f9f {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:39 user nova-compute[72820]: WARNING nova.compute.manager [req-9ebf8173-243c-4e0a-927c-de0f17c941db req-5bc6aed6-b606-44bd-beb0-ec400048f779 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-6a8419c8-b3eb-40ec-8f50-2eebcf714f9f for instance with vm_state building and task_state spawning.
Aug 27 02:22:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-9ebf8173-243c-4e0a-927c-de0f17c941db req-5bc6aed6-b606-44bd-beb0-ec400048f779 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-6a8419c8-b3eb-40ec-8f50-2eebcf714f9f {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9ebf8173-243c-4e0a-927c-de0f17c941db req-5bc6aed6-b606-44bd-beb0-ec400048f779 service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9ebf8173-243c-4e0a-927c-de0f17c941db req-5bc6aed6-b606-44bd-beb0-ec400048f779 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9ebf8173-243c-4e0a-927c-de0f17c941db req-5bc6aed6-b606-44bd-beb0-ec400048f779 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-9ebf8173-243c-4e0a-927c-de0f17c941db req-5bc6aed6-b606-44bd-beb0-ec400048f779 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-6a8419c8-b3eb-40ec-8f50-2eebcf714f9f {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:39 user nova-compute[72820]: WARNING nova.compute.manager [req-9ebf8173-243c-4e0a-927c-de0f17c941db req-5bc6aed6-b606-44bd-beb0-ec400048f779 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-6a8419c8-b3eb-40ec-8f50-2eebcf714f9f for instance with vm_state building and task_state spawning.
Aug 27 02:22:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "interface-1246d21d-b797-4c76-b282-83e17e6bf06a-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "interface-1246d21d-b797-4c76-b282-83e17e6bf06a-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:39 user nova-compute[72820]: DEBUG nova.objects.instance [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lazy-loading 'flavor' on Instance uuid 1246d21d-b797-4c76-b282-83e17e6bf06a {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-ff643d4c-9a58-4448-a43d-187e65bc74d1 req-65d085e6-c821-4022-9d3f-656e4f7102d7 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received event network-changed-52e755c8-03a4-4255-a48d-414e0a1ba26a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-ff643d4c-9a58-4448-a43d-187e65bc74d1 req-65d085e6-c821-4022-9d3f-656e4f7102d7 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Refreshing instance network info cache due to event network-changed-52e755c8-03a4-4255-a48d-414e0a1ba26a. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ff643d4c-9a58-4448-a43d-187e65bc74d1 req-65d085e6-c821-4022-9d3f-656e4f7102d7 service nova] Acquiring lock "refresh_cache-1246d21d-b797-4c76-b282-83e17e6bf06a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ff643d4c-9a58-4448-a43d-187e65bc74d1 req-65d085e6-c821-4022-9d3f-656e4f7102d7 service nova] Acquired lock "refresh_cache-1246d21d-b797-4c76-b282-83e17e6bf06a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG nova.network.neutron [req-ff643d4c-9a58-4448-a43d-187e65bc74d1 req-65d085e6-c821-4022-9d3f-656e4f7102d7 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Refreshing network info cache for port 52e755c8-03a4-4255-a48d-414e0a1ba26a {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-d213a9b4-5eaf-476b-9577-d9583e26a6b0 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-d213a9b4-5eaf-476b-9577-d9583e26a6b0 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:40 user nova-compute[72820]: WARNING nova.compute.manager [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-d213a9b4-5eaf-476b-9577-d9583e26a6b0 for instance with vm_state building and task_state spawning.
Aug 27 02:22:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-9405c97c-5de6-43e5-b9f1-b8cff3272472 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-9405c97c-5de6-43e5-b9f1-b8cff3272472 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:40 user nova-compute[72820]: WARNING nova.compute.manager [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-9405c97c-5de6-43e5-b9f1-b8cff3272472 for instance with vm_state building and task_state spawning.
Aug 27 02:22:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-9405c97c-5de6-43e5-b9f1-b8cff3272472 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-9405c97c-5de6-43e5-b9f1-b8cff3272472 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:40 user nova-compute[72820]: WARNING nova.compute.manager [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-9405c97c-5de6-43e5-b9f1-b8cff3272472 for instance with vm_state building and task_state spawning.
Aug 27 02:22:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-8c2ad90b-3b97-42d3-ab37-bcc1e83feb03 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-8c2ad90b-3b97-42d3-ab37-bcc1e83feb03 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:40 user nova-compute[72820]: WARNING nova.compute.manager [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-8c2ad90b-3b97-42d3-ab37-bcc1e83feb03 for instance with vm_state building and task_state spawning.
Aug 27 02:22:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-8c2ad90b-3b97-42d3-ab37-bcc1e83feb03 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-8c2ad90b-3b97-42d3-ab37-bcc1e83feb03 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:40 user nova-compute[72820]: WARNING nova.compute.manager [req-55b9ccdd-7457-44e8-9d11-9f604d152a99 req-a8d03ad2-6fc1-413b-b643-defc3e80aa8e service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-8c2ad90b-3b97-42d3-ab37-bcc1e83feb03 for instance with vm_state building and task_state spawning.
Aug 27 02:22:40 user nova-compute[72820]: DEBUG nova.network.neutron [req-ff643d4c-9a58-4448-a43d-187e65bc74d1 req-65d085e6-c821-4022-9d3f-656e4f7102d7 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Updated VIF entry in instance network info cache for port 52e755c8-03a4-4255-a48d-414e0a1ba26a. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG nova.network.neutron [req-ff643d4c-9a58-4448-a43d-187e65bc74d1 req-65d085e6-c821-4022-9d3f-656e4f7102d7 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Updating instance_info_cache with network_info: [{"id": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "address": "fa:16:3e:50:f4:e0", "network": {"id": "acc49577-9bcb-4da3-ad31-4ecf60e14ce6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2140276278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e755c8-03", "ovs_interfaceid": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:22:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ff643d4c-9a58-4448-a43d-187e65bc74d1 req-65d085e6-c821-4022-9d3f-656e4f7102d7 service nova] Releasing lock "refresh_cache-1246d21d-b797-4c76-b282-83e17e6bf06a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102961.1560452, c0644b77-33ce-46e4-a6cb-b6322bdc6a9e => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:22:41 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] VM Resumed (Lifecycle Event)
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:22:41 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Instance spawned successfully.
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.objects.instance [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lazy-loading 'pci_requests' on Instance uuid 1246d21d-b797-4c76-b282-83e17e6bf06a {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.objects.base [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Object Instance<1246d21d-b797-4c76-b282-83e17e6bf06a> lazy-loaded attributes: flavor,pci_requests {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.network.neutron [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:22:41 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693102961.1573532, c0644b77-33ce-46e4-a6cb-b6322bdc6a9e => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:22:41 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] VM Started (Lifecycle Event)
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:22:41 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:22:41 user nova-compute[72820]: INFO nova.compute.manager [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Took 13.07 seconds to spawn the instance on the hypervisor.
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:22:41 user nova-compute[72820]: INFO nova.compute.manager [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Took 56.19 seconds to build instance.
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.policy [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d17e388756d462da4e6d144b73085fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34aba94505ec4710a8a30e50cae8d4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a71268a0-f64c-42ee-b5f6-58bb10d80e12 tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 56.343s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Acquiring lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG nova.objects.instance [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lazy-loading 'flavor' on Instance uuid 8ae21d01-4c7c-4926-9868-cf8786e59d4d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:22:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Acquiring lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:42 user nova-compute[72820]: INFO nova.compute.manager [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Attaching volume ada98b61-4364-4886-99fa-80836e6b610e to /dev/sdc
Aug 27 02:22:42 user nova-compute[72820]: DEBUG os_brick.utils [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65d5e3e-eaba-46f8-8929-74fa73efea0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[359c07e1-ee31-438b-ac78-9baf571d1542]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab052e3-b57c-495d-b113-5607f887279c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e34106f-9df6-41ba-b476-1209972b9260]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:22:42 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41b8e26-d271-42a5-b661-16fa6a7202ce]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG os_brick.utils [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Updating existing volume attachment record: 95db68b5-74d4-4b0b-80e6-87a773f52d42 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-98501473-1397-4f11-b8ed-3da46500b609 req-1b5a93b7-0ad1-438e-82cf-93a8522441ed service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Received event network-changed-7f134260-3849-4dea-bc03-f14fa02d4e17 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-98501473-1397-4f11-b8ed-3da46500b609 req-1b5a93b7-0ad1-438e-82cf-93a8522441ed service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Refreshing instance network info cache due to event network-changed-7f134260-3849-4dea-bc03-f14fa02d4e17. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-98501473-1397-4f11-b8ed-3da46500b609 req-1b5a93b7-0ad1-438e-82cf-93a8522441ed service nova] Acquiring lock "refresh_cache-abe48a87-2a54-468d-98e5-afae2577e541" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-98501473-1397-4f11-b8ed-3da46500b609 req-1b5a93b7-0ad1-438e-82cf-93a8522441ed service nova] Acquired lock "refresh_cache-abe48a87-2a54-468d-98e5-afae2577e541" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:22:42 user nova-compute[72820]: DEBUG nova.network.neutron [req-98501473-1397-4f11-b8ed-3da46500b609 req-1b5a93b7-0ad1-438e-82cf-93a8522441ed service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Refreshing network info cache for port 7f134260-3849-4dea-bc03-f14fa02d4e17 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG nova.network.neutron [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Successfully created port: d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Acquiring lock "abe48a87-2a54-468d-98e5-afae2577e541" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "abe48a87-2a54-468d-98e5-afae2577e541" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG nova.objects.instance [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lazy-loading 'flavor' on Instance uuid abe48a87-2a54-468d-98e5-afae2577e541 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "abe48a87-2a54-468d-98e5-afae2577e541" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Acquiring lock "abe48a87-2a54-468d-98e5-afae2577e541" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "abe48a87-2a54-468d-98e5-afae2577e541" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:43 user nova-compute[72820]: INFO nova.compute.manager [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Attaching volume b19cea99-e9a2-4f33-bf1c-761bbfa0b902 to /dev/vdb
Aug 27 02:22:43 user nova-compute[72820]: DEBUG os_brick.utils [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0547b9ce-2477-4236-a202-2f477b5bd4f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b28ca6-ff40-4ada-9bac-ef58287ed5b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a2920d-daac-4bcc-8f56-bcd93811d031]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e56897-31dc-43bc-af1d-e22c1c3105a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:22:43 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ba4736-2811-4dca-917f-11093f922546]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG os_brick.utils [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Updating existing volume attachment record: 63694b39-b94a-41bc-b660-451550393ad7 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG nova.network.neutron [req-98501473-1397-4f11-b8ed-3da46500b609 req-1b5a93b7-0ad1-438e-82cf-93a8522441ed service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Updated VIF entry in instance network info cache for port 7f134260-3849-4dea-bc03-f14fa02d4e17. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG nova.network.neutron [req-98501473-1397-4f11-b8ed-3da46500b609 req-1b5a93b7-0ad1-438e-82cf-93a8522441ed service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Updating instance_info_cache with network_info: [{"id": "7f134260-3849-4dea-bc03-f14fa02d4e17", "address": "fa:16:3e:fc:a5:b0", "network": {"id": "fe558211-ecb3-4bc8-b195-e03c52142d69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-252580199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390ad1b0be83481fa07c91e508c5cfd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f134260-38", "ovs_interfaceid": "7f134260-3849-4dea-bc03-f14fa02d4e17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:22:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-98501473-1397-4f11-b8ed-3da46500b609 req-1b5a93b7-0ad1-438e-82cf-93a8522441ed service nova] Releasing lock "refresh_cache-abe48a87-2a54-468d-98e5-afae2577e541" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:22:44 user nova-compute[72820]: DEBUG nova.network.neutron [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Successfully updated port: d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:22:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "refresh_cache-1246d21d-b797-4c76-b282-83e17e6bf06a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:22:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquired lock "refresh_cache-1246d21d-b797-4c76-b282-83e17e6bf06a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:22:44 user nova-compute[72820]: DEBUG nova.network.neutron [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:22:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:44 user nova-compute[72820]: DEBUG nova.network.neutron [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Updating instance_info_cache with network_info: [{"id": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "address": "fa:16:3e:50:f4:e0", "network": {"id": "acc49577-9bcb-4da3-ad31-4ecf60e14ce6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2140276278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e755c8-03", "ovs_interfaceid": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "address": "fa:16:3e:a2:70:e9", "network": {"id": "3457fd89-273d-40a6-a830-f74984c0170c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1985262322", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ed2ab2-41", "ovs_interfaceid": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Releasing lock "refresh_cache-1246d21d-b797-4c76-b282-83e17e6bf06a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-763202852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-763202852',id=7,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp8SE+60pO/iSvH/3MlKKhub1Bt3pIV43ycpm9UNaf+uwVjtT/lwbZQdwY4vF2RtnbJSES0rieVwtxnV3XLrYsdPch9SnMxc7EdoRqFhT0gE3l0qDEzBd0M43h/WvHElA==',key_name='tempest-keypair-1710782008',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:20:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='34aba94505ec4710a8a30e50cae8d4df',ramdisk_id='',reservation_id='r-vu1svk2a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-634168039',owner_user_name='tempest-TaggedAttachmentsTest-634168039-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d17e388756d462da4e6d144b73085fa',uuid=1246d21d-b797-4c76-b282-83e17e6bf06a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "address": "fa:16:3e:a2:70:e9", "network": {"id": "3457fd89-273d-40a6-a830-f74984c0170c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1985262322", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ed2ab2-41", "ovs_interfaceid": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Converting VIF {"id": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "address": "fa:16:3e:a2:70:e9", "network": {"id": "3457fd89-273d-40a6-a830-f74984c0170c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1985262322", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ed2ab2-41", "ovs_interfaceid": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f,network=Network(3457fd89-273d-40a6-a830-f74984c0170c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ed2ab2-41') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG os_vif [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f,network=Network(3457fd89-273d-40a6-a830-f74984c0170c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ed2ab2-41') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-7c36d19f-2add-4e11-8179-8defd251193e req-b9a1be17-780f-4dd0-964c-a1ee3ddf8252 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received event network-changed-d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-7c36d19f-2add-4e11-8179-8defd251193e req-b9a1be17-780f-4dd0-964c-a1ee3ddf8252 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Refreshing instance network info cache due to event network-changed-d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7c36d19f-2add-4e11-8179-8defd251193e req-b9a1be17-780f-4dd0-964c-a1ee3ddf8252 service nova] Acquiring lock "refresh_cache-1246d21d-b797-4c76-b282-83e17e6bf06a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7c36d19f-2add-4e11-8179-8defd251193e req-b9a1be17-780f-4dd0-964c-a1ee3ddf8252 service nova] Acquired lock "refresh_cache-1246d21d-b797-4c76-b282-83e17e6bf06a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG nova.network.neutron [req-7c36d19f-2add-4e11-8179-8defd251193e req-b9a1be17-780f-4dd0-964c-a1ee3ddf8252 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Refreshing network info cache for port d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6ed2ab2-41, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6ed2ab2-41, col_values=(('external_ids', {'iface-id': 'd6ed2ab2-41ec-4aa1-9f04-d638d4cde94f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:70:e9', 'vm-uuid': '1246d21d-b797-4c76-b282-83e17e6bf06a'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:22:45 user nova-compute[72820]: INFO os_vif [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f,network=Network(3457fd89-273d-40a6-a830-f74984c0170c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ed2ab2-41')
Aug 27 02:22:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-763202852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-763202852',id=7,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp8SE+60pO/iSvH/3MlKKhub1Bt3pIV43ycpm9UNaf+uwVjtT/lwbZQdwY4vF2RtnbJSES0rieVwtxnV3XLrYsdPch9SnMxc7EdoRqFhT0gE3l0qDEzBd0M43h/WvHElA==',key_name='tempest-keypair-1710782008',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:20:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='34aba94505ec4710a8a30e50cae8d4df',ramdisk_id='',reservation_id='r-vu1svk2a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-634168039',owner_user_name='tempest-TaggedAttachmentsTest-634168039-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d17e388756d462da4e6d144b73085fa',uuid=1246d21d-b797-4c76-b282-83e17e6bf06a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "address": "fa:16:3e:a2:70:e9", "network": {"id": "3457fd89-273d-40a6-a830-f74984c0170c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1985262322", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ed2ab2-41", "ovs_interfaceid": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Converting VIF {"id": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "address": "fa:16:3e:a2:70:e9", "network": {"id": "3457fd89-273d-40a6-a830-f74984c0170c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1985262322", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ed2ab2-41", "ovs_interfaceid": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f,network=Network(3457fd89-273d-40a6-a830-f74984c0170c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ed2ab2-41') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] attach device xml: <interface type="ethernet">
Aug 27 02:22:45 user nova-compute[72820]:   <mac address="fa:16:3e:a2:70:e9"/>
Aug 27 02:22:45 user nova-compute[72820]:   <model type="virtio"/>
Aug 27 02:22:45 user nova-compute[72820]:   <mtu size="1442"/>
Aug 27 02:22:45 user nova-compute[72820]:   <target dev="tapd6ed2ab2-41"/>
Aug 27 02:22:45 user nova-compute[72820]: </interface>
Aug 27 02:22:45 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] No BDM found with device name hda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:22:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] No VIF found with MAC fa:16:3e:50:f4:e0, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:22:46 user nova-compute[72820]:   <nova:package version="0.0.0"/>
Aug 27 02:22:46 user nova-compute[72820]:   <nova:name>tempest-device-tagging-server-763202852</nova:name>
Aug 27 02:22:46 user nova-compute[72820]:   <nova:creationTime>2023-08-27 02:22:46</nova:creationTime>
Aug 27 02:22:46 user nova-compute[72820]:   <nova:flavor name="m1.tiny">
Aug 27 02:22:46 user nova-compute[72820]:     <nova:memory>512</nova:memory>
Aug 27 02:22:46 user nova-compute[72820]:     <nova:disk>1</nova:disk>
Aug 27 02:22:46 user nova-compute[72820]:     <nova:swap>0</nova:swap>
Aug 27 02:22:46 user nova-compute[72820]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:22:46 user nova-compute[72820]:     <nova:vcpus>1</nova:vcpus>
Aug 27 02:22:46 user nova-compute[72820]:   </nova:flavor>
Aug 27 02:22:46 user nova-compute[72820]:   <nova:owner>
Aug 27 02:22:46 user nova-compute[72820]:     <nova:user uuid="6d17e388756d462da4e6d144b73085fa">tempest-TaggedAttachmentsTest-634168039-project-member</nova:user>
Aug 27 02:22:46 user nova-compute[72820]:     <nova:project uuid="34aba94505ec4710a8a30e50cae8d4df">tempest-TaggedAttachmentsTest-634168039</nova:project>
Aug 27 02:22:46 user nova-compute[72820]:   </nova:owner>
Aug 27 02:22:46 user nova-compute[72820]:   <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:22:46 user nova-compute[72820]:   <nova:ports>
Aug 27 02:22:46 user nova-compute[72820]:     <nova:port uuid="52e755c8-03a4-4255-a48d-414e0a1ba26a">
Aug 27 02:22:46 user nova-compute[72820]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 02:22:46 user nova-compute[72820]:     </nova:port>
Aug 27 02:22:46 user nova-compute[72820]:     <nova:port uuid="d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f">
Aug 27 02:22:46 user nova-compute[72820]:       <nova:ip type="fixed" address="10.10.10.36" ipVersion="4"/>
Aug 27 02:22:46 user nova-compute[72820]:     </nova:port>
Aug 27 02:22:46 user nova-compute[72820]:   </nova:ports>
Aug 27 02:22:46 user nova-compute[72820]: </nova:instance>
Aug 27 02:22:46 user nova-compute[72820]:  {{(pid=72820) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d480af88-07d0-4507-a589-11b44706c863 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "interface-1246d21d-b797-4c76-b282-83e17e6bf06a-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 6.151s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG nova.network.neutron [req-7c36d19f-2add-4e11-8179-8defd251193e req-b9a1be17-780f-4dd0-964c-a1ee3ddf8252 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Updated VIF entry in instance network info cache for port d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG nova.network.neutron [req-7c36d19f-2add-4e11-8179-8defd251193e req-b9a1be17-780f-4dd0-964c-a1ee3ddf8252 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Updating instance_info_cache with network_info: [{"id": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "address": "fa:16:3e:50:f4:e0", "network": {"id": "acc49577-9bcb-4da3-ad31-4ecf60e14ce6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2140276278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e755c8-03", "ovs_interfaceid": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "address": "fa:16:3e:a2:70:e9", "network": {"id": "3457fd89-273d-40a6-a830-f74984c0170c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1985262322", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ed2ab2-41", "ovs_interfaceid": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7c36d19f-2add-4e11-8179-8defd251193e req-b9a1be17-780f-4dd0-964c-a1ee3ddf8252 service nova] Releasing lock "refresh_cache-1246d21d-b797-4c76-b282-83e17e6bf06a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "1246d21d-b797-4c76-b282-83e17e6bf06a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG nova.objects.instance [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lazy-loading 'flavor' on Instance uuid 1246d21d-b797-4c76-b282-83e17e6bf06a {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "1246d21d-b797-4c76-b282-83e17e6bf06a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:46 user nova-compute[72820]: INFO nova.compute.manager [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Attaching volume e9e2e494-ecca-4f09-b9c1-0d01a39d5456 to /dev/vdb
Aug 27 02:22:46 user nova-compute[72820]: DEBUG os_brick.utils [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc458b2-b5f8-49ab-baa4-886ba2980bf1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb25b482-647c-4cd8-a3f8-d8c472960152]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a43028-aa75-4f38-93b0-d1ba279845d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa59799-62c1-4659-9359-e1a1af947853]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:22:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:22:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:22:47 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:22:47 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[40aaffdd-cf2f-49af-84f3-a26e2551c9f9]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:22:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:22:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:22:47 user nova-compute[72820]: DEBUG os_brick.utils [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:22:47 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Updating existing volume attachment record: 796e0afc-5d61-4b46-8361-963624e51d90 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:22:47 user nova-compute[72820]: DEBUG nova.compute.manager [req-db903ada-a05d-40b8-ae35-e2815d364b98 req-561ded04-0d24-413a-9162-2d1c897baebe service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received event network-vif-plugged-d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-db903ada-a05d-40b8-ae35-e2815d364b98 req-561ded04-0d24-413a-9162-2d1c897baebe service nova] Acquiring lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-db903ada-a05d-40b8-ae35-e2815d364b98 req-561ded04-0d24-413a-9162-2d1c897baebe service nova] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-db903ada-a05d-40b8-ae35-e2815d364b98 req-561ded04-0d24-413a-9162-2d1c897baebe service nova] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:47 user nova-compute[72820]: DEBUG nova.compute.manager [req-db903ada-a05d-40b8-ae35-e2815d364b98 req-561ded04-0d24-413a-9162-2d1c897baebe service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] No waiting events found dispatching network-vif-plugged-d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:47 user nova-compute[72820]: WARNING nova.compute.manager [req-db903ada-a05d-40b8-ae35-e2815d364b98 req-561ded04-0d24-413a-9162-2d1c897baebe service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received unexpected event network-vif-plugged-d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f for instance with vm_state active and task_state None.
Aug 27 02:22:47 user nova-compute[72820]: DEBUG nova.compute.manager [req-db903ada-a05d-40b8-ae35-e2815d364b98 req-561ded04-0d24-413a-9162-2d1c897baebe service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received event network-vif-plugged-d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-db903ada-a05d-40b8-ae35-e2815d364b98 req-561ded04-0d24-413a-9162-2d1c897baebe service nova] Acquiring lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-db903ada-a05d-40b8-ae35-e2815d364b98 req-561ded04-0d24-413a-9162-2d1c897baebe service nova] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-db903ada-a05d-40b8-ae35-e2815d364b98 req-561ded04-0d24-413a-9162-2d1c897baebe service nova] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:47 user nova-compute[72820]: DEBUG nova.compute.manager [req-db903ada-a05d-40b8-ae35-e2815d364b98 req-561ded04-0d24-413a-9162-2d1c897baebe service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] No waiting events found dispatching network-vif-plugged-d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:22:47 user nova-compute[72820]: WARNING nova.compute.manager [req-db903ada-a05d-40b8-ae35-e2815d364b98 req-561ded04-0d24-413a-9162-2d1c897baebe service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received unexpected event network-vif-plugged-d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f for instance with vm_state active and task_state None.
Aug 27 02:22:49 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693102954.480433, 703a5060-dd34-4fff-9dec-6924ad018713 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:22:49 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] VM Stopped (Lifecycle Event)
Aug 27 02:22:49 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7c9cfb64-25d4-4c33-a9bf-fd5da6021b84 None None] [instance: 703a5060-dd34-4fff-9dec-6924ad018713] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:22:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:50 user nova-compute[72820]: DEBUG nova.compute.manager [req-89b77b6d-1cec-4182-a292-c35590956bf3 req-55758fdd-3a1a-4386-9d8e-85cb401ad0fb service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Received event network-changed-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:22:50 user nova-compute[72820]: DEBUG nova.compute.manager [req-89b77b6d-1cec-4182-a292-c35590956bf3 req-55758fdd-3a1a-4386-9d8e-85cb401ad0fb service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Refreshing instance network info cache due to event network-changed-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:22:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-89b77b6d-1cec-4182-a292-c35590956bf3 req-55758fdd-3a1a-4386-9d8e-85cb401ad0fb service nova] Acquiring lock "refresh_cache-0d99438e-e6d1-4fc3-a399-7e844c8f9538" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:22:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-89b77b6d-1cec-4182-a292-c35590956bf3 req-55758fdd-3a1a-4386-9d8e-85cb401ad0fb service nova] Acquired lock "refresh_cache-0d99438e-e6d1-4fc3-a399-7e844c8f9538" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:22:50 user nova-compute[72820]: DEBUG nova.network.neutron [req-89b77b6d-1cec-4182-a292-c35590956bf3 req-55758fdd-3a1a-4386-9d8e-85cb401ad0fb service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Refreshing network info cache for port ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:22:50 user nova-compute[72820]: DEBUG nova.network.neutron [req-89b77b6d-1cec-4182-a292-c35590956bf3 req-55758fdd-3a1a-4386-9d8e-85cb401ad0fb service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Updated VIF entry in instance network info cache for port ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:22:50 user nova-compute[72820]: DEBUG nova.network.neutron [req-89b77b6d-1cec-4182-a292-c35590956bf3 req-55758fdd-3a1a-4386-9d8e-85cb401ad0fb service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Updating instance_info_cache with network_info: [{"id": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "address": "fa:16:3e:80:50:5b", "network": {"id": "1d1b3f8c-f7ac-48bc-a3af-2a801a350494", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688950999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aea4a72361814294b5a2378a8512abe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc3b16a-3f", "ovs_interfaceid": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:22:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-89b77b6d-1cec-4182-a292-c35590956bf3 req-55758fdd-3a1a-4386-9d8e-85cb401ad0fb service nova] Releasing lock "refresh_cache-0d99438e-e6d1-4fc3-a399-7e844c8f9538" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:22:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjKHcEMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:22:54 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:22:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:22:54 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:22:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:22:54 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[709ad12e-0c04-42ff-b3d2-dcb0fd694fd3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:22:54 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd35b42a-ac7b-4133-89d8-64b8754944f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e] added
Aug 27 02:22:54 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7404c99-8689-451c-9296-c876226338b8]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9178d36d-3755-41d9-916d-64887aef7a2c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xjKHcEMn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xjKHcEMn" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[446290de-e912-4d73-8b3d-fda13a92a1b2]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xjKHcEMn'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e16a250-feb3-4500-a18a-009d146a1c28]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d604fb-4ac0-4e05-b1d7-79865afad416]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:54 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:54 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:22:54 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:54 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:54 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:22:54 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:22:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Acquiring lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG nova.objects.instance [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Lazy-loading 'flavor' on Instance uuid 0d99438e-e6d1-4fc3-a399-7e844c8f9538 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c59f083-296c-4e81-a719-2bfe02f24183]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e, portal: 172.16.0.220,3260]
Aug 27 02:22:55 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e, portal: 172.16.0.220,3260] successful.
Aug 27 02:22:55 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebb9970-3503-4e33-abca-e85bde4d47ea]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fe8b0d-f587-48a2-9731-fd085af2ea3b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:55 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:55 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:22:55 user nova-compute[72820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e (non-flash)
Aug 27 02:22:55 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:55 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:55 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:22:55 user nova-compute[72820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e (non-flash)
Aug 27 02:22:55 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] HCTL ('35', '-', '-', 0) found on session 7 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aa6da4-738c-4535-b2f4-83f031f1cef6]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Searching for a device in session 7 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjKHcEMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Acquiring lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:22:55 user nova-compute[72820]: INFO nova.compute.manager [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Attaching volume 417fed4f-e7d6-481f-b5fd-32679b52fd32 to /dev/vdb
Aug 27 02:22:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG os_brick.utils [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c544fd8-333b-48ee-9cfa-faff9309fb0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50c7493-e9de-43bb-a93d-991c82a601f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec0f94f-0550-4906-8433-220695450582]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddd8035-01a5-4f1e-bd16-0e4eb8d707ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:22:55 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:22:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54658b7-54d2-4939-b345-6b3fc03491b5]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG os_brick.utils [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:22:55 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Updating existing volume attachment record: 0fad86e7-a7ae-4160-a42e-99e6a5c04009 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:22:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:22:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26531626639616363', 'path': '/dev/sdd'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:22:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531626639616363', 'path': '/dev/sdd'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:22:56 user nova-compute[72820]: DEBUG nova.objects.instance [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lazy-loading 'flavor' on Instance uuid 8ae21d01-4c7c-4926-9868-cf8786e59d4d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:22:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:22:56 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:22:56 user nova-compute[72820]:   <source dev="/dev/sdd"/>
Aug 27 02:22:56 user nova-compute[72820]:   <target dev="sdc" bus="scsi"/>
Aug 27 02:22:56 user nova-compute[72820]:   <serial>ada98b61-4364-4886-99fa-80836e6b610e</serial>
Aug 27 02:22:56 user nova-compute[72820]:   <address type="drive" controller="0" unit="2"/>
Aug 27 02:22:56 user nova-compute[72820]: </disk>
Aug 27 02:22:56 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:22:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] No BDM found with device name sda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:22:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:22:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:22:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] No VIF found with MAC fa:16:3e:b2:10:8f, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:22:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKDLbrjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:22:59 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:22:59 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:22:59 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb384afc-7ce0-477c-af62-c823e8432bc1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:22:59 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc3d779-7496-4486-9a1c-782f95d7af1c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456] added
Aug 27 02:22:59 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[636850a3-b2fc-4efb-adf4-f232dae8fe4d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[328f170f-fa9c-4d33-bba3-b8c0fe5617b6]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PKDLbrjC {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PKDLbrjC" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ad750f-f29a-49af-bed2-1d075cd0ca88]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PKDLbrjC'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a739afd2-2c67-4f4f-aead-c72d01bb0fe5]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fdac73-0fbf-412f-8147-71d4d505b913]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:59 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:59 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:22:59 user nova-compute[72820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e (non-flash)
Aug 27 02:22:59 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:59 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:59 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:22:59 user nova-compute[72820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e (non-flash)
Aug 27 02:22:59 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d3e999-4450-4f9a-838d-afe7b2aac9b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456, portal: 172.16.0.220,3260]
Aug 27 02:22:59 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456, portal: 172.16.0.220,3260] successful.
Aug 27 02:22:59 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e58ff6-827b-42f0-ad2b-827d204847de]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[164da439-63ec-4fd0-9ec6-4e10cc23857b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:59 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:59 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:22:59 user nova-compute[72820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e (non-flash)
Aug 27 02:22:59 user nova-compute[72820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 (non-flash)
Aug 27 02:22:59 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:22:59 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:22:59 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:22:59 user nova-compute[72820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e (non-flash)
Aug 27 02:22:59 user nova-compute[72820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 (non-flash)
Aug 27 02:22:59 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d7d3f8-7091-48c8-9db6-b8cb5b89e54d]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKDLbrjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:22:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9d5810bc-7414-48b3-825b-bfce2eccd4b7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.785s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:00 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:23:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:23:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23737633637643833', 'path': '/dev/sdf'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:23:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737633637643833', 'path': '/dev/sdf'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:23:00 user nova-compute[72820]: DEBUG nova.objects.instance [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lazy-loading 'flavor' on Instance uuid 1246d21d-b797-4c76-b282-83e17e6bf06a {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:23:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:23:00 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:23:00 user nova-compute[72820]:   <source dev="/dev/sdf"/>
Aug 27 02:23:00 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:23:00 user nova-compute[72820]:   <serial>e9e2e494-ecca-4f09-b9c1-0d01a39d5456</serial>
Aug 27 02:23:00 user nova-compute[72820]: </disk>
Aug 27 02:23:00 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] No BDM found with device name hda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] No VIF found with MAC fa:16:3e:50:f4:e0, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Acquiring lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:01 user nova-compute[72820]: INFO nova.compute.manager [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Detaching volume ada98b61-4364-4886-99fa-80836e6b610e
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-68a00112-666f-40de-b3b5-1119affe26a0 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.546s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:23:01 user nova-compute[72820]: INFO nova.virt.block_device [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Attempting to driver detach volume ada98b61-4364-4886-99fa-80836e6b610e from mountpoint /dev/sdc
Aug 27 02:23:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Attempting to detach device sdc from instance 8ae21d01-4c7c-4926-9868-cf8786e59d4d from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:23:01 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:23:01 user nova-compute[72820]:   <source dev="/dev/sdd"/>
Aug 27 02:23:01 user nova-compute[72820]:   <target dev="sdc" bus="scsi"/>
Aug 27 02:23:01 user nova-compute[72820]:   <serial>ada98b61-4364-4886-99fa-80836e6b610e</serial>
Aug 27 02:23:01 user nova-compute[72820]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 27 02:23:01 user nova-compute[72820]: </disk>
Aug 27 02:23:01 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:23:01 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Successfully detached device sdc from instance 8ae21d01-4c7c-4926-9868-cf8786e59d4d from the persistent domain config.
Aug 27 02:23:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 8ae21d01-4c7c-4926-9868-cf8786e59d4d from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:23:01 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:23:01 user nova-compute[72820]:   <source dev="/dev/sdd"/>
Aug 27 02:23:01 user nova-compute[72820]:   <target dev="sdc" bus="scsi"/>
Aug 27 02:23:01 user nova-compute[72820]:   <serial>ada98b61-4364-4886-99fa-80836e6b610e</serial>
Aug 27 02:23:01 user nova-compute[72820]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 27 02:23:01 user nova-compute[72820]: </disk>
Aug 27 02:23:01 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693102981.7785385, 8ae21d01-4c7c-4926-9868-cf8786e59d4d => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 8ae21d01-4c7c-4926-9868-cf8786e59d4d {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:23:01 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Successfully detached device sdc from instance 8ae21d01-4c7c-4926-9868-cf8786e59d4d from the live domain config.
Aug 27 02:23:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjKHcEMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:23:01 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:23:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf5c1f6-7395-4403-b5cb-526b54ff1620]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:23:01 user nova-compute[72820]: No targets found.
Aug 27 02:23:01 user nova-compute[72820]: iSNS:
Aug 27 02:23:01 user nova-compute[72820]: No targets found.
Aug 27 02:23:01 user nova-compute[72820]: STATIC:
Aug 27 02:23:01 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e
Aug 27 02:23:01 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:01 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:01 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341
Aug 27 02:23:01 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:01 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:01 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b
Aug 27 02:23:01 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:01 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:01 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633
Aug 27 02:23:01 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:01 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:01 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456
Aug 27 02:23:01 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:01 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:01 user nova-compute[72820]: FIRMWARE:
Aug 27 02:23:01 user nova-compute[72820]: No targets found.
Aug 27 02:23:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:23:01 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:23:01 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7b7c3b-4da9-401c-bf33-ed2b541cc6eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[332c48e2-fad1-4dfb-bfb3-beff3bd6ea4a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:01 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:01 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:01 user nova-compute[72820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e (non-flash)
Aug 27 02:23:01 user nova-compute[72820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 (non-flash)
Aug 27 02:23:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:01 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:01 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:01 user nova-compute[72820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e (non-flash)
Aug 27 02:23:01 user nova-compute[72820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 (non-flash)
Aug 27 02:23:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c02ed360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e'): ({'sdd'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Removing single pathed devices sdd {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e898eb-d2e3-4a6a-a325-31494b3fd0be]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[48814212-ce67-4e5c-a3ad-60e21b9ddda3]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Flushing IO for device /dev/sdd {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[098e167e-6994-40c2-adc0-d034c6a819eb]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[282890c8-ec26-4866-bf7c-7e9034de524f]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:23:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb40fa7f-2590-404b-8b50-eba32c83076f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d301e70-b4f0-45e2-b1b4-434ad6f02902]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e, portal: 172.16.0.220,3260]
Aug 27 02:23:02 user nova-compute[72820]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e, portal: 172.16.0.220,3260] successful.
Aug 27 02:23:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada98b61-4364-4886-99fa-80836e6b610e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3f7d54-ea3d-4884-8654-268eeed7a4b6]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] <== disconnect_volume: return (311ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lazy-loading 'flavor' on Instance uuid 8ae21d01-4c7c-4926-9868-cf8786e59d4d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bd011229-8868-4d60-b3c8-7ec25852440c tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.871s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJFHraCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:23:03 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:23:03 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:23:03 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96c0a01-bcb7-499d-aa41-a80a8291f27f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:23:03 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6039b05-6e79-47f3-9334-67a96796d5a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902] added
Aug 27 02:23:03 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "1246d21d-b797-4c76-b282-83e17e6bf06a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7440bd80-758c-4997-9834-9415bde0fde9]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:03 user nova-compute[72820]: INFO nova.compute.manager [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Detaching volume e9e2e494-ecca-4f09-b9c1-0d01a39d5456
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee3506e-f915-40da-b22d-345882638d75]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LJFHraCe {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LJFHraCe" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2192d7fb-55ad-4ea1-a5af-ae4de9cae34f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LJFHraCe'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:03 user nova-compute[72820]: INFO nova.virt.block_device [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Attempting to driver detach volume e9e2e494-ecca-4f09-b9c1-0d01a39d5456 from mountpoint /dev/vdb
Aug 27 02:23:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Attempting to detach device vdb from instance 1246d21d-b797-4c76-b282-83e17e6bf06a from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:23:03 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:23:03 user nova-compute[72820]:   <source dev="/dev/sdf"/>
Aug 27 02:23:03 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:23:03 user nova-compute[72820]:   <serial>e9e2e494-ecca-4f09-b9c1-0d01a39d5456</serial>
Aug 27 02:23:03 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 02:23:03 user nova-compute[72820]: </disk>
Aug 27 02:23:03 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6441b96-f205-4cca-ae61-6671e73e24b5]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:03 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Successfully detached device vdb from instance 1246d21d-b797-4c76-b282-83e17e6bf06a from the persistent domain config.
Aug 27 02:23:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1246d21d-b797-4c76-b282-83e17e6bf06a from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:23:03 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:23:03 user nova-compute[72820]:   <source dev="/dev/sdf"/>
Aug 27 02:23:03 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:23:03 user nova-compute[72820]:   <serial>e9e2e494-ecca-4f09-b9c1-0d01a39d5456</serial>
Aug 27 02:23:03 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 02:23:03 user nova-compute[72820]: </disk>
Aug 27 02:23:03 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[10358234-d293-47fb-b8a2-f89798861c1c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:03 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:03 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:03 user nova-compute[72820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 (non-flash)
Aug 27 02:23:03 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:03 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:03 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:03 user nova-compute[72820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 (non-flash)
Aug 27 02:23:03 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd078752-e66b-4bc5-b7ba-c9440f5092ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902, portal: 172.16.0.220,3260]
Aug 27 02:23:03 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902, portal: 172.16.0.220,3260] successful.
Aug 27 02:23:03 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa08cbfa-cd3b-4e6a-93b5-2a94fba0c1de]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Acquiring lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Acquiring lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:03 user nova-compute[72820]: INFO nova.compute.manager [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Terminating instance
Aug 27 02:23:03 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[61efdf3c-2009-40db-ba7f-509a671d4a07]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:03 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:03 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:03 user nova-compute[72820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 (non-flash)
Aug 27 02:23:03 user nova-compute[72820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:03 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:03 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:03 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:03 user nova-compute[72820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 (non-flash)
Aug 27 02:23:03 user nova-compute[72820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:03 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] HCTL ('35', '-', '-', 0) found on session 9 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9de4e0e-73ef-43f3-aad6-08a865e7b9e5]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Searching for a device in session 9 and hctl ['35', '*', '*', 0] yield: None {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693102983.9856565, 1246d21d-b797-4c76-b282-83e17e6bf06a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1246d21d-b797-4c76-b282-83e17e6bf06a {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:23:03 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Successfully detached device vdb from instance 1246d21d-b797-4c76-b282-83e17e6bf06a from the live domain config.
Aug 27 02:23:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:23:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKDLbrjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:23:04 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG nova.compute.manager [req-96b98a11-c2f1-42a2-a8ee-8860da606b32 req-5fe2e833-3187-43a2-b16e-39559d5b39b3 service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Received event network-vif-unplugged-82d087af-c0f8-4c88-904c-4afbf9c5239d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-96b98a11-c2f1-42a2-a8ee-8860da606b32 req-5fe2e833-3187-43a2-b16e-39559d5b39b3 service nova] Acquiring lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-96b98a11-c2f1-42a2-a8ee-8860da606b32 req-5fe2e833-3187-43a2-b16e-39559d5b39b3 service nova] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-96b98a11-c2f1-42a2-a8ee-8860da606b32 req-5fe2e833-3187-43a2-b16e-39559d5b39b3 service nova] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG nova.compute.manager [req-96b98a11-c2f1-42a2-a8ee-8860da606b32 req-5fe2e833-3187-43a2-b16e-39559d5b39b3 service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] No waiting events found dispatching network-vif-unplugged-82d087af-c0f8-4c88-904c-4afbf9c5239d {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG nova.compute.manager [req-96b98a11-c2f1-42a2-a8ee-8860da606b32 req-5fe2e833-3187-43a2-b16e-39559d5b39b3 service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Received event network-vif-unplugged-82d087af-c0f8-4c88-904c-4afbf9c5239d for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:04 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Instance destroyed successfully.
Aug 27 02:23:04 user nova-compute[72820]: DEBUG nova.objects.instance [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lazy-loading 'resources' on Instance uuid 8ae21d01-4c7c-4926-9868-cf8786e59d4d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-253085215',display_name='tempest-AttachSCSIVolumeTestJSON-server-253085215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-253085215',id=6,image_ref='c45b06f8-81fd-4b51-8680-d726d017e203',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3KSyCyo5TVWqbGYf7C7dAxNibvz6IcOcDQ7omQ0j/Bhga7OA4HIQWZAXZCLCxgNv3fMMmYzYkemiDw4xM9YYw043DyGaX/iSCw9d7R7v5KqAi3YWz7pYTjc0mUIA8g1A==',key_name='tempest-keypair-1136723862',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:20:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48503a99b8e149f7bf2be3b21e156014',ramdisk_id='',reservation_id='r-ru8kbb3d',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c45b06f8-81fd-4b51-8680-d726d017e203',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-65283222',owner_user_name='tempest-AttachSCSIVolumeTestJSON-65283222-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:20:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b6dde0634d4494ab5dedcfabb9871bf',uuid=8ae21d01-4c7c-4926-9868-cf8786e59d4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "address": "fa:16:3e:b2:10:8f", "network": {"id": "bcd471a8-51e4-4484-9152-d414438c0997", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1786754798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48503a99b8e149f7bf2be3b21e156014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82d087af-c0", "ovs_interfaceid": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Converting VIF {"id": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "address": "fa:16:3e:b2:10:8f", "network": {"id": "bcd471a8-51e4-4484-9152-d414438c0997", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1786754798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48503a99b8e149f7bf2be3b21e156014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82d087af-c0", "ovs_interfaceid": "82d087af-c0f8-4c88-904c-4afbf9c5239d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:10:8f,bridge_name='br-int',has_traffic_filtering=True,id=82d087af-c0f8-4c88-904c-4afbf9c5239d,network=Network(bcd471a8-51e4-4484-9152-d414438c0997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82d087af-c0') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_vif [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:10:8f,bridge_name='br-int',has_traffic_filtering=True,id=82d087af-c0f8-4c88-904c-4afbf9c5239d,network=Network(bcd471a8-51e4-4484-9152-d414438c0997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82d087af-c0') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82d087af-c0, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:23:04 user nova-compute[72820]: INFO os_vif [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:10:8f,bridge_name='br-int',has_traffic_filtering=True,id=82d087af-c0f8-4c88-904c-4afbf9c5239d,network=Network(bcd471a8-51e4-4484-9152-d414438c0997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82d087af-c0')
Aug 27 02:23:04 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Deleting instance files /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d_del
Aug 27 02:23:04 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Deletion of /opt/stack/data/nova/instances/8ae21d01-4c7c-4926-9868-cf8786e59d4d_del complete
Aug 27 02:23:04 user nova-compute[72820]: INFO nova.compute.manager [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Searching for a device in session 9 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJFHraCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23266386139363139', 'path': '/dev/sdd'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266386139363139', 'path': '/dev/sdd'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.739s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG nova.objects.instance [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lazy-loading 'flavor' on Instance uuid abe48a87-2a54-468d-98e5-afae2577e541 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4868289b-6211-4946-8981-ec5a42de3a71]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:23:04 user nova-compute[72820]: No targets found.
Aug 27 02:23:04 user nova-compute[72820]: iSNS:
Aug 27 02:23:04 user nova-compute[72820]: No targets found.
Aug 27 02:23:04 user nova-compute[72820]: STATIC:
Aug 27 02:23:04 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341
Aug 27 02:23:04 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:04 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:04 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b
Aug 27 02:23:04 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:04 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:04 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633
Aug 27 02:23:04 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:04 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:04 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902
Aug 27 02:23:04 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:04 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:04 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456
Aug 27 02:23:04 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:04 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:04 user nova-compute[72820]: FIRMWARE:
Aug 27 02:23:04 user nova-compute[72820]: No targets found.
Aug 27 02:23:04 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:23:04 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:23:04 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:23:04 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:23:04 user nova-compute[72820]:   <source dev="/dev/sdd"/>
Aug 27 02:23:04 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:23:04 user nova-compute[72820]:   <serial>b19cea99-e9a2-4f33-bf1c-761bbfa0b902</serial>
Aug 27 02:23:04 user nova-compute[72820]: </disk>
Aug 27 02:23:04 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0e03fd-7641-4e91-95ea-aa7d54315306]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30bb6d8-92bb-4cc7-ad4d-c6d168030d89]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:04 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:04 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:04 user nova-compute[72820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 (non-flash)
Aug 27 02:23:04 user nova-compute[72820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:04 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:04 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:04 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:04 user nova-compute[72820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 (non-flash)
Aug 27 02:23:04 user nova-compute[72820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:04 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c0698dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456'): ({'sdf'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Removing single pathed devices sdf {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faa2cad-e014-44cd-8a45-8b524dd66ee2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adba02d-dcbc-4b23-84c6-18314536ab58]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Flushing IO for device /dev/sdf {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1b46fd-a01a-425d-8e51-e5c8f024a8ca]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a15d25-0513-4965-be59-c1265761178b]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] SCSI volumes sdf have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:23:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3991f4-2962-4c48-8423-cde43bcaf060]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[354f27aa-d185-48c9-b6cc-73e9e13ced56]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456, portal: 172.16.0.220,3260]
Aug 27 02:23:05 user nova-compute[72820]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456, portal: 172.16.0.220,3260] successful.
Aug 27 02:23:05 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e2e494-ecca-4f09-b9c1-0d01a39d5456 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c61de35-98ba-4133-b967-3db258918b8b]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] <== disconnect_volume: return (1170ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] No VIF found with MAC fa:16:3e:fc:a5:b0, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c5658ada-2d90-4ccc-847a-9cf84eeb7f86 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "abe48a87-2a54-468d-98e5-afae2577e541" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.295s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-fa7c7f8d-eed3-4ed1-8125-5f3a461340ae req-e0f255cc-65ea-4004-b3e8-90e96fada767 service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Received event network-vif-plugged-82d087af-c0f8-4c88-904c-4afbf9c5239d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:23:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fa7c7f8d-eed3-4ed1-8125-5f3a461340ae req-e0f255cc-65ea-4004-b3e8-90e96fada767 service nova] Acquiring lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fa7c7f8d-eed3-4ed1-8125-5f3a461340ae req-e0f255cc-65ea-4004-b3e8-90e96fada767 service nova] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fa7c7f8d-eed3-4ed1-8125-5f3a461340ae req-e0f255cc-65ea-4004-b3e8-90e96fada767 service nova] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-fa7c7f8d-eed3-4ed1-8125-5f3a461340ae req-e0f255cc-65ea-4004-b3e8-90e96fada767 service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] No waiting events found dispatching network-vif-plugged-82d087af-c0f8-4c88-904c-4afbf9c5239d {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:23:06 user nova-compute[72820]: WARNING nova.compute.manager [req-fa7c7f8d-eed3-4ed1-8125-5f3a461340ae req-e0f255cc-65ea-4004-b3e8-90e96fada767 service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Received unexpected event network-vif-plugged-82d087af-c0f8-4c88-904c-4afbf9c5239d for instance with vm_state active and task_state deleting.
Aug 27 02:23:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:06 user nova-compute[72820]: DEBUG nova.objects.instance [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lazy-loading 'flavor' on Instance uuid 1246d21d-b797-4c76-b282-83e17e6bf06a {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:23:06 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:23:06 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Took 1.87 seconds to deallocate network for instance.
Aug 27 02:23:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:06 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Error from libvirt while getting description of instance-00000006: [Error Code 42] Domain not found: no domain with matching uuid '8ae21d01-4c7c-4926-9868-cf8786e59d4d' (instance-00000006): libvirt.libvirtError: Domain not found: no domain with matching uuid '8ae21d01-4c7c-4926-9868-cf8786e59d4d' (instance-00000006)
Aug 27 02:23:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-668513ee-ab0d-4ecc-9d61-9cd8487c3f91 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.248s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:07 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:23:07 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7056MB free_disk=25.454593658447266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "interface-1246d21d-b797-4c76-b282-83e17e6bf06a-d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "interface-1246d21d-b797-4c76-b282-83e17e6bf06a-d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Acquiring lock "abe48a87-2a54-468d-98e5-afae2577e541" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Lock "abe48a87-2a54-468d-98e5-afae2577e541" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG os_brick.utils [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.objects.instance [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lazy-loading 'flavor' on Instance uuid 1246d21d-b797-4c76-b282-83e17e6bf06a {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a22c18-91c3-43b6-be3f-77c7d0171701]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-763202852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-763202852',id=7,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp8SE+60pO/iSvH/3MlKKhub1Bt3pIV43ycpm9UNaf+uwVjtT/lwbZQdwY4vF2RtnbJSES0rieVwtxnV3XLrYsdPch9SnMxc7EdoRqFhT0gE3l0qDEzBd0M43h/WvHElA==',key_name='tempest-keypair-1710782008',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:20:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34aba94505ec4710a8a30e50cae8d4df',ramdisk_id='',reservation_id='r-vu1svk2a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-634168039',owner_user_name='tempest-TaggedAttachmentsTest-634168039-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d17e388756d462da4e6d144b73085fa',uuid=1246d21d-b797-4c76-b282-83e17e6bf06a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "address": "fa:16:3e:a2:70:e9", "network": {"id": "3457fd89-273d-40a6-a830-f74984c0170c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1985262322", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ed2ab2-41", "ovs_interfaceid": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Converting VIF {"id": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "address": "fa:16:3e:a2:70:e9", "network": {"id": "3457fd89-273d-40a6-a830-f74984c0170c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1985262322", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ed2ab2-41", "ovs_interfaceid": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f,network=Network(3457fd89-273d-40a6-a830-f74984c0170c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ed2ab2-41') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[524cf6b5-cd4d-4192-b8cc-252ac91c874a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a2:70:e9"/><model type="virtio"/><mtu size="1442"/><target dev="tapd6ed2ab2-41"/></interface> {{(pid=72820) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a2:70:e9"/><model type="virtio"/><mtu size="1442"/><target dev="tapd6ed2ab2-41"/></interface> {{(pid=72820) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Attempting to detach device tapd6ed2ab2-41 from instance 1246d21d-b797-4c76-b282-83e17e6bf06a from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] detach device xml: <interface type="ethernet">
Aug 27 02:23:07 user nova-compute[72820]:   <mac address="fa:16:3e:a2:70:e9"/>
Aug 27 02:23:07 user nova-compute[72820]:   <model type="virtio"/>
Aug 27 02:23:07 user nova-compute[72820]:   <mtu size="1442"/>
Aug 27 02:23:07 user nova-compute[72820]:   <target dev="tapd6ed2ab2-41"/>
Aug 27 02:23:07 user nova-compute[72820]: </interface>
Aug 27 02:23:07 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a2:70:e9"/><model type="virtio"/><mtu size="1442"/><target dev="tapd6ed2ab2-41"/></interface> {{(pid=72820) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dc3134-7df6-417e-bd6c-b125d8194091]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a2:70:e9"/><model type="virtio"/><mtu size="1442"/><target dev="tapd6ed2ab2-41"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 27 02:23:07 user nova-compute[72820]:   <name>instance-00000007</name>
Aug 27 02:23:07 user nova-compute[72820]:   <uuid>1246d21d-b797-4c76-b282-83e17e6bf06a</uuid>
Aug 27 02:23:07 user nova-compute[72820]:   <metadata>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:23:07 user nova-compute[72820]:   <nova:package version="0.0.0"/>
Aug 27 02:23:07 user nova-compute[72820]:   <nova:name>tempest-device-tagging-server-763202852</nova:name>
Aug 27 02:23:07 user nova-compute[72820]:   <nova:creationTime>2023-08-27 02:22:46</nova:creationTime>
Aug 27 02:23:07 user nova-compute[72820]:   <nova:flavor name="m1.tiny">
Aug 27 02:23:07 user nova-compute[72820]:     <nova:memory>512</nova:memory>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:disk>1</nova:disk>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:swap>0</nova:swap>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:vcpus>1</nova:vcpus>
Aug 27 02:23:07 user nova-compute[72820]:   </nova:flavor>
Aug 27 02:23:07 user nova-compute[72820]:   <nova:owner>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:user uuid="6d17e388756d462da4e6d144b73085fa">tempest-TaggedAttachmentsTest-634168039-project-member</nova:user>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:project uuid="34aba94505ec4710a8a30e50cae8d4df">tempest-TaggedAttachmentsTest-634168039</nova:project>
Aug 27 02:23:07 user nova-compute[72820]:   </nova:owner>
Aug 27 02:23:07 user nova-compute[72820]:   <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:23:07 user nova-compute[72820]:   <nova:ports>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:port uuid="52e755c8-03a4-4255-a48d-414e0a1ba26a">
Aug 27 02:23:07 user nova-compute[72820]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 02:23:07 user nova-compute[72820]:     </nova:port>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:port uuid="d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f">
Aug 27 02:23:07 user nova-compute[72820]:       <nova:ip type="fixed" address="10.10.10.36" ipVersion="4"/>
Aug 27 02:23:07 user nova-compute[72820]:     </nova:port>
Aug 27 02:23:07 user nova-compute[72820]:   </nova:ports>
Aug 27 02:23:07 user nova-compute[72820]: </nova:instance>
Aug 27 02:23:07 user nova-compute[72820]:   </metadata>
Aug 27 02:23:07 user nova-compute[72820]:   <memory unit='KiB'>524288</memory>
Aug 27 02:23:07 user nova-compute[72820]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 27 02:23:07 user nova-compute[72820]:   <vcpu placement='static'>1</vcpu>
Aug 27 02:23:07 user nova-compute[72820]:   <resource>
Aug 27 02:23:07 user nova-compute[72820]:     <partition>/machine</partition>
Aug 27 02:23:07 user nova-compute[72820]:   </resource>
Aug 27 02:23:07 user nova-compute[72820]:   <sysinfo type='smbios'>
Aug 27 02:23:07 user nova-compute[72820]:     <system>
Aug 27 02:23:07 user nova-compute[72820]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 27 02:23:07 user nova-compute[72820]:       <entry name='product'>OpenStack Nova</entry>
Aug 27 02:23:07 user nova-compute[72820]:       <entry name='version'>0.0.0</entry>
Aug 27 02:23:07 user nova-compute[72820]:       <entry name='serial'>1246d21d-b797-4c76-b282-83e17e6bf06a</entry>
Aug 27 02:23:07 user nova-compute[72820]:       <entry name='uuid'>1246d21d-b797-4c76-b282-83e17e6bf06a</entry>
Aug 27 02:23:07 user nova-compute[72820]:       <entry name='family'>Virtual Machine</entry>
Aug 27 02:23:07 user nova-compute[72820]:     </system>
Aug 27 02:23:07 user nova-compute[72820]:   </sysinfo>
Aug 27 02:23:07 user nova-compute[72820]:   <os>
Aug 27 02:23:07 user nova-compute[72820]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 27 02:23:07 user nova-compute[72820]:     <boot dev='hd'/>
Aug 27 02:23:07 user nova-compute[72820]:     <smbios mode='sysinfo'/>
Aug 27 02:23:07 user nova-compute[72820]:   </os>
Aug 27 02:23:07 user nova-compute[72820]:   <features>
Aug 27 02:23:07 user nova-compute[72820]:     <acpi/>
Aug 27 02:23:07 user nova-compute[72820]:     <apic/>
Aug 27 02:23:07 user nova-compute[72820]:     <vmcoreinfo state='on'/>
Aug 27 02:23:07 user nova-compute[72820]:   </features>
Aug 27 02:23:07 user nova-compute[72820]:   <cpu mode='custom' match='exact' check='full'>
Aug 27 02:23:07 user nova-compute[72820]:     <model fallback='forbid'>Nehalem</model>
Aug 27 02:23:07 user nova-compute[72820]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 27 02:23:07 user nova-compute[72820]:     <feature policy='require' name='vme'/>
Aug 27 02:23:07 user nova-compute[72820]:     <feature policy='require' name='x2apic'/>
Aug 27 02:23:07 user nova-compute[72820]:     <feature policy='require' name='hypervisor'/>
Aug 27 02:23:07 user nova-compute[72820]:   </cpu>
Aug 27 02:23:07 user nova-compute[72820]:   <clock offset='utc'>
Aug 27 02:23:07 user nova-compute[72820]:     <timer name='pit' tickpolicy='delay'/>
Aug 27 02:23:07 user nova-compute[72820]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 27 02:23:07 user nova-compute[72820]:     <timer name='hpet' present='no'/>
Aug 27 02:23:07 user nova-compute[72820]:   </clock>
Aug 27 02:23:07 user nova-compute[72820]:   <on_poweroff>destroy</on_poweroff>
Aug 27 02:23:07 user nova-compute[72820]:   <on_reboot>restart</on_reboot>
Aug 27 02:23:07 user nova-compute[72820]:   <on_crash>destroy</on_crash>
Aug 27 02:23:07 user nova-compute[72820]:   <devices>
Aug 27 02:23:07 user nova-compute[72820]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 02:23:07 user nova-compute[72820]:     <disk type='file' device='disk'>
Aug 27 02:23:07 user nova-compute[72820]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 27 02:23:07 user nova-compute[72820]:       <source file='/opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk' index='2'/>
Aug 27 02:23:07 user nova-compute[72820]:       <backingStore type='file' index='3'>
Aug 27 02:23:07 user nova-compute[72820]:         <format type='raw'/>
Aug 27 02:23:07 user nova-compute[72820]:         <source file='/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d'/>
Aug 27 02:23:07 user nova-compute[72820]:         <backingStore/>
Aug 27 02:23:07 user nova-compute[72820]:       </backingStore>
Aug 27 02:23:07 user nova-compute[72820]:       <target dev='vda' bus='virtio'/>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='virtio-disk0'/>
Aug 27 02:23:07 user nova-compute[72820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </disk>
Aug 27 02:23:07 user nova-compute[72820]:     <disk type='file' device='cdrom'>
Aug 27 02:23:07 user nova-compute[72820]:       <driver name='qemu' type='raw' cache='none'/>
Aug 27 02:23:07 user nova-compute[72820]:       <source file='/opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk.config' index='1'/>
Aug 27 02:23:07 user nova-compute[72820]:       <backingStore/>
Aug 27 02:23:07 user nova-compute[72820]:       <target dev='hda' bus='ide'/>
Aug 27 02:23:07 user nova-compute[72820]:       <readonly/>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='ide0-0-0'/>
Aug 27 02:23:07 user nova-compute[72820]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </disk>
Aug 27 02:23:07 user nova-compute[72820]:     <controller type='usb' index='0' model='none'>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='usb'/>
Aug 27 02:23:07 user nova-compute[72820]:     </controller>
Aug 27 02:23:07 user nova-compute[72820]:     <controller type='pci' index='0' model='pci-root'>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='pci.0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </controller>
Aug 27 02:23:07 user nova-compute[72820]:     <controller type='ide' index='0'>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='ide'/>
Aug 27 02:23:07 user nova-compute[72820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 27 02:23:07 user nova-compute[72820]:     </controller>
Aug 27 02:23:07 user nova-compute[72820]:     <interface type='ethernet'>
Aug 27 02:23:07 user nova-compute[72820]:       <mac address='fa:16:3e:50:f4:e0'/>
Aug 27 02:23:07 user nova-compute[72820]:       <target dev='tap52e755c8-03'/>
Aug 27 02:23:07 user nova-compute[72820]:       <model type='virtio'/>
Aug 27 02:23:07 user nova-compute[72820]:       <mtu size='1442'/>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='net0'/>
Aug 27 02:23:07 user nova-compute[72820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </interface>
Aug 27 02:23:07 user nova-compute[72820]:     <interface type='ethernet'>
Aug 27 02:23:07 user nova-compute[72820]:       <mac address='fa:16:3e:a2:70:e9'/>
Aug 27 02:23:07 user nova-compute[72820]:       <target dev='tapd6ed2ab2-41'/>
Aug 27 02:23:07 user nova-compute[72820]:       <model type='virtio'/>
Aug 27 02:23:07 user nova-compute[72820]:       <mtu size='1442'/>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='net1'/>
Aug 27 02:23:07 user nova-compute[72820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </interface>
Aug 27 02:23:07 user nova-compute[72820]:     <serial type='pty'>
Aug 27 02:23:07 user nova-compute[72820]:       <source path='/dev/pts/6'/>
Aug 27 02:23:07 user nova-compute[72820]:       <log file='/opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/console.log' append='off'/>
Aug 27 02:23:07 user nova-compute[72820]:       <target type='isa-serial' port='0'>
Aug 27 02:23:07 user nova-compute[72820]:         <model name='isa-serial'/>
Aug 27 02:23:07 user nova-compute[72820]:       </target>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='serial0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </serial>
Aug 27 02:23:07 user nova-compute[72820]:     <console type='pty' tty='/dev/pts/6'>
Aug 27 02:23:07 user nova-compute[72820]:       <source path='/dev/pts/6'/>
Aug 27 02:23:07 user nova-compute[72820]:       <log file='/opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/console.log' append='off'/>
Aug 27 02:23:07 user nova-compute[72820]:       <target type='serial' port='0'/>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='serial0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </console>
Aug 27 02:23:07 user nova-compute[72820]:     <input type='mouse' bus='ps2'>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='input0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </input>
Aug 27 02:23:07 user nova-compute[72820]:     <input type='keyboard' bus='ps2'>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='input1'/>
Aug 27 02:23:07 user nova-compute[72820]:     </input>
Aug 27 02:23:07 user nova-compute[72820]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 27 02:23:07 user nova-compute[72820]:       <listen type='address' address='0.0.0.0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </graphics>
Aug 27 02:23:07 user nova-compute[72820]:     <audio id='1' type='none'/>
Aug 27 02:23:07 user nova-compute[72820]:     <video>
Aug 27 02:23:07 user nova-compute[72820]:       <model type='virtio' heads='1' primary='yes'/>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='video0'/>
Aug 27 02:23:07 user nova-compute[72820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </video>
Aug 27 02:23:07 user nova-compute[72820]:     <memballoon model='virtio'>
Aug 27 02:23:07 user nova-compute[72820]:       <stats period='10'/>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='balloon0'/>
Aug 27 02:23:07 user nova-compute[72820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </memballoon>
Aug 27 02:23:07 user nova-compute[72820]:     <rng model='virtio'>
Aug 27 02:23:07 user nova-compute[72820]:       <backend model='random'>/dev/urandom</backend>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='rng0'/>
Aug 27 02:23:07 user nova-compute[72820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </rng>
Aug 27 02:23:07 user nova-compute[72820]:   </devices>
Aug 27 02:23:07 user nova-compute[72820]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 27 02:23:07 user nova-compute[72820]:     <label>libvirt-1246d21d-b797-4c76-b282-83e17e6bf06a</label>
Aug 27 02:23:07 user nova-compute[72820]:     <imagelabel>libvirt-1246d21d-b797-4c76-b282-83e17e6bf06a</imagelabel>
Aug 27 02:23:07 user nova-compute[72820]:   </seclabel>
Aug 27 02:23:07 user nova-compute[72820]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 27 02:23:07 user nova-compute[72820]:     <label>+64055:+108</label>
Aug 27 02:23:07 user nova-compute[72820]:     <imagelabel>+64055:+108</imagelabel>
Aug 27 02:23:07 user nova-compute[72820]:   </seclabel>
Aug 27 02:23:07 user nova-compute[72820]: </domain>
Aug 27 02:23:07 user nova-compute[72820]:  {{(pid=72820) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 27 02:23:07 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Successfully detached device tapd6ed2ab2-41 from instance 1246d21d-b797-4c76-b282-83e17e6bf06a from the persistent domain config.
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] (1/8): Attempting to detach device tapd6ed2ab2-41 with device alias net1 from instance 1246d21d-b797-4c76-b282-83e17e6bf06a from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] detach device xml: <interface type="ethernet">
Aug 27 02:23:07 user nova-compute[72820]:   <mac address="fa:16:3e:a2:70:e9"/>
Aug 27 02:23:07 user nova-compute[72820]:   <model type="virtio"/>
Aug 27 02:23:07 user nova-compute[72820]:   <mtu size="1442"/>
Aug 27 02:23:07 user nova-compute[72820]:   <target dev="tapd6ed2ab2-41"/>
Aug 27 02:23:07 user nova-compute[72820]: </interface>
Aug 27 02:23:07 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a43b4f-946e-48f1-b2b6-b106de5ced8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:23:07 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac351ec1-d3a8-49de-abbf-f84e806e3e79]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG os_brick.utils [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:23:07 user nova-compute[72820]: INFO nova.compute.manager [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Swapping volume b19cea99-e9a2-4f33-bf1c-761bbfa0b902 for 1050330c-df37-4ba2-af96-abc58bc63532
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.067s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.344s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:07 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Deleted allocations for instance 8ae21d01-4c7c-4926-9868-cf8786e59d4d
Aug 27 02:23:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693102987.7536826, 1246d21d-b797-4c76-b282-83e17e6bf06a => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Start waiting for the detach event from libvirt for device tapd6ed2ab2-41 with device alias net1 for instance 1246d21d-b797-4c76-b282-83e17e6bf06a {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a2:70:e9"/><model type="virtio"/><mtu size="1442"/><target dev="tapd6ed2ab2-41"/></interface> {{(pid=72820) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a2:70:e9"/><model type="virtio"/><mtu size="1442"/><target dev="tapd6ed2ab2-41"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 27 02:23:07 user nova-compute[72820]:   <name>instance-00000007</name>
Aug 27 02:23:07 user nova-compute[72820]:   <uuid>1246d21d-b797-4c76-b282-83e17e6bf06a</uuid>
Aug 27 02:23:07 user nova-compute[72820]:   <metadata>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:23:07 user nova-compute[72820]:   <nova:package version="0.0.0"/>
Aug 27 02:23:07 user nova-compute[72820]:   <nova:name>tempest-device-tagging-server-763202852</nova:name>
Aug 27 02:23:07 user nova-compute[72820]:   <nova:creationTime>2023-08-27 02:22:46</nova:creationTime>
Aug 27 02:23:07 user nova-compute[72820]:   <nova:flavor name="m1.tiny">
Aug 27 02:23:07 user nova-compute[72820]:     <nova:memory>512</nova:memory>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:disk>1</nova:disk>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:swap>0</nova:swap>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:vcpus>1</nova:vcpus>
Aug 27 02:23:07 user nova-compute[72820]:   </nova:flavor>
Aug 27 02:23:07 user nova-compute[72820]:   <nova:owner>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:user uuid="6d17e388756d462da4e6d144b73085fa">tempest-TaggedAttachmentsTest-634168039-project-member</nova:user>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:project uuid="34aba94505ec4710a8a30e50cae8d4df">tempest-TaggedAttachmentsTest-634168039</nova:project>
Aug 27 02:23:07 user nova-compute[72820]:   </nova:owner>
Aug 27 02:23:07 user nova-compute[72820]:   <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:23:07 user nova-compute[72820]:   <nova:ports>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:port uuid="52e755c8-03a4-4255-a48d-414e0a1ba26a">
Aug 27 02:23:07 user nova-compute[72820]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 02:23:07 user nova-compute[72820]:     </nova:port>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:port uuid="d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f">
Aug 27 02:23:07 user nova-compute[72820]:       <nova:ip type="fixed" address="10.10.10.36" ipVersion="4"/>
Aug 27 02:23:07 user nova-compute[72820]:     </nova:port>
Aug 27 02:23:07 user nova-compute[72820]:   </nova:ports>
Aug 27 02:23:07 user nova-compute[72820]: </nova:instance>
Aug 27 02:23:07 user nova-compute[72820]:   </metadata>
Aug 27 02:23:07 user nova-compute[72820]:   <memory unit='KiB'>524288</memory>
Aug 27 02:23:07 user nova-compute[72820]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 27 02:23:07 user nova-compute[72820]:   <vcpu placement='static'>1</vcpu>
Aug 27 02:23:07 user nova-compute[72820]:   <resource>
Aug 27 02:23:07 user nova-compute[72820]:     <partition>/machine</partition>
Aug 27 02:23:07 user nova-compute[72820]:   </resource>
Aug 27 02:23:07 user nova-compute[72820]:   <sysinfo type='smbios'>
Aug 27 02:23:07 user nova-compute[72820]:     <system>
Aug 27 02:23:07 user nova-compute[72820]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 27 02:23:07 user nova-compute[72820]:       <entry name='product'>OpenStack Nova</entry>
Aug 27 02:23:07 user nova-compute[72820]:       <entry name='version'>0.0.0</entry>
Aug 27 02:23:07 user nova-compute[72820]:       <entry name='serial'>1246d21d-b797-4c76-b282-83e17e6bf06a</entry>
Aug 27 02:23:07 user nova-compute[72820]:       <entry name='uuid'>1246d21d-b797-4c76-b282-83e17e6bf06a</entry>
Aug 27 02:23:07 user nova-compute[72820]:       <entry name='family'>Virtual Machine</entry>
Aug 27 02:23:07 user nova-compute[72820]:     </system>
Aug 27 02:23:07 user nova-compute[72820]:   </sysinfo>
Aug 27 02:23:07 user nova-compute[72820]:   <os>
Aug 27 02:23:07 user nova-compute[72820]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 27 02:23:07 user nova-compute[72820]:     <boot dev='hd'/>
Aug 27 02:23:07 user nova-compute[72820]:     <smbios mode='sysinfo'/>
Aug 27 02:23:07 user nova-compute[72820]:   </os>
Aug 27 02:23:07 user nova-compute[72820]:   <features>
Aug 27 02:23:07 user nova-compute[72820]:     <acpi/>
Aug 27 02:23:07 user nova-compute[72820]:     <apic/>
Aug 27 02:23:07 user nova-compute[72820]:     <vmcoreinfo state='on'/>
Aug 27 02:23:07 user nova-compute[72820]:   </features>
Aug 27 02:23:07 user nova-compute[72820]:   <cpu mode='custom' match='exact' check='full'>
Aug 27 02:23:07 user nova-compute[72820]:     <model fallback='forbid'>Nehalem</model>
Aug 27 02:23:07 user nova-compute[72820]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 27 02:23:07 user nova-compute[72820]:     <feature policy='require' name='vme'/>
Aug 27 02:23:07 user nova-compute[72820]:     <feature policy='require' name='x2apic'/>
Aug 27 02:23:07 user nova-compute[72820]:     <feature policy='require' name='hypervisor'/>
Aug 27 02:23:07 user nova-compute[72820]:   </cpu>
Aug 27 02:23:07 user nova-compute[72820]:   <clock offset='utc'>
Aug 27 02:23:07 user nova-compute[72820]:     <timer name='pit' tickpolicy='delay'/>
Aug 27 02:23:07 user nova-compute[72820]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 27 02:23:07 user nova-compute[72820]:     <timer name='hpet' present='no'/>
Aug 27 02:23:07 user nova-compute[72820]:   </clock>
Aug 27 02:23:07 user nova-compute[72820]:   <on_poweroff>destroy</on_poweroff>
Aug 27 02:23:07 user nova-compute[72820]:   <on_reboot>restart</on_reboot>
Aug 27 02:23:07 user nova-compute[72820]:   <on_crash>destroy</on_crash>
Aug 27 02:23:07 user nova-compute[72820]:   <devices>
Aug 27 02:23:07 user nova-compute[72820]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 02:23:07 user nova-compute[72820]:     <disk type='file' device='disk'>
Aug 27 02:23:07 user nova-compute[72820]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 27 02:23:07 user nova-compute[72820]:       <source file='/opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk' index='2'/>
Aug 27 02:23:07 user nova-compute[72820]:       <backingStore type='file' index='3'>
Aug 27 02:23:07 user nova-compute[72820]:         <format type='raw'/>
Aug 27 02:23:07 user nova-compute[72820]:         <source file='/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d'/>
Aug 27 02:23:07 user nova-compute[72820]:         <backingStore/>
Aug 27 02:23:07 user nova-compute[72820]:       </backingStore>
Aug 27 02:23:07 user nova-compute[72820]:       <target dev='vda' bus='virtio'/>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='virtio-disk0'/>
Aug 27 02:23:07 user nova-compute[72820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </disk>
Aug 27 02:23:07 user nova-compute[72820]:     <disk type='file' device='cdrom'>
Aug 27 02:23:07 user nova-compute[72820]:       <driver name='qemu' type='raw' cache='none'/>
Aug 27 02:23:07 user nova-compute[72820]:       <source file='/opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/disk.config' index='1'/>
Aug 27 02:23:07 user nova-compute[72820]:       <backingStore/>
Aug 27 02:23:07 user nova-compute[72820]:       <target dev='hda' bus='ide'/>
Aug 27 02:23:07 user nova-compute[72820]:       <readonly/>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='ide0-0-0'/>
Aug 27 02:23:07 user nova-compute[72820]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </disk>
Aug 27 02:23:07 user nova-compute[72820]:     <controller type='usb' index='0' model='none'>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='usb'/>
Aug 27 02:23:07 user nova-compute[72820]:     </controller>
Aug 27 02:23:07 user nova-compute[72820]:     <controller type='pci' index='0' model='pci-root'>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='pci.0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </controller>
Aug 27 02:23:07 user nova-compute[72820]:     <controller type='ide' index='0'>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='ide'/>
Aug 27 02:23:07 user nova-compute[72820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 27 02:23:07 user nova-compute[72820]:     </controller>
Aug 27 02:23:07 user nova-compute[72820]:     <interface type='ethernet'>
Aug 27 02:23:07 user nova-compute[72820]:       <mac address='fa:16:3e:50:f4:e0'/>
Aug 27 02:23:07 user nova-compute[72820]:       <target dev='tap52e755c8-03'/>
Aug 27 02:23:07 user nova-compute[72820]:       <model type='virtio'/>
Aug 27 02:23:07 user nova-compute[72820]:       <mtu size='1442'/>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='net0'/>
Aug 27 02:23:07 user nova-compute[72820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </interface>
Aug 27 02:23:07 user nova-compute[72820]:     <serial type='pty'>
Aug 27 02:23:07 user nova-compute[72820]:       <source path='/dev/pts/6'/>
Aug 27 02:23:07 user nova-compute[72820]:       <log file='/opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/console.log' append='off'/>
Aug 27 02:23:07 user nova-compute[72820]:       <target type='isa-serial' port='0'>
Aug 27 02:23:07 user nova-compute[72820]:         <model name='isa-serial'/>
Aug 27 02:23:07 user nova-compute[72820]:       </target>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='serial0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </serial>
Aug 27 02:23:07 user nova-compute[72820]:     <console type='pty' tty='/dev/pts/6'>
Aug 27 02:23:07 user nova-compute[72820]:       <source path='/dev/pts/6'/>
Aug 27 02:23:07 user nova-compute[72820]:       <log file='/opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a/console.log' append='off'/>
Aug 27 02:23:07 user nova-compute[72820]:       <target type='serial' port='0'/>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='serial0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </console>
Aug 27 02:23:07 user nova-compute[72820]:     <input type='mouse' bus='ps2'>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='input0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </input>
Aug 27 02:23:07 user nova-compute[72820]:     <input type='keyboard' bus='ps2'>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='input1'/>
Aug 27 02:23:07 user nova-compute[72820]:     </input>
Aug 27 02:23:07 user nova-compute[72820]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 27 02:23:07 user nova-compute[72820]:       <listen type='address' address='0.0.0.0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </graphics>
Aug 27 02:23:07 user nova-compute[72820]:     <audio id='1' type='none'/>
Aug 27 02:23:07 user nova-compute[72820]:     <video>
Aug 27 02:23:07 user nova-compute[72820]:       <model type='virtio' heads='1' primary='yes'/>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='video0'/>
Aug 27 02:23:07 user nova-compute[72820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </video>
Aug 27 02:23:07 user nova-compute[72820]:     <memballoon model='virtio'>
Aug 27 02:23:07 user nova-compute[72820]:       <stats period='10'/>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='balloon0'/>
Aug 27 02:23:07 user nova-compute[72820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </memballoon>
Aug 27 02:23:07 user nova-compute[72820]:     <rng model='virtio'>
Aug 27 02:23:07 user nova-compute[72820]:       <backend model='random'>/dev/urandom</backend>
Aug 27 02:23:07 user nova-compute[72820]:       <alias name='rng0'/>
Aug 27 02:23:07 user nova-compute[72820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 27 02:23:07 user nova-compute[72820]:     </rng>
Aug 27 02:23:07 user nova-compute[72820]:   </devices>
Aug 27 02:23:07 user nova-compute[72820]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 27 02:23:07 user nova-compute[72820]:     <label>libvirt-1246d21d-b797-4c76-b282-83e17e6bf06a</label>
Aug 27 02:23:07 user nova-compute[72820]:     <imagelabel>libvirt-1246d21d-b797-4c76-b282-83e17e6bf06a</imagelabel>
Aug 27 02:23:07 user nova-compute[72820]:   </seclabel>
Aug 27 02:23:07 user nova-compute[72820]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 27 02:23:07 user nova-compute[72820]:     <label>+64055:+108</label>
Aug 27 02:23:07 user nova-compute[72820]:     <imagelabel>+64055:+108</imagelabel>
Aug 27 02:23:07 user nova-compute[72820]:   </seclabel>
Aug 27 02:23:07 user nova-compute[72820]: </domain>
Aug 27 02:23:07 user nova-compute[72820]:  {{(pid=72820) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 27 02:23:07 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Successfully detached device tapd6ed2ab2-41 from instance 1246d21d-b797-4c76-b282-83e17e6bf06a from the live domain config.
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-763202852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-763202852',id=7,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp8SE+60pO/iSvH/3MlKKhub1Bt3pIV43ycpm9UNaf+uwVjtT/lwbZQdwY4vF2RtnbJSES0rieVwtxnV3XLrYsdPch9SnMxc7EdoRqFhT0gE3l0qDEzBd0M43h/WvHElA==',key_name='tempest-keypair-1710782008',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:20:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34aba94505ec4710a8a30e50cae8d4df',ramdisk_id='',reservation_id='r-vu1svk2a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-634168039',owner_user_name='tempest-TaggedAttachmentsTest-634168039-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d17e388756d462da4e6d144b73085fa',uuid=1246d21d-b797-4c76-b282-83e17e6bf06a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "address": "fa:16:3e:a2:70:e9", "network": {"id": "3457fd89-273d-40a6-a830-f74984c0170c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1985262322", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ed2ab2-41", "ovs_interfaceid": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Converting VIF {"id": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "address": "fa:16:3e:a2:70:e9", "network": {"id": "3457fd89-273d-40a6-a830-f74984c0170c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1985262322", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ed2ab2-41", "ovs_interfaceid": "d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f,network=Network(3457fd89-273d-40a6-a830-f74984c0170c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ed2ab2-41') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG os_vif [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f,network=Network(3457fd89-273d-40a6-a830-f74984c0170c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ed2ab2-41') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6ed2ab2-41, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:07 user nova-compute[72820]: INFO os_vif [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:70:e9,bridge_name='br-int',has_traffic_filtering=True,id=d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f,network=Network(3457fd89-273d-40a6-a830-f74984c0170c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ed2ab2-41')
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:23:07 user nova-compute[72820]:   <nova:package version="0.0.0"/>
Aug 27 02:23:07 user nova-compute[72820]:   <nova:name>tempest-device-tagging-server-763202852</nova:name>
Aug 27 02:23:07 user nova-compute[72820]:   <nova:creationTime>2023-08-27 02:23:07</nova:creationTime>
Aug 27 02:23:07 user nova-compute[72820]:   <nova:flavor name="m1.tiny">
Aug 27 02:23:07 user nova-compute[72820]:     <nova:memory>512</nova:memory>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:disk>1</nova:disk>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:swap>0</nova:swap>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:vcpus>1</nova:vcpus>
Aug 27 02:23:07 user nova-compute[72820]:   </nova:flavor>
Aug 27 02:23:07 user nova-compute[72820]:   <nova:owner>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:user uuid="6d17e388756d462da4e6d144b73085fa">tempest-TaggedAttachmentsTest-634168039-project-member</nova:user>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:project uuid="34aba94505ec4710a8a30e50cae8d4df">tempest-TaggedAttachmentsTest-634168039</nova:project>
Aug 27 02:23:07 user nova-compute[72820]:   </nova:owner>
Aug 27 02:23:07 user nova-compute[72820]:   <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:23:07 user nova-compute[72820]:   <nova:ports>
Aug 27 02:23:07 user nova-compute[72820]:     <nova:port uuid="52e755c8-03a4-4255-a48d-414e0a1ba26a">
Aug 27 02:23:07 user nova-compute[72820]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 02:23:07 user nova-compute[72820]:     </nova:port>
Aug 27 02:23:07 user nova-compute[72820]:   </nova:ports>
Aug 27 02:23:07 user nova-compute[72820]: </nova:instance>
Aug 27 02:23:07 user nova-compute[72820]:  {{(pid=72820) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ac4bdeca-2ca1-4b79-8e49-495acc597fa7 tempest-AttachSCSIVolumeTestJSON-65283222 tempest-AttachSCSIVolumeTestJSON-65283222-project-member] Lock "8ae21d01-4c7c-4926-9868-cf8786e59d4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.166s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 26581695-c4b9-40b8-ab7a-34c99db0dadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f8f612f3-41c9-4dae-8d49-218d61720b15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6ed3c12e-96a8-4a32-8089-f04eba608663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1246d21d-b797-4c76-b282-83e17e6bf06a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance abe48a87-2a54-468d-98e5-afae2577e541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 0d99438e-e6d1-4fc3-a399-7e844c8f9538 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance c0644b77-33ce-46e4-a6cb-b6322bdc6a9e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 717fb1d8-6d09-440b-bc50-7132a8ebe8d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:23:07 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:23:08 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:23:08 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:23:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-fd458bb0-1e42-409a-9d60-21e709059200 req-5394c310-ab8a-4b78-8dac-3f3ffafb2be0 service nova] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Received event network-vif-deleted-82d087af-c0f8-4c88-904c-4afbf9c5239d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:23:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-fd458bb0-1e42-409a-9d60-21e709059200 req-5394c310-ab8a-4b78-8dac-3f3ffafb2be0 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received event network-vif-unplugged-d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:23:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fd458bb0-1e42-409a-9d60-21e709059200 req-5394c310-ab8a-4b78-8dac-3f3ffafb2be0 service nova] Acquiring lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fd458bb0-1e42-409a-9d60-21e709059200 req-5394c310-ab8a-4b78-8dac-3f3ffafb2be0 service nova] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fd458bb0-1e42-409a-9d60-21e709059200 req-5394c310-ab8a-4b78-8dac-3f3ffafb2be0 service nova] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-fd458bb0-1e42-409a-9d60-21e709059200 req-5394c310-ab8a-4b78-8dac-3f3ffafb2be0 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] No waiting events found dispatching network-vif-unplugged-d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:23:08 user nova-compute[72820]: WARNING nova.compute.manager [req-fd458bb0-1e42-409a-9d60-21e709059200 req-5394c310-ab8a-4b78-8dac-3f3ffafb2be0 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received unexpected event network-vif-unplugged-d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f for instance with vm_state active and task_state None.
Aug 27 02:23:08 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:23:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "refresh_cache-1246d21d-b797-4c76-b282-83e17e6bf06a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquired lock "refresh_cache-1246d21d-b797-4c76-b282-83e17e6bf06a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG nova.network.neutron [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CuLbnXjQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:23:09 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:23:09 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:23:09 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[622e92e7-1663-4521-b322-112ce27051bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:23:09 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[630783ca-f37f-476d-af78-7a6dab652e3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32] added
Aug 27 02:23:09 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d731565a-a56e-4812-9bf5-a75f1856f718]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73698dc-a5a9-4bf5-9582-d7df84860705]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CuLbnXjQ {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CuLbnXjQ" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e835c1-a4f8-4f8b-8617-abd2ab1cc4fe]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CuLbnXjQ'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-f8f612f3-41c9-4dae-8d49-218d61720b15" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-f8f612f3-41c9-4dae-8d49-218d61720b15" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37891eb-24fc-4265-aea7-b99244f1c0dd]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1ac7bf-809e-414e-9dab-0bea8ecedc3f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:09 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:09 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:09 user nova-compute[72820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:09 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:09 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:09 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:09 user nova-compute[72820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:09 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f2ffac-09af-478f-965b-be2a4119fa23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32, portal: 172.16.0.220,3260]
Aug 27 02:23:09 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32, portal: 172.16.0.220,3260] successful.
Aug 27 02:23:09 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ba972d-98e0-487b-8a30-c878f05b57a7]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f72710-ea35-4494-8b7f-0f9345e670d9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 (non-flash)
Aug 27 02:23:09 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:09 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:09 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:09 user nova-compute[72820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:09 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 (non-flash)
Aug 27 02:23:09 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:09 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:09 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:09 user nova-compute[72820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:09 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaf2219-b340-4e8b-8a6f-73adb92d0d8b]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CuLbnXjQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:23:09 user nova-compute[72820]: INFO nova.network.neutron [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Port d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 27 02:23:09 user nova-compute[72820]: DEBUG nova.network.neutron [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Updating instance_info_cache with network_info: [{"id": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "address": "fa:16:3e:50:f4:e0", "network": {"id": "acc49577-9bcb-4da3-ad31-4ecf60e14ce6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2140276278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e755c8-03", "ovs_interfaceid": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Releasing lock "refresh_cache-1246d21d-b797-4c76-b282-83e17e6bf06a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4be4e5b9-5d76-48be-ab80-7af6fd7617b9 tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "interface-1246d21d-b797-4c76-b282-83e17e6bf06a-d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.307s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Updating instance_info_cache with network_info: [{"id": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "address": "fa:16:3e:64:42:e4", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c62328f-29", "ovs_interfaceid": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-f8f612f3-41c9-4dae-8d49-218d61720b15" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:23:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:23:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-ebc04965-d117-4fac-970c-1f9559156992 req-94f64732-58ae-4963-b051-5cf528a3d754 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received event network-vif-plugged-d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:23:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ebc04965-d117-4fac-970c-1f9559156992 req-94f64732-58ae-4963-b051-5cf528a3d754 service nova] Acquiring lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ebc04965-d117-4fac-970c-1f9559156992 req-94f64732-58ae-4963-b051-5cf528a3d754 service nova] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ebc04965-d117-4fac-970c-1f9559156992 req-94f64732-58ae-4963-b051-5cf528a3d754 service nova] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-ebc04965-d117-4fac-970c-1f9559156992 req-94f64732-58ae-4963-b051-5cf528a3d754 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] No waiting events found dispatching network-vif-plugged-d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:23:10 user nova-compute[72820]: WARNING nova.compute.manager [req-ebc04965-d117-4fac-970c-1f9559156992 req-94f64732-58ae-4963-b051-5cf528a3d754 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received unexpected event network-vif-plugged-d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f for instance with vm_state active and task_state None.
Aug 27 02:23:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-ebc04965-d117-4fac-970c-1f9559156992 req-94f64732-58ae-4963-b051-5cf528a3d754 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received event network-vif-deleted-d6ed2ab2-41ec-4aa1-9f04-d638d4cde94f {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:23:10 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:23:10 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23935623539373133', 'path': '/dev/sdf'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:23:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935623539373133', 'path': '/dev/sdf'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:23:10 user nova-compute[72820]: DEBUG nova.objects.instance [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Lazy-loading 'flavor' on Instance uuid 0d99438e-e6d1-4fc3-a399-7e844c8f9538 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:23:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] attach device xml: <disk type="block" device="disk">
Aug 27 02:23:10 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:23:10 user nova-compute[72820]:   <source dev="/dev/sdf"/>
Aug 27 02:23:10 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:23:10 user nova-compute[72820]:   <serial>417fed4f-e7d6-481f-b5fd-32679b52fd32</serial>
Aug 27 02:23:10 user nova-compute[72820]: </disk>
Aug 27 02:23:10 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:23:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:23:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:23:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] No VIF found with MAC fa:16:3e:80:50:5b, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:23:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-648d407e-f89e-49f1-8a41-9c03b66aba9c tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.815s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-042c5f90-ce22-4718-8f24-44cfb870f316 tempest-VolumesAssistedSnapshotsTest-1857374018 tempest-VolumesAssistedSnapshotsTest-1857374018-project] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] volume_snapshot_create: create_info: {'snapshot_id': 'b493f09e-5582-423e-a5cc-642c5b0da7f7', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72820) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 27 02:23:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-042c5f90-ce22-4718-8f24-44cfb870f316 tempest-VolumesAssistedSnapshotsTest-1857374018 tempest-VolumesAssistedSnapshotsTest-1857374018-project] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] snap xml: <domainsnapshot>
Aug 27 02:23:12 user nova-compute[72820]:   <disks>
Aug 27 02:23:12 user nova-compute[72820]:     <disk name="/dev/sdf" snapshot="external" type="file">
Aug 27 02:23:12 user nova-compute[72820]:       <source file="/dev/new_file"/>
Aug 27 02:23:12 user nova-compute[72820]:     </disk>
Aug 27 02:23:12 user nova-compute[72820]:     <disk name="vda" snapshot="no"/>
Aug 27 02:23:12 user nova-compute[72820]:   </disks>
Aug 27 02:23:12 user nova-compute[72820]: </domainsnapshot>
Aug 27 02:23:12 user nova-compute[72820]:  {{(pid=72820) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 27 02:23:12 user nova-compute[72820]: DEBUG nova.objects.instance [None req-042c5f90-ce22-4718-8f24-44cfb870f316 tempest-VolumesAssistedSnapshotsTest-1857374018 tempest-VolumesAssistedSnapshotsTest-1857374018-project] Lazy-loading 'system_metadata' on Instance uuid 0d99438e-e6d1-4fc3-a399-7e844c8f9538 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:23:12 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-042c5f90-ce22-4718-8f24-44cfb870f316 tempest-VolumesAssistedSnapshotsTest-1857374018 tempest-VolumesAssistedSnapshotsTest-1857374018-project] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [None req-042c5f90-ce22-4718-8f24-44cfb870f316 tempest-VolumesAssistedSnapshotsTest-1857374018 tempest-VolumesAssistedSnapshotsTest-1857374018-project] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Traceback (most recent call last):
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     rv = execute(f, *args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     six.reraise(c, e, tb)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     raise value
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     rv = meth(*args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] 
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [None req-042c5f90-ce22-4718-8f24-44cfb870f316 tempest-VolumesAssistedSnapshotsTest-1857374018 tempest-VolumesAssistedSnapshotsTest-1857374018-project] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Traceback (most recent call last):
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     self._volume_snapshot_create(context, instance, guest,
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     rv = execute(f, *args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     six.reraise(c, e, tb)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     raise value
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     rv = meth(*args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] 
Aug 27 02:23:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c60dc76f-9373-46b1-a970-4580110cd506 tempest-VolumesAssistedSnapshotsTest-1857374018 tempest-VolumesAssistedSnapshotsTest-1857374018-project] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] volume_snapshot_delete: delete_info: {'volume_id': '417fed4f-e7d6-481f-b5fd-32679b52fd32'} {{(pid=72820) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [None req-c60dc76f-9373-46b1-a970-4580110cd506 tempest-VolumesAssistedSnapshotsTest-1857374018 tempest-VolumesAssistedSnapshotsTest-1857374018-project] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Traceback (most recent call last):
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538]     if delete_info['type'] != 'qcow2':
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] KeyError: 'type'
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] 
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [None req-042c5f90-ce22-4718-8f24-44cfb870f316 tempest-VolumesAssistedSnapshotsTest-1857374018 tempest-VolumesAssistedSnapshotsTest-1857374018-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot b493f09e-5582-423e-a5cc-642c5b0da7f7 could not be found.
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     raise value
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver 
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver 
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot b493f09e-5582-423e-a5cc-642c5b0da7f7 could not be found. (HTTP 404) (Request-ID: req-8484155f-bdf7-4382-8d81-ab93b6fd6757)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver 
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver 
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot b493f09e-5582-423e-a5cc-642c5b0da7f7 could not be found.
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver 
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver [None req-c60dc76f-9373-46b1-a970-4580110cd506 tempest-VolumesAssistedSnapshotsTest-1857374018 tempest-VolumesAssistedSnapshotsTest-1857374018-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver 
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver 
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-074f18b3-315a-4784-a191-0b86870efd54)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver 
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver 
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 27 02:23:12 user nova-compute[72820]: ERROR nova.virt.libvirt.driver 
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server [None req-042c5f90-ce22-4718-8f24-44cfb870f316 tempest-VolumesAssistedSnapshotsTest-1857374018 tempest-VolumesAssistedSnapshotsTest-1857374018-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     raise value
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server 
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server [None req-c60dc76f-9373-46b1-a970-4580110cd506 tempest-VolumesAssistedSnapshotsTest-1857374018 tempest-VolumesAssistedSnapshotsTest-1857374018-project] Exception during message handling: KeyError: 'type'
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 27 02:23:12 user nova-compute[72820]: ERROR oslo_messaging.rpc.server 
Aug 27 02:23:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Acquiring lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:12 user nova-compute[72820]: INFO nova.compute.manager [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Detaching volume 417fed4f-e7d6-481f-b5fd-32679b52fd32
Aug 27 02:23:12 user nova-compute[72820]: INFO nova.virt.block_device [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Attempting to driver detach volume 417fed4f-e7d6-481f-b5fd-32679b52fd32 from mountpoint /dev/vdb
Aug 27 02:23:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Attempting to detach device vdb from instance 0d99438e-e6d1-4fc3-a399-7e844c8f9538 from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:23:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] detach device xml: <disk type="block" device="disk">
Aug 27 02:23:12 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:23:12 user nova-compute[72820]:   <source dev="/dev/sdf"/>
Aug 27 02:23:12 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:23:12 user nova-compute[72820]:   <serial>417fed4f-e7d6-481f-b5fd-32679b52fd32</serial>
Aug 27 02:23:12 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:23:12 user nova-compute[72820]: </disk>
Aug 27 02:23:12 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:23:12 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Successfully detached device vdb from instance 0d99438e-e6d1-4fc3-a399-7e844c8f9538 from the persistent domain config.
Aug 27 02:23:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d99438e-e6d1-4fc3-a399-7e844c8f9538 from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:23:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] detach device xml: <disk type="block" device="disk">
Aug 27 02:23:12 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:23:12 user nova-compute[72820]:   <source dev="/dev/sdf"/>
Aug 27 02:23:12 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:23:12 user nova-compute[72820]:   <serial>417fed4f-e7d6-481f-b5fd-32679b52fd32</serial>
Aug 27 02:23:12 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:23:12 user nova-compute[72820]: </disk>
Aug 27 02:23:12 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:23:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693102993.4659784, 0d99438e-e6d1-4fc3-a399-7e844c8f9538 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d99438e-e6d1-4fc3-a399-7e844c8f9538 {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:23:13 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Successfully detached device vdb from instance 0d99438e-e6d1-4fc3-a399-7e844c8f9538 from the live domain config.
Aug 27 02:23:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CuLbnXjQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:23:13 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a65f26-2afc-48c6-9c00-fd65cbb694e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:23:13 user nova-compute[72820]: No targets found.
Aug 27 02:23:13 user nova-compute[72820]: iSNS:
Aug 27 02:23:13 user nova-compute[72820]: No targets found.
Aug 27 02:23:13 user nova-compute[72820]: STATIC:
Aug 27 02:23:13 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32
Aug 27 02:23:13 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:13 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:13 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341
Aug 27 02:23:13 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:13 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:13 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b
Aug 27 02:23:13 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:13 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:13 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633
Aug 27 02:23:13 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:13 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:13 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902
Aug 27 02:23:13 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:13 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:13 user nova-compute[72820]: FIRMWARE:
Aug 27 02:23:13 user nova-compute[72820]: No targets found.
Aug 27 02:23:13 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:23:13 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:23:13 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb873ec-b59c-4b28-ac65-f1be9fb851e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[82602cac-22fe-4b30-9872-40713b6d6391]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 (non-flash)
Aug 27 02:23:13 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:13 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:13 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:13 user nova-compute[72820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:13 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 (non-flash)
Aug 27 02:23:13 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:13 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:13 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:13 user nova-compute[72820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:13 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c0699c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32'): ({'sdf'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Removing single pathed devices sdf {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e567566-e0db-40fb-82d6-341c5bb337b3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0eec51-9504-427b-96d2-320b35b953f9]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Flushing IO for device /dev/sdf {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e82071d-5fab-429a-a8bc-5b90b91275cf]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[31baebed-c979-44c6-b252-b16339f7252d]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] SCSI volumes sdf have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2536cd-2640-401e-bcf7-2397dd44c068]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[176d6356-5acf-4348-964e-b028bf4b31f5]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32, portal: 172.16.0.220,3260]
Aug 27 02:23:13 user nova-compute[72820]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32, portal: 172.16.0.220,3260] successful.
Aug 27 02:23:13 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417fed4f-e7d6-481f-b5fd-32679b52fd32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b1f190-8d2e-484a-b0c8-53d62a7bb57d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] <== disconnect_volume: return (366ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:23:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:23:14 user nova-compute[72820]: DEBUG nova.objects.instance [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Lazy-loading 'flavor' on Instance uuid 0d99438e-e6d1-4fc3-a399-7e844c8f9538 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:23:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-869dc4c0-42fb-456b-b175-b592ac09ce33 tempest-VolumesAssistedSnapshotsTest-117154335 tempest-VolumesAssistedSnapshotsTest-117154335-project-admin] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.022s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:19 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693102984.4542158, 8ae21d01-4c7c-4926-9868-cf8786e59d4d => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:23:19 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] VM Stopped (Lifecycle Event)
Aug 27 02:23:19 user nova-compute[72820]: DEBUG nova.compute.manager [None req-de0b71be-9628-4b50-ac83-8a9826a76380 None None] [instance: 8ae21d01-4c7c-4926-9868-cf8786e59d4d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:23:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:23:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:23:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:23:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:23:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] [instance: abe48a87-2a54-468d-98e5-afae2577e541] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrZhgeJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'abe48a87-2a54-468d-98e5-afae2577e541', 'attached_at': '', 'detached_at': '', 'volume_id': '1050330c-df37-4ba2-af96-abc58bc63532', 'serial': '1050330c-df37-4ba2-af96-abc58bc63532'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJFHraCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'abe48a87-2a54-468d-98e5-afae2577e541', 'attached_at': '', 'detached_at': '', 'volume_id': 'b19cea99-e9a2-4f33-bf1c-761bbfa0b902', 'serial'} {{(pid=72820) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrZhgeJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:23:31 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:23:31 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:23:31 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2016f2a-2a7b-4936-ab3d-fec9ed2e2a14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:23:31 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd54e2d-5aef-4def-ad89-94dce89873f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532] added
Aug 27 02:23:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ea7651-1fee-4fe2-8735-47af13f5b32e]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec8d1d7-5979-48bc-a6ac-9b2db96ca657]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrZhgeJO {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrZhgeJO" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b51704b-0c66-4c02-ac47-6405bdf3af9d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HrZhgeJO'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[22942103-d7b9-47bd-b01e-ccb71dba05fd]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0968d45-e9bd-4166-bde3-f54a879a4d10]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:31 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:31 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:31 user nova-compute[72820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:31 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:31 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:31 user nova-compute[72820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e54f830-4dd8-4c58-b1ae-906548b4e916]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532, portal: 172.16.0.220,3260]
Aug 27 02:23:31 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532, portal: 172.16.0.220,3260] successful.
Aug 27 02:23:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[94225164-6466-4022-b04f-6dcc76a17681]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b1657a-391e-40d9-bcfa-78f690c40a18]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 (non-flash)
Aug 27 02:23:31 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:31 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:31 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:31 user nova-compute[72820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 (non-flash)
Aug 27 02:23:31 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:31 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:31 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:31 user nova-compute[72820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[80be5ce5-135b-4dee-8427-fc3edbee4de1]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:23:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrZhgeJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:23:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:23:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23564326437643734', 'path': '/dev/sdf'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:23:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564326437643734', 'path': '/dev/sdf'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:23:32 user nova-compute[72820]: DEBUG nova.objects.instance [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Lazy-loading 'flavor' on Instance uuid abe48a87-2a54-468d-98e5-afae2577e541 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:23:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:23:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] COPY block job progress, current cursor: 188743680 final cursor: 1073741824 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:23:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] COPY block job progress, current cursor: 322961408 final cursor: 1073741824 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:23:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] COPY block job progress, current cursor: 475004928 final cursor: 1073741824 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:23:35 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] COPY block job progress, current cursor: 612368384 final cursor: 1073741824 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:23:35 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] COPY block job progress, current cursor: 705691648 final cursor: 1073741824 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:23:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] COPY block job progress, current cursor: 873463808 final cursor: 1073741824 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:23:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] COPY block job progress, current cursor: 1033895936 final cursor: 1073741824 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] [instance: abe48a87-2a54-468d-98e5-afae2577e541] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJFHraCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:23:37 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1d6320-86ce-4b1f-a4ee-22a32a3b2406]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:23:37 user nova-compute[72820]: No targets found.
Aug 27 02:23:37 user nova-compute[72820]: iSNS:
Aug 27 02:23:37 user nova-compute[72820]: No targets found.
Aug 27 02:23:37 user nova-compute[72820]: STATIC:
Aug 27 02:23:37 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341
Aug 27 02:23:37 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:37 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:37 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b
Aug 27 02:23:37 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:37 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:37 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633
Aug 27 02:23:37 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:37 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:37 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902
Aug 27 02:23:37 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:37 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:37 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532
Aug 27 02:23:37 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:37 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:37 user nova-compute[72820]: FIRMWARE:
Aug 27 02:23:37 user nova-compute[72820]: No targets found.
Aug 27 02:23:37 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:23:37 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:23:37 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1753b8c-b4d0-44d3-9381-e8a3db2a50bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[78616b74-dedc-4729-b366-a887be2f91d2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 (non-flash)
Aug 27 02:23:37 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:37 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:37 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:37 user nova-compute[72820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:37 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 (non-flash)
Aug 27 02:23:37 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:37 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:37 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:37 user nova-compute[72820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:37 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c02dbb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902'): ({'sdd'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Removing single pathed devices sdd {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5e9c34-e534-4d3a-a9b9-2032f81b108f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[087573ea-9481-43a8-bfc3-2f139015aafe]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Flushing IO for device /dev/sdd {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee73586e-233c-4419-9d4c-7988552f2ab5]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b664b13-9b9b-4d65-9aa8-a5a10a654b4c]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[61901956-d7af-4ffe-9c08-1e7525fbf3fc]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b111c035-31a2-48bb-a145-bde0fe94d200]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902, portal: 172.16.0.220,3260]
Aug 27 02:23:37 user nova-compute[72820]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902, portal: 172.16.0.220,3260] successful.
Aug 27 02:23:37 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40a8efe-46e0-4de7-a055-6c6275f9217d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] <== disconnect_volume: return (347ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrZhgeJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'abe48a87-2a54-468d-98e5-afae2577e541', 'attached_at': '', 'detached_at': '', 'volume_id': '1050330c-df37-4ba2-af96-abc58bc63532', 'serial'} {{(pid=72820) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] [instance: abe48a87-2a54-468d-98e5-afae2577e541] swap_volume: removing Cinder connection for volume b19cea99-e9a2-4f33-bf1c-761bbfa0b902 {{(pid=72820) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 27 02:23:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:38 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] [instance: abe48a87-2a54-468d-98e5-afae2577e541] swap_volume: Updating volume b19cea99-e9a2-4f33-bf1c-761bbfa0b902 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "HrZhgeJO", "auth_password": "8BIV0f4XymgeO7", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "1050330c-df37-4ba2-af96-abc58bc63532"}, "status": "reserved", "instance": "abe48a87-2a54-468d-98e5-afae2577e541", "attached_at": "", "detached_at": "", "volume_id": "1050330c-df37-4ba2-af96-abc58bc63532", "serial": "1050330c-df37-4ba2-af96-abc58bc63532"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '1050330c-df37-4ba2-af96-abc58bc63532', 'no_device': None, 'attachment_id': 'b4bf3c6c-155d-45de-9701-6b8927ef7266'} {{(pid=72820) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 27 02:23:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b4da60c-98ce-430a-aae3-e28cc556a6e4 tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Lock "abe48a87-2a54-468d-98e5-afae2577e541" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 31.095s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Acquiring lock "abe48a87-2a54-468d-98e5-afae2577e541" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Lock "abe48a87-2a54-468d-98e5-afae2577e541" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.003s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:39 user nova-compute[72820]: DEBUG os_brick.utils [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:23:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:39 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b84f96-2562-43ea-a38a-fca499c3fef9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:39 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89e3aae-06cb-41f7-b015-19ead1b59b93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:39 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd12c14-9bb9-4169-a5c1-5ce7f519ac53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:39 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[404f98fd-3da3-48a5-bc90-a9f827ae98c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:23:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:23:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:23:40 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:23:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abc9523-5c02-40ed-bcd1-34dc75b5f271]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:23:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:23:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:23:40 user nova-compute[72820]: DEBUG os_brick.utils [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:23:40 user nova-compute[72820]: INFO nova.compute.manager [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Swapping volume 1050330c-df37-4ba2-af96-abc58bc63532 for b19cea99-e9a2-4f33-bf1c-761bbfa0b902
Aug 27 02:23:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:23:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:48 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:23:48 user nova-compute[72820]: INFO nova.compute.claims [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Claim successful on node user
Aug 27 02:23:48 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:23:48 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:23:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:23:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:23:48 user nova-compute[72820]: DEBUG nova.network.neutron [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:23:48 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:23:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG nova.policy [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb67e11ecdd648a89dd58b4bf416060a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f023daf1767f4088bf0a23524587e662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG nova.compute.manager [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:23:49 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Creating image(s)
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "/opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "/opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.245s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.197s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk 1073741824" returned: 0 in 0.049s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.197s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Cannot resize image /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Ensure instance console log exists: /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Successfully created port: b330a8f4-0812-4964-bd70-10d41689406a {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:23:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Successfully updated port: b330a8f4-0812-4964-bd70-10d41689406a {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:23:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "refresh_cache-f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:23:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquired lock "refresh_cache-f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:23:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:23:50 user nova-compute[72820]: DEBUG nova.compute.manager [req-42e919e6-4677-4311-8980-a76d0426f1f1 req-9a08739e-14c5-468d-83de-5a44f63170e8 service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Received event network-changed-b330a8f4-0812-4964-bd70-10d41689406a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:23:50 user nova-compute[72820]: DEBUG nova.compute.manager [req-42e919e6-4677-4311-8980-a76d0426f1f1 req-9a08739e-14c5-468d-83de-5a44f63170e8 service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Refreshing instance network info cache due to event network-changed-b330a8f4-0812-4964-bd70-10d41689406a. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:23:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-42e919e6-4677-4311-8980-a76d0426f1f1 req-9a08739e-14c5-468d-83de-5a44f63170e8 service nova] Acquiring lock "refresh_cache-f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:23:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.network.neutron [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Updating instance_info_cache with network_info: [{"id": "b330a8f4-0812-4964-bd70-10d41689406a", "address": "fa:16:3e:a4:9d:95", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb330a8f4-08", "ovs_interfaceid": "b330a8f4-0812-4964-bd70-10d41689406a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Releasing lock "refresh_cache-f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.compute.manager [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Instance network_info: |[{"id": "b330a8f4-0812-4964-bd70-10d41689406a", "address": "fa:16:3e:a4:9d:95", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb330a8f4-08", "ovs_interfaceid": "b330a8f4-0812-4964-bd70-10d41689406a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-42e919e6-4677-4311-8980-a76d0426f1f1 req-9a08739e-14c5-468d-83de-5a44f63170e8 service nova] Acquired lock "refresh_cache-f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.network.neutron [req-42e919e6-4677-4311-8980-a76d0426f1f1 req-9a08739e-14c5-468d-83de-5a44f63170e8 service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Refreshing network info cache for port b330a8f4-0812-4964-bd70-10d41689406a {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Start _get_guest_xml network_info=[{"id": "b330a8f4-0812-4964-bd70-10d41689406a", "address": "fa:16:3e:a4:9d:95", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb330a8f4-08", "ovs_interfaceid": "b330a8f4-0812-4964-bd70-10d41689406a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:23:51 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:23:51 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2054462033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2054462033',id=12,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f023daf1767f4088bf0a23524587e662',ramdisk_id='',reservation_id='r-tco0mpab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:23:49Z,user_data=None,user_id='bb67e11ecdd648a89dd58b4bf416060a',uuid=f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b330a8f4-0812-4964-bd70-10d41689406a", "address": "fa:16:3e:a4:9d:95", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb330a8f4-08", "ovs_interfaceid": "b330a8f4-0812-4964-bd70-10d41689406a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converting VIF {"id": "b330a8f4-0812-4964-bd70-10d41689406a", "address": "fa:16:3e:a4:9d:95", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb330a8f4-08", "ovs_interfaceid": "b330a8f4-0812-4964-bd70-10d41689406a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9d:95,bridge_name='br-int',has_traffic_filtering=True,id=b330a8f4-0812-4964-bd70-10d41689406a,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb330a8f4-08') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.objects.instance [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'pci_devices' on Instance uuid f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:23:51 user nova-compute[72820]:   <uuid>f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3</uuid>
Aug 27 02:23:51 user nova-compute[72820]:   <name>instance-0000000c</name>
Aug 27 02:23:51 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:23:51 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:23:51 user nova-compute[72820]:   <metadata>
Aug 27 02:23:51 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:23:51 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:23:51 user nova-compute[72820]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2054462033</nova:name>
Aug 27 02:23:51 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:23:51</nova:creationTime>
Aug 27 02:23:51 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:23:51 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:23:51 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:23:51 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:23:51 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:23:51 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:23:51 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:23:51 user nova-compute[72820]:       <nova:owner>
Aug 27 02:23:51 user nova-compute[72820]:         <nova:user uuid="bb67e11ecdd648a89dd58b4bf416060a">tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member</nova:user>
Aug 27 02:23:51 user nova-compute[72820]:         <nova:project uuid="f023daf1767f4088bf0a23524587e662">tempest-ServerBootFromVolumeStableRescueTest-2088708325</nova:project>
Aug 27 02:23:51 user nova-compute[72820]:       </nova:owner>
Aug 27 02:23:51 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:23:51 user nova-compute[72820]:       <nova:ports>
Aug 27 02:23:51 user nova-compute[72820]:         <nova:port uuid="b330a8f4-0812-4964-bd70-10d41689406a">
Aug 27 02:23:51 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 02:23:51 user nova-compute[72820]:         </nova:port>
Aug 27 02:23:51 user nova-compute[72820]:       </nova:ports>
Aug 27 02:23:51 user nova-compute[72820]:     </nova:instance>
Aug 27 02:23:51 user nova-compute[72820]:   </metadata>
Aug 27 02:23:51 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:23:51 user nova-compute[72820]:     <system>
Aug 27 02:23:51 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:23:51 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:23:51 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:23:51 user nova-compute[72820]:       <entry name="serial">f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3</entry>
Aug 27 02:23:51 user nova-compute[72820]:       <entry name="uuid">f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3</entry>
Aug 27 02:23:51 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:23:51 user nova-compute[72820]:     </system>
Aug 27 02:23:51 user nova-compute[72820]:   </sysinfo>
Aug 27 02:23:51 user nova-compute[72820]:   <os>
Aug 27 02:23:51 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:23:51 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:23:51 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:23:51 user nova-compute[72820]:   </os>
Aug 27 02:23:51 user nova-compute[72820]:   <features>
Aug 27 02:23:51 user nova-compute[72820]:     <acpi/>
Aug 27 02:23:51 user nova-compute[72820]:     <apic/>
Aug 27 02:23:51 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:23:51 user nova-compute[72820]:   </features>
Aug 27 02:23:51 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:23:51 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:23:51 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:23:51 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:23:51 user nova-compute[72820]:   </clock>
Aug 27 02:23:51 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:23:51 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:23:51 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:23:51 user nova-compute[72820]:   </cpu>
Aug 27 02:23:51 user nova-compute[72820]:   <devices>
Aug 27 02:23:51 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:23:51 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:23:51 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk"/>
Aug 27 02:23:51 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:23:51 user nova-compute[72820]:     </disk>
Aug 27 02:23:51 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:23:51 user nova-compute[72820]:       <mac address="fa:16:3e:a4:9d:95"/>
Aug 27 02:23:51 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:23:51 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:23:51 user nova-compute[72820]:       <target dev="tapb330a8f4-08"/>
Aug 27 02:23:51 user nova-compute[72820]:     </interface>
Aug 27 02:23:51 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:23:51 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/console.log" append="off"/>
Aug 27 02:23:51 user nova-compute[72820]:     </serial>
Aug 27 02:23:51 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:23:51 user nova-compute[72820]:     <video>
Aug 27 02:23:51 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:23:51 user nova-compute[72820]:     </video>
Aug 27 02:23:51 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:23:51 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:23:51 user nova-compute[72820]:     </rng>
Aug 27 02:23:51 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:23:51 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:23:51 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:23:51 user nova-compute[72820]:     </memballoon>
Aug 27 02:23:51 user nova-compute[72820]:   </devices>
Aug 27 02:23:51 user nova-compute[72820]: </domain>
Aug 27 02:23:51 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2054462033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2054462033',id=12,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f023daf1767f4088bf0a23524587e662',ramdisk_id='',reservation_id='r-tco0mpab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:23:49Z,user_data=None,user_id='bb67e11ecdd648a89dd58b4bf416060a',uuid=f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b330a8f4-0812-4964-bd70-10d41689406a", "address": "fa:16:3e:a4:9d:95", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb330a8f4-08", "ovs_interfaceid": "b330a8f4-0812-4964-bd70-10d41689406a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converting VIF {"id": "b330a8f4-0812-4964-bd70-10d41689406a", "address": "fa:16:3e:a4:9d:95", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb330a8f4-08", "ovs_interfaceid": "b330a8f4-0812-4964-bd70-10d41689406a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9d:95,bridge_name='br-int',has_traffic_filtering=True,id=b330a8f4-0812-4964-bd70-10d41689406a,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb330a8f4-08') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG os_vif [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9d:95,bridge_name='br-int',has_traffic_filtering=True,id=b330a8f4-0812-4964-bd70-10d41689406a,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb330a8f4-08') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb330a8f4-08, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb330a8f4-08, col_values=(('external_ids', {'iface-id': 'b330a8f4-0812-4964-bd70-10d41689406a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:9d:95', 'vm-uuid': 'f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:51 user nova-compute[72820]: INFO os_vif [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9d:95,bridge_name='br-int',has_traffic_filtering=True,id=b330a8f4-0812-4964-bd70-10d41689406a,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb330a8f4-08')
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] No VIF found with MAC fa:16:3e:a4:9d:95, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.network.neutron [req-42e919e6-4677-4311-8980-a76d0426f1f1 req-9a08739e-14c5-468d-83de-5a44f63170e8 service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Updated VIF entry in instance network info cache for port b330a8f4-0812-4964-bd70-10d41689406a. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG nova.network.neutron [req-42e919e6-4677-4311-8980-a76d0426f1f1 req-9a08739e-14c5-468d-83de-5a44f63170e8 service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Updating instance_info_cache with network_info: [{"id": "b330a8f4-0812-4964-bd70-10d41689406a", "address": "fa:16:3e:a4:9d:95", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb330a8f4-08", "ovs_interfaceid": "b330a8f4-0812-4964-bd70-10d41689406a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-42e919e6-4677-4311-8980-a76d0426f1f1 req-9a08739e-14c5-468d-83de-5a44f63170e8 service nova] Releasing lock "refresh_cache-f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:23:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG nova.compute.manager [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] [instance: abe48a87-2a54-468d-98e5-afae2577e541] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJFHraCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'abe48a87-2a54-468d-98e5-afae2577e541', 'attached_at': '', 'detached_at': '', 'volume_id': 'b19cea99-e9a2-4f33-bf1c-761bbfa0b902', 'serial': 'b19cea99-e9a2-4f33-bf1c-761bbfa0b902'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrZhgeJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '1050330c-df37-4ba2-af96-abc58bc63532'}, 'status': 'reserved', 'instance': 'abe48a87-2a54-468d-98e5-afae2577e541', 'attached_at': '', 'detached_at': '', 'volume_id': '1050330c-df37-4ba2-af96-abc58bc63532', 'serial'} {{(pid=72820) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJFHraCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:23:52 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:23:52 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:23:52 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9803e24c-b9e0-4bab-9e01-aa0a9bed856e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:23:52 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2d5ade-6b1a-406c-8eef-f6c9c4f7f094]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902] added
Aug 27 02:23:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8fd661-cb43-430b-9d96-40804306d8b6]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d6633f-afd5-4558-adcc-fc3770497188]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LJFHraCe {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LJFHraCe" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc1c4cc-860e-46b0-b50d-42c9d605918c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LJFHraCe'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1d7789-efe6-46d1-82b3-4d8c7f4cd9fb]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[906ffa21-e31a-4990-a940-be1bf4abb175]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 (non-flash)
Aug 27 02:23:52 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:52 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:52 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 (non-flash)
Aug 27 02:23:52 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:52 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:52 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c22714-9374-4c05-a2fd-9cb7947cb1f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902, portal: 172.16.0.220,3260]
Aug 27 02:23:52 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902, portal: 172.16.0.220,3260] successful.
Aug 27 02:23:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5299525e-09f3-4324-a5fd-9e3b4413dea4]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[873ea532-0eb8-47b9-b2ea-b1ad64cc93b5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 (non-flash)
Aug 27 02:23:52 user nova-compute[72820]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:52 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:52 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:52 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 (non-flash)
Aug 27 02:23:52 user nova-compute[72820]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:52 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:52 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:52 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] HCTL ('35', '-', '-', 0) found on session 12 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b35e94-981b-4d6c-b1dd-b70cded14848]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJFHraCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-1d0eeb8e-2d77-4a6a-b87b-1d65a3866f6f req-e782cd7c-87d1-4ee2-b406-4e9b00728912 service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Received event network-vif-plugged-b330a8f4-0812-4964-bd70-10d41689406a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:23:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1d0eeb8e-2d77-4a6a-b87b-1d65a3866f6f req-e782cd7c-87d1-4ee2-b406-4e9b00728912 service nova] Acquiring lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1d0eeb8e-2d77-4a6a-b87b-1d65a3866f6f req-e782cd7c-87d1-4ee2-b406-4e9b00728912 service nova] Lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1d0eeb8e-2d77-4a6a-b87b-1d65a3866f6f req-e782cd7c-87d1-4ee2-b406-4e9b00728912 service nova] Lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-1d0eeb8e-2d77-4a6a-b87b-1d65a3866f6f req-e782cd7c-87d1-4ee2-b406-4e9b00728912 service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] No waiting events found dispatching network-vif-plugged-b330a8f4-0812-4964-bd70-10d41689406a {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:23:53 user nova-compute[72820]: WARNING nova.compute.manager [req-1d0eeb8e-2d77-4a6a-b87b-1d65a3866f6f req-e782cd7c-87d1-4ee2-b406-4e9b00728912 service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Received unexpected event network-vif-plugged-b330a8f4-0812-4964-bd70-10d41689406a for instance with vm_state building and task_state spawning.
Aug 27 02:23:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:23:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23266386139363139', 'path': '/dev/sdd'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:23:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266386139363139', 'path': '/dev/sdd'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:23:53 user nova-compute[72820]: DEBUG nova.objects.instance [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Lazy-loading 'flavor' on Instance uuid abe48a87-2a54-468d-98e5-afae2577e541 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:23:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:23:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] COPY block job progress, current cursor: 106954752 final cursor: 1073741824 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:23:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] COPY block job progress, current cursor: 281018368 final cursor: 1073741824 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-34811402-367f-46ca-9afe-78c55da0c89f req-a2d8d8e0-7a5e-4247-ad9d-d7c1eb0cfaa0 service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Received event network-vif-plugged-b330a8f4-0812-4964-bd70-10d41689406a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:23:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-34811402-367f-46ca-9afe-78c55da0c89f req-a2d8d8e0-7a5e-4247-ad9d-d7c1eb0cfaa0 service nova] Acquiring lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-34811402-367f-46ca-9afe-78c55da0c89f req-a2d8d8e0-7a5e-4247-ad9d-d7c1eb0cfaa0 service nova] Lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-34811402-367f-46ca-9afe-78c55da0c89f req-a2d8d8e0-7a5e-4247-ad9d-d7c1eb0cfaa0 service nova] Lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-34811402-367f-46ca-9afe-78c55da0c89f req-a2d8d8e0-7a5e-4247-ad9d-d7c1eb0cfaa0 service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] No waiting events found dispatching network-vif-plugged-b330a8f4-0812-4964-bd70-10d41689406a {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:23:55 user nova-compute[72820]: WARNING nova.compute.manager [req-34811402-367f-46ca-9afe-78c55da0c89f req-a2d8d8e0-7a5e-4247-ad9d-d7c1eb0cfaa0 service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Received unexpected event network-vif-plugged-b330a8f4-0812-4964-bd70-10d41689406a for instance with vm_state building and task_state spawning.
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103035.3637493, f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:23:55 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] VM Resumed (Lifecycle Event)
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] COPY block job progress, current cursor: 454033408 final cursor: 1073741824 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:23:55 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Instance spawned successfully.
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:23:55 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103035.3681471, f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:23:55 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] VM Started (Lifecycle Event)
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:23:55 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:23:55 user nova-compute[72820]: INFO nova.compute.manager [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Took 6.58 seconds to spawn the instance on the hypervisor.
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:23:55 user nova-compute[72820]: INFO nova.compute.manager [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Took 7.40 seconds to build instance.
Aug 27 02:23:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4790dcc8-a56c-4a99-b410-03add78fee93 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.519s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] COPY block job progress, current cursor: 606076928 final cursor: 1073741824 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:23:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] COPY block job progress, current cursor: 715128832 final cursor: 1073741824 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:23:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] COPY block job progress, current cursor: 875560960 final cursor: 1073741824 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:23:57 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] COPY block job progress, current cursor: 1007681536 final cursor: 1073741824 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:23:57 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "1246d21d-b797-4c76-b282-83e17e6bf06a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:58 user nova-compute[72820]: INFO nova.compute.manager [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Terminating instance
Aug 27 02:23:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] [instance: abe48a87-2a54-468d-98e5-afae2577e541] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrZhgeJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '1050330c-df37-4ba2-af96-abc58bc63532'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:23:58 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7850804f-8208-4a7f-a9c7-754c4edc9f6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:23:58 user nova-compute[72820]: No targets found.
Aug 27 02:23:58 user nova-compute[72820]: iSNS:
Aug 27 02:23:58 user nova-compute[72820]: No targets found.
Aug 27 02:23:58 user nova-compute[72820]: STATIC:
Aug 27 02:23:58 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341
Aug 27 02:23:58 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:58 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:58 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b
Aug 27 02:23:58 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:58 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:58 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633
Aug 27 02:23:58 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:58 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:58 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902
Aug 27 02:23:58 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:58 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:58 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532
Aug 27 02:23:58 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:23:58 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:23:58 user nova-compute[72820]: FIRMWARE:
Aug 27 02:23:58 user nova-compute[72820]: No targets found.
Aug 27 02:23:58 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:23:58 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:23:58 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b197f5a-81ac-4fff-b957-30c6e8bf6b3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b58eec-151f-4d02-b9da-d6a918aff8a4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 (non-flash)
Aug 27 02:23:58 user nova-compute[72820]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:58 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:58 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:58 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:58 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 (non-flash)
Aug 27 02:23:58 user nova-compute[72820]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:23:58 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:23:58 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:23:58 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:23:58 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75d00d4e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532'): ({'sdf'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Removing single pathed devices sdf {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cef43e9-018a-481a-84b2-9977112664ca]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5d8a73-aca0-4c35-baea-9e2f522a954e]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Flushing IO for device /dev/sdf {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0038f7f3-5f62-451f-a543-7a615122a2ba]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c400c93-8be6-461d-b102-a84a67d6f921]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] SCSI volumes sdf have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e035ab-e31d-4111-95e2-f49da79cb9cf]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d10a2e7-3235-4c77-bef6-2ad5438b3c32]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532, portal: 172.16.0.220,3260]
Aug 27 02:23:58 user nova-compute[72820]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532, portal: 172.16.0.220,3260] successful.
Aug 27 02:23:58 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-606f44d7-d908-40b1-8230-abc54c02ed8d req-25c5238e-7f32-4964-a5bd-42ff0e4d4829 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received event network-vif-unplugged-52e755c8-03a4-4255-a48d-414e0a1ba26a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-606f44d7-d908-40b1-8230-abc54c02ed8d req-25c5238e-7f32-4964-a5bd-42ff0e4d4829 service nova] Acquiring lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-606f44d7-d908-40b1-8230-abc54c02ed8d req-25c5238e-7f32-4964-a5bd-42ff0e4d4829 service nova] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-606f44d7-d908-40b1-8230-abc54c02ed8d req-25c5238e-7f32-4964-a5bd-42ff0e4d4829 service nova] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-606f44d7-d908-40b1-8230-abc54c02ed8d req-25c5238e-7f32-4964-a5bd-42ff0e4d4829 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] No waiting events found dispatching network-vif-unplugged-52e755c8-03a4-4255-a48d-414e0a1ba26a {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-606f44d7-d908-40b1-8230-abc54c02ed8d req-25c5238e-7f32-4964-a5bd-42ff0e4d4829 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received event network-vif-unplugged-52e755c8-03a4-4255-a48d-414e0a1ba26a for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1050330c-df37-4ba2-af96-abc58bc63532 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b8e348-fb1d-42a6-9d23-f8aea367f85b]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] <== disconnect_volume: return (388ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJFHraCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'abe48a87-2a54-468d-98e5-afae2577e541', 'attached_at': '', 'detached_at': '', 'volume_id': 'b19cea99-e9a2-4f33-bf1c-761bbfa0b902', 'serial'} {{(pid=72820) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] [instance: abe48a87-2a54-468d-98e5-afae2577e541] swap_volume: removing Cinder connection for volume 1050330c-df37-4ba2-af96-abc58bc63532 {{(pid=72820) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 27 02:23:58 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Instance destroyed successfully.
Aug 27 02:23:58 user nova-compute[72820]: DEBUG nova.objects.instance [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lazy-loading 'resources' on Instance uuid 1246d21d-b797-4c76-b282-83e17e6bf06a {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-763202852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-763202852',id=7,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp8SE+60pO/iSvH/3MlKKhub1Bt3pIV43ycpm9UNaf+uwVjtT/lwbZQdwY4vF2RtnbJSES0rieVwtxnV3XLrYsdPch9SnMxc7EdoRqFhT0gE3l0qDEzBd0M43h/WvHElA==',key_name='tempest-keypair-1710782008',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:20:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34aba94505ec4710a8a30e50cae8d4df',ramdisk_id='',reservation_id='r-vu1svk2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-634168039',owner_user_name='tempest-TaggedAttachmentsTest-634168039-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d17e388756d462da4e6d144b73085fa',uuid=1246d21d-b797-4c76-b282-83e17e6bf06a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "address": "fa:16:3e:50:f4:e0", "network": {"id": "acc49577-9bcb-4da3-ad31-4ecf60e14ce6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2140276278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e755c8-03", "ovs_interfaceid": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Converting VIF {"id": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "address": "fa:16:3e:50:f4:e0", "network": {"id": "acc49577-9bcb-4da3-ad31-4ecf60e14ce6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2140276278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34aba94505ec4710a8a30e50cae8d4df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e755c8-03", "ovs_interfaceid": "52e755c8-03a4-4255-a48d-414e0a1ba26a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:f4:e0,bridge_name='br-int',has_traffic_filtering=True,id=52e755c8-03a4-4255-a48d-414e0a1ba26a,network=Network(acc49577-9bcb-4da3-ad31-4ecf60e14ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e755c8-03') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG os_vif [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:f4:e0,bridge_name='br-int',has_traffic_filtering=True,id=52e755c8-03a4-4255-a48d-414e0a1ba26a,network=Network(acc49577-9bcb-4da3-ad31-4ecf60e14ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e755c8-03') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52e755c8-03, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:23:58 user nova-compute[72820]: INFO os_vif [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:f4:e0,bridge_name='br-int',has_traffic_filtering=True,id=52e755c8-03a4-4255-a48d-414e0a1ba26a,network=Network(acc49577-9bcb-4da3-ad31-4ecf60e14ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e755c8-03')
Aug 27 02:23:58 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Deleting instance files /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a_del
Aug 27 02:23:58 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Deletion of /opt/stack/data/nova/instances/1246d21d-b797-4c76-b282-83e17e6bf06a_del complete
Aug 27 02:23:58 user nova-compute[72820]: INFO nova.compute.manager [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 27 02:23:58 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:23:58 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:23:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] [instance: abe48a87-2a54-468d-98e5-afae2577e541] swap_volume: Updating volume 1050330c-df37-4ba2-af96-abc58bc63532 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "LJFHraCe", "auth_password": "mruZHvRAEcijIO", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "b19cea99-e9a2-4f33-bf1c-761bbfa0b902"}, "status": "reserved", "instance": "abe48a87-2a54-468d-98e5-afae2577e541", "attached_at": "", "detached_at": "", "volume_id": "b19cea99-e9a2-4f33-bf1c-761bbfa0b902", "serial": "b19cea99-e9a2-4f33-bf1c-761bbfa0b902"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b19cea99-e9a2-4f33-bf1c-761bbfa0b902', 'no_device': None, 'attachment_id': '5dd30bcd-bad4-4818-8cdf-645de5e92636'} {{(pid=72820) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 27 02:23:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-eca298c2-4b94-41d5-8206-c1954ffdeadf tempest-TestVolumeSwap-755001939 tempest-TestVolumeSwap-755001939-project-admin] Lock "abe48a87-2a54-468d-98e5-afae2577e541" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.711s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:23:59 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:23:59 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Took 0.97 seconds to deallocate network for instance.
Aug 27 02:23:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:23:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-3b639f71-00b6-4240-8e91-1f4e8db13bde req-efed8c35-68c7-4d91-a5d8-3523d5f7b1c5 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received event network-vif-plugged-52e755c8-03a4-4255-a48d-414e0a1ba26a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3b639f71-00b6-4240-8e91-1f4e8db13bde req-efed8c35-68c7-4d91-a5d8-3523d5f7b1c5 service nova] Acquiring lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3b639f71-00b6-4240-8e91-1f4e8db13bde req-efed8c35-68c7-4d91-a5d8-3523d5f7b1c5 service nova] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3b639f71-00b6-4240-8e91-1f4e8db13bde req-efed8c35-68c7-4d91-a5d8-3523d5f7b1c5 service nova] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-3b639f71-00b6-4240-8e91-1f4e8db13bde req-efed8c35-68c7-4d91-a5d8-3523d5f7b1c5 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] No waiting events found dispatching network-vif-plugged-52e755c8-03a4-4255-a48d-414e0a1ba26a {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:00 user nova-compute[72820]: WARNING nova.compute.manager [req-3b639f71-00b6-4240-8e91-1f4e8db13bde req-efed8c35-68c7-4d91-a5d8-3523d5f7b1c5 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received unexpected event network-vif-plugged-52e755c8-03a4-4255-a48d-414e0a1ba26a for instance with vm_state deleted and task_state None.
Aug 27 02:24:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-3b639f71-00b6-4240-8e91-1f4e8db13bde req-efed8c35-68c7-4d91-a5d8-3523d5f7b1c5 service nova] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Received event network-vif-deleted-52e755c8-03a4-4255-a48d-414e0a1ba26a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:00 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:24:00 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:24:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.871s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:00 user nova-compute[72820]: DEBUG nova.objects.instance [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lazy-loading 'flavor' on Instance uuid 6ed3c12e-96a8-4a32-8089-f04eba608663 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:24:00 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Deleted allocations for instance 1246d21d-b797-4c76-b282-83e17e6bf06a
Aug 27 02:24:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-597fec51-7181-48c6-82bc-b067d9bd25cd tempest-TaggedAttachmentsTest-634168039 tempest-TaggedAttachmentsTest-634168039-project-member] Lock "1246d21d-b797-4c76-b282-83e17e6bf06a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.027s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:01 user nova-compute[72820]: INFO nova.compute.manager [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Attaching volume 5ba8bce8-8d37-4482-954f-fd1da52b23cc to /dev/vdb
Aug 27 02:24:01 user nova-compute[72820]: DEBUG os_brick.utils [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c55a7b7-4c27-4510-939c-6c297a76de6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a9c6d2-bfd8-4c86-8e4a-fd4e826f19f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e798c50d-afa1-4fd6-a49a-f9c3ff1cca01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ab97e4-c18b-453e-be8d-f68327852ef5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:24:01 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdd959a-d3b5-4277-998e-a86343e732bc]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG os_brick.utils [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Updating existing volume attachment record: 266bd658-1fc0-4568-9346-be7e438edb76 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Acquiring lock "abe48a87-2a54-468d-98e5-afae2577e541" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "abe48a87-2a54-468d-98e5-afae2577e541" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:01 user nova-compute[72820]: INFO nova.compute.manager [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Detaching volume b19cea99-e9a2-4f33-bf1c-761bbfa0b902
Aug 27 02:24:01 user nova-compute[72820]: INFO nova.virt.block_device [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Attempting to driver detach volume b19cea99-e9a2-4f33-bf1c-761bbfa0b902 from mountpoint /dev/vdb
Aug 27 02:24:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Attempting to detach device vdb from instance abe48a87-2a54-468d-98e5-afae2577e541 from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:24:01 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:24:01 user nova-compute[72820]:   <source dev="/dev/sdd"/>
Aug 27 02:24:01 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:24:01 user nova-compute[72820]:   <serial>b19cea99-e9a2-4f33-bf1c-761bbfa0b902</serial>
Aug 27 02:24:01 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:24:01 user nova-compute[72820]: </disk>
Aug 27 02:24:01 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:24:01 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Successfully detached device vdb from instance abe48a87-2a54-468d-98e5-afae2577e541 from the persistent domain config.
Aug 27 02:24:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance abe48a87-2a54-468d-98e5-afae2577e541 from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:24:01 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:24:01 user nova-compute[72820]:   <source dev="/dev/sdd"/>
Aug 27 02:24:01 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:24:01 user nova-compute[72820]:   <serial>b19cea99-e9a2-4f33-bf1c-761bbfa0b902</serial>
Aug 27 02:24:01 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:24:01 user nova-compute[72820]: </disk>
Aug 27 02:24:01 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:24:01 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693103042.0483265, abe48a87-2a54-468d-98e5-afae2577e541 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance abe48a87-2a54-468d-98e5-afae2577e541 {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:24:02 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Successfully detached device vdb from instance abe48a87-2a54-468d-98e5-afae2577e541 from the live domain config.
Aug 27 02:24:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJFHraCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'b19cea99-e9a2-4f33-bf1c-761bbfa0b902'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:24:02 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02b697f-ac53-45d8-85e9-05ce82875c73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:24:02 user nova-compute[72820]: No targets found.
Aug 27 02:24:02 user nova-compute[72820]: iSNS:
Aug 27 02:24:02 user nova-compute[72820]: No targets found.
Aug 27 02:24:02 user nova-compute[72820]: STATIC:
Aug 27 02:24:02 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341
Aug 27 02:24:02 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:24:02 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:24:02 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b
Aug 27 02:24:02 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:24:02 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:24:02 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633
Aug 27 02:24:02 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:24:02 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:24:02 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902
Aug 27 02:24:02 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:24:02 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:24:02 user nova-compute[72820]: FIRMWARE:
Aug 27 02:24:02 user nova-compute[72820]: No targets found.
Aug 27 02:24:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:24:02 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:24:02 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e031945-2a25-4859-9789-9bbc6c8c85a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[191b3341-f0d3-4d0e-80d0-a53d00a9d17b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:24:02 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:24:02 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:24:02 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:24:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 (non-flash)
Aug 27 02:24:02 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:24:02 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:24:02 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:24:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c02db5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902'): ({'sdd'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Removing single pathed devices sdd {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3ea824-799c-4525-9e12-a6261634e213]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfdc059-8f8c-47b5-9e91-fcc951d6398e]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Flushing IO for device /dev/sdd {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b6ed45-ec91-4771-98c3-e234310593de]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7bacc1-f7f0-488c-8e5b-a1f7770c0759]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a7be6a-7dd3-4251-bc05-0213f473497a]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5091ac1-5870-485f-a6db-bef1dbd70592]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902, portal: 172.16.0.220,3260]
Aug 27 02:24:02 user nova-compute[72820]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902, portal: 172.16.0.220,3260] successful.
Aug 27 02:24:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19cea99-e9a2-4f33-bf1c-761bbfa0b902 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8037276b-f0e4-43e2-8adc-8324a8b8bf89]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] <== disconnect_volume: return (345ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:24:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:24:03 user nova-compute[72820]: DEBUG nova.objects.instance [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lazy-loading 'flavor' on Instance uuid abe48a87-2a54-468d-98e5-afae2577e541 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:24:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b91ec5d6-70bd-46fc-b915-2fdaeacd7523 tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "abe48a87-2a54-468d-98e5-afae2577e541" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.977s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:04 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:24:04 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:24:04 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:24:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:04 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:24:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.330s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:06 user nova-compute[72820]: DEBUG nova.compute.manager [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:24:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:24:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:24:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:24:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:06 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:24:06 user nova-compute[72820]: INFO nova.compute.claims [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Claim successful on node user
Aug 27 02:24:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.263s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:06 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:24:06 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.751s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG nova.network.neutron [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:07 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG nova.policy [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '275f713edfd042d4b4fa32620956484a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7797569db44f40f193483e6e6933a0d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:24:07 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Creating image(s)
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "/opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "/opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "/opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.221s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.231s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk 1073741824" returned: 0 in 0.094s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG nova.network.neutron [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Successfully created port: 525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.206s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Cannot resize image /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Ensure instance console log exists: /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.network.neutron [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Successfully updated port: 525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.compute.manager [req-37fa8f80-4830-43d0-94e0-6fdc11a43cf1 req-0f007b5e-10f4-4a60-80b7-2863f27bebf4 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received event network-changed-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.compute.manager [req-37fa8f80-4830-43d0-94e0-6fdc11a43cf1 req-0f007b5e-10f4-4a60-80b7-2863f27bebf4 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Refreshing instance network info cache due to event network-changed-525fd1df-177d-44ee-a88d-e6dcde84e9d4. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-37fa8f80-4830-43d0-94e0-6fdc11a43cf1 req-0f007b5e-10f4-4a60-80b7-2863f27bebf4 service nova] Acquiring lock "refresh_cache-f37dfe42-3b22-4111-b10d-9459c8c42b2d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-37fa8f80-4830-43d0-94e0-6fdc11a43cf1 req-0f007b5e-10f4-4a60-80b7-2863f27bebf4 service nova] Acquired lock "refresh_cache-f37dfe42-3b22-4111-b10d-9459c8c42b2d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.network.neutron [req-37fa8f80-4830-43d0-94e0-6fdc11a43cf1 req-0f007b5e-10f4-4a60-80b7-2863f27bebf4 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Refreshing network info cache for port 525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "refresh_cache-f37dfe42-3b22-4111-b10d-9459c8c42b2d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:24:09 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:24:09 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7537MB free_disk=25.536739349365234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.network.neutron [req-37fa8f80-4830-43d0-94e0-6fdc11a43cf1 req-0f007b5e-10f4-4a60-80b7-2863f27bebf4 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 26581695-c4b9-40b8-ab7a-34c99db0dadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f8f612f3-41c9-4dae-8d49-218d61720b15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6ed3c12e-96a8-4a32-8089-f04eba608663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance abe48a87-2a54-468d-98e5-afae2577e541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 0d99438e-e6d1-4fc3-a399-7e844c8f9538 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance c0644b77-33ce-46e4-a6cb-b6322bdc6a9e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 717fb1d8-6d09-440b-bc50-7132a8ebe8d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f37dfe42-3b22-4111-b10d-9459c8c42b2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.network.neutron [req-37fa8f80-4830-43d0-94e0-6fdc11a43cf1 req-0f007b5e-10f4-4a60-80b7-2863f27bebf4 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-37fa8f80-4830-43d0-94e0-6fdc11a43cf1 req-0f007b5e-10f4-4a60-80b7-2863f27bebf4 service nova] Releasing lock "refresh_cache-f37dfe42-3b22-4111-b10d-9459c8c42b2d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquired lock "refresh_cache-f37dfe42-3b22-4111-b10d-9459c8c42b2d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.network.neutron [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:24:09 user nova-compute[72820]: DEBUG nova.network.neutron [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.624s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.network.neutron [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Updating instance_info_cache with network_info: [{"id": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "address": "fa:16:3e:8f:f1:36", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd1df-17", "ovs_interfaceid": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Releasing lock "refresh_cache-f37dfe42-3b22-4111-b10d-9459c8c42b2d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.compute.manager [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Instance network_info: |[{"id": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "address": "fa:16:3e:8f:f1:36", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd1df-17", "ovs_interfaceid": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Start _get_guest_xml network_info=[{"id": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "address": "fa:16:3e:8f:f1:36", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd1df-17", "ovs_interfaceid": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:24:10 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:24:10 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-421019104',display_name='tempest-tempest.common.compute-instance-421019104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-421019104',id=13,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMw/Y2giaEd949A8TrcWBPdl2Eikv6Xenmfv4cllzQw8aisIhzqkeUdBQYtbr+OYny0m8MqNxEwe+yjAuXRnQEEmz90bzQRRLT4my2+BuCn44VZPZT8Z8gGsdaV35h+jg==',key_name='tempest-keypair-1823346990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7797569db44f40f193483e6e6933a0d0',ramdisk_id='',reservation_id='r-251z002r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-892102693',owner_user_name='tempest-ServerActionsTestOtherA-892102693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:24:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='275f713edfd042d4b4fa32620956484a',uuid=f37dfe42-3b22-4111-b10d-9459c8c42b2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "address": "fa:16:3e:8f:f1:36", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd1df-17", "ovs_interfaceid": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converting VIF {"id": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "address": "fa:16:3e:8f:f1:36", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd1df-17", "ovs_interfaceid": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=525fd1df-177d-44ee-a88d-e6dcde84e9d4,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd1df-17') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.objects.instance [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lazy-loading 'pci_devices' on Instance uuid f37dfe42-3b22-4111-b10d-9459c8c42b2d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:24:10 user nova-compute[72820]:   <uuid>f37dfe42-3b22-4111-b10d-9459c8c42b2d</uuid>
Aug 27 02:24:10 user nova-compute[72820]:   <name>instance-0000000d</name>
Aug 27 02:24:10 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:24:10 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:24:10 user nova-compute[72820]:   <metadata>
Aug 27 02:24:10 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:24:10 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:24:10 user nova-compute[72820]:       <nova:name>tempest-tempest.common.compute-instance-421019104</nova:name>
Aug 27 02:24:10 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:24:10</nova:creationTime>
Aug 27 02:24:10 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:24:10 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:24:10 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:24:10 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:24:10 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:24:10 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:24:10 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:24:10 user nova-compute[72820]:       <nova:owner>
Aug 27 02:24:10 user nova-compute[72820]:         <nova:user uuid="275f713edfd042d4b4fa32620956484a">tempest-ServerActionsTestOtherA-892102693-project-member</nova:user>
Aug 27 02:24:10 user nova-compute[72820]:         <nova:project uuid="7797569db44f40f193483e6e6933a0d0">tempest-ServerActionsTestOtherA-892102693</nova:project>
Aug 27 02:24:10 user nova-compute[72820]:       </nova:owner>
Aug 27 02:24:10 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:24:10 user nova-compute[72820]:       <nova:ports>
Aug 27 02:24:10 user nova-compute[72820]:         <nova:port uuid="525fd1df-177d-44ee-a88d-e6dcde84e9d4">
Aug 27 02:24:10 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 02:24:10 user nova-compute[72820]:         </nova:port>
Aug 27 02:24:10 user nova-compute[72820]:       </nova:ports>
Aug 27 02:24:10 user nova-compute[72820]:     </nova:instance>
Aug 27 02:24:10 user nova-compute[72820]:   </metadata>
Aug 27 02:24:10 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:24:10 user nova-compute[72820]:     <system>
Aug 27 02:24:10 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:24:10 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:24:10 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:24:10 user nova-compute[72820]:       <entry name="serial">f37dfe42-3b22-4111-b10d-9459c8c42b2d</entry>
Aug 27 02:24:10 user nova-compute[72820]:       <entry name="uuid">f37dfe42-3b22-4111-b10d-9459c8c42b2d</entry>
Aug 27 02:24:10 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:24:10 user nova-compute[72820]:     </system>
Aug 27 02:24:10 user nova-compute[72820]:   </sysinfo>
Aug 27 02:24:10 user nova-compute[72820]:   <os>
Aug 27 02:24:10 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:24:10 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:24:10 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:24:10 user nova-compute[72820]:   </os>
Aug 27 02:24:10 user nova-compute[72820]:   <features>
Aug 27 02:24:10 user nova-compute[72820]:     <acpi/>
Aug 27 02:24:10 user nova-compute[72820]:     <apic/>
Aug 27 02:24:10 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:24:10 user nova-compute[72820]:   </features>
Aug 27 02:24:10 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:24:10 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:24:10 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:24:10 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:24:10 user nova-compute[72820]:   </clock>
Aug 27 02:24:10 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:24:10 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:24:10 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:24:10 user nova-compute[72820]:   </cpu>
Aug 27 02:24:10 user nova-compute[72820]:   <devices>
Aug 27 02:24:10 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:24:10 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:24:10 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk"/>
Aug 27 02:24:10 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:24:10 user nova-compute[72820]:     </disk>
Aug 27 02:24:10 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:24:10 user nova-compute[72820]:       <mac address="fa:16:3e:8f:f1:36"/>
Aug 27 02:24:10 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:24:10 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:24:10 user nova-compute[72820]:       <target dev="tap525fd1df-17"/>
Aug 27 02:24:10 user nova-compute[72820]:     </interface>
Aug 27 02:24:10 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:24:10 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/console.log" append="off"/>
Aug 27 02:24:10 user nova-compute[72820]:     </serial>
Aug 27 02:24:10 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:24:10 user nova-compute[72820]:     <video>
Aug 27 02:24:10 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:24:10 user nova-compute[72820]:     </video>
Aug 27 02:24:10 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:24:10 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:24:10 user nova-compute[72820]:     </rng>
Aug 27 02:24:10 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:24:10 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:24:10 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:24:10 user nova-compute[72820]:     </memballoon>
Aug 27 02:24:10 user nova-compute[72820]:   </devices>
Aug 27 02:24:10 user nova-compute[72820]: </domain>
Aug 27 02:24:10 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-421019104',display_name='tempest-tempest.common.compute-instance-421019104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-421019104',id=13,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMw/Y2giaEd949A8TrcWBPdl2Eikv6Xenmfv4cllzQw8aisIhzqkeUdBQYtbr+OYny0m8MqNxEwe+yjAuXRnQEEmz90bzQRRLT4my2+BuCn44VZPZT8Z8gGsdaV35h+jg==',key_name='tempest-keypair-1823346990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7797569db44f40f193483e6e6933a0d0',ramdisk_id='',reservation_id='r-251z002r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-892102693',owner_user_name='tempest-ServerActionsTestOtherA-892102693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:24:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='275f713edfd042d4b4fa32620956484a',uuid=f37dfe42-3b22-4111-b10d-9459c8c42b2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "address": "fa:16:3e:8f:f1:36", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd1df-17", "ovs_interfaceid": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converting VIF {"id": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "address": "fa:16:3e:8f:f1:36", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd1df-17", "ovs_interfaceid": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=525fd1df-177d-44ee-a88d-e6dcde84e9d4,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd1df-17') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG os_vif [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=525fd1df-177d-44ee-a88d-e6dcde84e9d4,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd1df-17') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap525fd1df-17, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap525fd1df-17, col_values=(('external_ids', {'iface-id': '525fd1df-177d-44ee-a88d-e6dcde84e9d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:f1:36', 'vm-uuid': 'f37dfe42-3b22-4111-b10d-9459c8c42b2d'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:10 user nova-compute[72820]: INFO os_vif [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=525fd1df-177d-44ee-a88d-e6dcde84e9d4,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd1df-17')
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:24:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] No VIF found with MAC fa:16:3e:8f:f1:36, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:24:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:24:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:24:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:24:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:24:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:24:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:24:11 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:24:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:12 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Updating instance_info_cache with network_info: [{"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:24:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:24:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:24:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:24:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:24:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:24:12 user nova-compute[72820]: DEBUG nova.compute.manager [req-0e8cb677-6d79-4fcf-851b-16daf3d59393 req-235ad661-900d-4add-930d-4a885999bbe6 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received event network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0e8cb677-6d79-4fcf-851b-16daf3d59393 req-235ad661-900d-4add-930d-4a885999bbe6 service nova] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0e8cb677-6d79-4fcf-851b-16daf3d59393 req-235ad661-900d-4add-930d-4a885999bbe6 service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0e8cb677-6d79-4fcf-851b-16daf3d59393 req-235ad661-900d-4add-930d-4a885999bbe6 service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:12 user nova-compute[72820]: DEBUG nova.compute.manager [req-0e8cb677-6d79-4fcf-851b-16daf3d59393 req-235ad661-900d-4add-930d-4a885999bbe6 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] No waiting events found dispatching network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:12 user nova-compute[72820]: WARNING nova.compute.manager [req-0e8cb677-6d79-4fcf-851b-16daf3d59393 req-235ad661-900d-4add-930d-4a885999bbe6 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received unexpected event network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 for instance with vm_state building and task_state spawning.
Aug 27 02:24:13 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103038.787955, 1246d21d-b797-4c76-b282-83e17e6bf06a => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:24:13 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] VM Stopped (Lifecycle Event)
Aug 27 02:24:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6ed7c943-9baa-4008-b8b7-655ac1e7e9c8 None None] [instance: 1246d21d-b797-4c76-b282-83e17e6bf06a] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:24:14 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103054.5473242, f37dfe42-3b22-4111-b10d-9459c8c42b2d => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:24:14 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] VM Resumed (Lifecycle Event)
Aug 27 02:24:14 user nova-compute[72820]: DEBUG nova.compute.manager [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:24:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:24:14 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Instance spawned successfully.
Aug 27 02:24:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:24:14 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:24:14 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:24:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:24:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:24:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:24:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:24:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:24:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:24:14 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:24:14 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103054.5489006, f37dfe42-3b22-4111-b10d-9459c8c42b2d => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:24:14 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] VM Started (Lifecycle Event)
Aug 27 02:24:14 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:24:14 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:24:14 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:24:14 user nova-compute[72820]: INFO nova.compute.manager [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Took 7.34 seconds to spawn the instance on the hypervisor.
Aug 27 02:24:14 user nova-compute[72820]: DEBUG nova.compute.manager [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:24:14 user nova-compute[72820]: INFO nova.compute.manager [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Took 8.59 seconds to build instance.
Aug 27 02:24:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-562d25c3-d327-4e05-b478-edd16aaf2988 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.758s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG nova.compute.manager [req-59bf7cbf-d0e8-4aae-b787-70cde269e4be req-5397b7c8-d3b5-4dab-85f9-615240025947 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received event network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-59bf7cbf-d0e8-4aae-b787-70cde269e4be req-5397b7c8-d3b5-4dab-85f9-615240025947 service nova] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-59bf7cbf-d0e8-4aae-b787-70cde269e4be req-5397b7c8-d3b5-4dab-85f9-615240025947 service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-59bf7cbf-d0e8-4aae-b787-70cde269e4be req-5397b7c8-d3b5-4dab-85f9-615240025947 service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG nova.compute.manager [req-59bf7cbf-d0e8-4aae-b787-70cde269e4be req-5397b7c8-d3b5-4dab-85f9-615240025947 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] No waiting events found dispatching network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:15 user nova-compute[72820]: WARNING nova.compute.manager [req-59bf7cbf-d0e8-4aae-b787-70cde269e4be req-5397b7c8-d3b5-4dab-85f9-615240025947 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received unexpected event network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 for instance with vm_state active and task_state None.
Aug 27 02:24:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkJBEIvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:24:15 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:24:15 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:24:15 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab8482c-a7f6-4400-bf10-0a2d17c088c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:24:15 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf573bf-33b5-4fef-b10c-21b089c1c308]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc] added
Aug 27 02:24:15 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cfa54d-8980-455c-851f-b96285659f9f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d1db03-2752-4144-a42a-ecfc70095d8d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QkJBEIvV {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QkJBEIvV" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc7fb09-5535-41f9-a491-64392433fdf6]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QkJBEIvV'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1670103-c409-42ba-88df-3af55f2df791]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cbac7b-a71a-451d-ae38-ee245ddd4738]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:24:15 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:24:15 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:24:15 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:24:15 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:24:15 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:24:15 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2fc506-ae22-41e2-bf67-e9ff732e9913]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc, portal: 172.16.0.220,3260]
Aug 27 02:24:15 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc, portal: 172.16.0.220,3260] successful.
Aug 27 02:24:15 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccafcdd-a0c5-4049-b09a-03d9490bd946]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4086f37-260b-4fa3-a006-8f964dec2dcf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:24:15 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:24:15 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:24:15 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:24:15 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:24:15 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:24:15 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:24:15 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:24:15 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d612ad-9509-43ca-a87b-592f2f6a2560]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:15 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: None {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:24:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:16 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:24:16 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkJBEIvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:24:16 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:24:16 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23533353430303064', 'path': '/dev/sdd'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:24:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533353430303064', 'path': '/dev/sdd'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:24:16 user nova-compute[72820]: DEBUG nova.objects.instance [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lazy-loading 'flavor' on Instance uuid 6ed3c12e-96a8-4a32-8089-f04eba608663 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:24:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:24:16 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:24:16 user nova-compute[72820]:   <source dev="/dev/sdd"/>
Aug 27 02:24:16 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:24:16 user nova-compute[72820]:   <serial>5ba8bce8-8d37-4482-954f-fd1da52b23cc</serial>
Aug 27 02:24:16 user nova-compute[72820]: </disk>
Aug 27 02:24:16 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:24:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:24:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:24:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] No VIF found with MAC fa:16:3e:67:6b:e8, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:24:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d520698-5f6c-41a7-8fab-d02e68690d07 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.495s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Acquiring lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Acquiring lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:18 user nova-compute[72820]: INFO nova.compute.manager [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Terminating instance
Aug 27 02:24:18 user nova-compute[72820]: DEBUG nova.compute.manager [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:24:18 user nova-compute[72820]: INFO nova.compute.manager [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Rescuing
Aug 27 02:24:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:24:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquired lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:24:18 user nova-compute[72820]: DEBUG nova.network.neutron [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:24:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG nova.compute.manager [req-96890538-fd56-4d26-b052-680bc3031315 req-09941707-007f-4901-905a-43407d516b4a service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Received event network-vif-unplugged-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-96890538-fd56-4d26-b052-680bc3031315 req-09941707-007f-4901-905a-43407d516b4a service nova] Acquiring lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-96890538-fd56-4d26-b052-680bc3031315 req-09941707-007f-4901-905a-43407d516b4a service nova] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-96890538-fd56-4d26-b052-680bc3031315 req-09941707-007f-4901-905a-43407d516b4a service nova] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG nova.compute.manager [req-96890538-fd56-4d26-b052-680bc3031315 req-09941707-007f-4901-905a-43407d516b4a service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] No waiting events found dispatching network-vif-unplugged-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG nova.compute.manager [req-96890538-fd56-4d26-b052-680bc3031315 req-09941707-007f-4901-905a-43407d516b4a service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Received event network-vif-unplugged-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:19 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Instance destroyed successfully.
Aug 27 02:24:19 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Lazy-loading 'resources' on Instance uuid 0d99438e-e6d1-4fc3-a399-7e844c8f9538 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1963514045',display_name='tempest-VolumesAssistedSnapshotsTest-server-1963514045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1963514045',id=9,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXv+c34RRrCHLc+b6QpJfvO893JppETFZUVjrO70UAa/IZhb6GBiUPm6I9aGeFzlnNa+OXRZLuih7+/EhiDwces1R9sbMqZD1npqXkONZMa5n+1nla4qb+OsrsNRnz3Iw==',key_name='tempest-keypair-256567050',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:21:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aea4a72361814294b5a2378a8512abe6',ramdisk_id='',reservation_id='r-5739cepl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1276797688',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1276797688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:21:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae40392499a646ef81a346ecbd78ec91',uuid=0d99438e-e6d1-4fc3-a399-7e844c8f9538,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "address": "fa:16:3e:80:50:5b", "network": {"id": "1d1b3f8c-f7ac-48bc-a3af-2a801a350494", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688950999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aea4a72361814294b5a2378a8512abe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc3b16a-3f", "ovs_interfaceid": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Converting VIF {"id": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "address": "fa:16:3e:80:50:5b", "network": {"id": "1d1b3f8c-f7ac-48bc-a3af-2a801a350494", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1688950999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aea4a72361814294b5a2378a8512abe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc3b16a-3f", "ovs_interfaceid": "ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:50:5b,bridge_name='br-int',has_traffic_filtering=True,id=ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14,network=Network(1d1b3f8c-f7ac-48bc-a3af-2a801a350494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc3b16a-3f') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG os_vif [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:50:5b,bridge_name='br-int',has_traffic_filtering=True,id=ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14,network=Network(1d1b3f8c-f7ac-48bc-a3af-2a801a350494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc3b16a-3f') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebc3b16a-3f, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:24:19 user nova-compute[72820]: INFO os_vif [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:50:5b,bridge_name='br-int',has_traffic_filtering=True,id=ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14,network=Network(1d1b3f8c-f7ac-48bc-a3af-2a801a350494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc3b16a-3f')
Aug 27 02:24:19 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Deleting instance files /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538_del
Aug 27 02:24:19 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Deletion of /opt/stack/data/nova/instances/0d99438e-e6d1-4fc3-a399-7e844c8f9538_del complete
Aug 27 02:24:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:19 user nova-compute[72820]: INFO nova.compute.manager [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 27 02:24:19 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:24:19 user nova-compute[72820]: DEBUG nova.network.neutron [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Updating instance_info_cache with network_info: [{"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:24:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Releasing lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:24:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:20 user nova-compute[72820]: DEBUG nova.compute.manager [req-cfefc729-56c7-417f-a28c-44ce18cfd6a2 req-62cd56b9-950b-4700-baba-014f1b98580c service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-vif-unplugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-cfefc729-56c7-417f-a28c-44ce18cfd6a2 req-62cd56b9-950b-4700-baba-014f1b98580c service nova] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-cfefc729-56c7-417f-a28c-44ce18cfd6a2 req-62cd56b9-950b-4700-baba-014f1b98580c service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-cfefc729-56c7-417f-a28c-44ce18cfd6a2 req-62cd56b9-950b-4700-baba-014f1b98580c service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:20 user nova-compute[72820]: DEBUG nova.compute.manager [req-cfefc729-56c7-417f-a28c-44ce18cfd6a2 req-62cd56b9-950b-4700-baba-014f1b98580c service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] No waiting events found dispatching network-vif-unplugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:20 user nova-compute[72820]: WARNING nova.compute.manager [req-cfefc729-56c7-417f-a28c-44ce18cfd6a2 req-62cd56b9-950b-4700-baba-014f1b98580c service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received unexpected event network-vif-unplugged-dc035bdf-5877-42fe-b1e2-fa882373f836 for instance with vm_state active and task_state rescuing.
Aug 27 02:24:20 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:24:20 user nova-compute[72820]: DEBUG nova.compute.manager [req-a2aa4d2e-d338-4a7a-acbd-56c2e343e679 req-ec7d15d9-c80c-4227-9d7c-c8576e5a23b3 service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Received event network-vif-deleted-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:20 user nova-compute[72820]: INFO nova.compute.manager [req-a2aa4d2e-d338-4a7a-acbd-56c2e343e679 req-ec7d15d9-c80c-4227-9d7c-c8576e5a23b3 service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Neutron deleted interface ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14; detaching it from the instance and deleting it from the info cache
Aug 27 02:24:20 user nova-compute[72820]: DEBUG nova.network.neutron [req-a2aa4d2e-d338-4a7a-acbd-56c2e343e679 req-ec7d15d9-c80c-4227-9d7c-c8576e5a23b3 service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:24:20 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Took 1.40 seconds to deallocate network for instance.
Aug 27 02:24:20 user nova-compute[72820]: DEBUG nova.compute.manager [req-a2aa4d2e-d338-4a7a-acbd-56c2e343e679 req-ec7d15d9-c80c-4227-9d7c-c8576e5a23b3 service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Detach interface failed, port_id=ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14, reason: Instance 0d99438e-e6d1-4fc3-a399-7e844c8f9538 could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 02:24:20 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Instance destroyed successfully.
Aug 27 02:24:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:20 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Attempting a stable device rescue
Aug 27 02:24:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72820) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Instance directory exists: not creating {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 02:24:21 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Creating image(s)
Aug 27 02:24:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "/opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "/opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG nova.objects.instance [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6ed3c12e-96a8-4a32-8089-f04eba608663 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "a042f21652059be98bfced14d07ee71ab8cbca7e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "a042f21652059be98bfced14d07ee71ab8cbca7e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-c5c73a6c-662c-4d76-aa71-aab5f165b78a req-c2564861-661c-4491-a5c2-848e334058a6 service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Received event network-vif-plugged-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c5c73a6c-662c-4d76-aa71-aab5f165b78a req-c2564861-661c-4491-a5c2-848e334058a6 service nova] Acquiring lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c5c73a6c-662c-4d76-aa71-aab5f165b78a req-c2564861-661c-4491-a5c2-848e334058a6 service nova] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c5c73a6c-662c-4d76-aa71-aab5f165b78a req-c2564861-661c-4491-a5c2-848e334058a6 service nova] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-c5c73a6c-662c-4d76-aa71-aab5f165b78a req-c2564861-661c-4491-a5c2-848e334058a6 service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] No waiting events found dispatching network-vif-plugged-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:21 user nova-compute[72820]: WARNING nova.compute.manager [req-c5c73a6c-662c-4d76-aa71-aab5f165b78a req-c2564861-661c-4491-a5c2-848e334058a6 service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Received unexpected event network-vif-plugged-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 for instance with vm_state deleted and task_state None.
Aug 27 02:24:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-c5c73a6c-662c-4d76-aa71-aab5f165b78a req-c2564861-661c-4491-a5c2-848e334058a6 service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Received event network-vif-plugged-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c5c73a6c-662c-4d76-aa71-aab5f165b78a req-c2564861-661c-4491-a5c2-848e334058a6 service nova] Acquiring lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c5c73a6c-662c-4d76-aa71-aab5f165b78a req-c2564861-661c-4491-a5c2-848e334058a6 service nova] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c5c73a6c-662c-4d76-aa71-aab5f165b78a req-c2564861-661c-4491-a5c2-848e334058a6 service nova] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-c5c73a6c-662c-4d76-aa71-aab5f165b78a req-c2564861-661c-4491-a5c2-848e334058a6 service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] No waiting events found dispatching network-vif-plugged-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:21 user nova-compute[72820]: WARNING nova.compute.manager [req-c5c73a6c-662c-4d76-aa71-aab5f165b78a req-c2564861-661c-4491-a5c2-848e334058a6 service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Received unexpected event network-vif-plugged-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 for instance with vm_state deleted and task_state None.
Aug 27 02:24:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-c5c73a6c-662c-4d76-aa71-aab5f165b78a req-c2564861-661c-4491-a5c2-848e334058a6 service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Received event network-vif-plugged-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c5c73a6c-662c-4d76-aa71-aab5f165b78a req-c2564861-661c-4491-a5c2-848e334058a6 service nova] Acquiring lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c5c73a6c-662c-4d76-aa71-aab5f165b78a req-c2564861-661c-4491-a5c2-848e334058a6 service nova] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c5c73a6c-662c-4d76-aa71-aab5f165b78a req-c2564861-661c-4491-a5c2-848e334058a6 service nova] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-c5c73a6c-662c-4d76-aa71-aab5f165b78a req-c2564861-661c-4491-a5c2-848e334058a6 service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] No waiting events found dispatching network-vif-plugged-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:21 user nova-compute[72820]: WARNING nova.compute.manager [req-c5c73a6c-662c-4d76-aa71-aab5f165b78a req-c2564861-661c-4491-a5c2-848e334058a6 service nova] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Received unexpected event network-vif-plugged-ebc3b16a-3fb4-43db-aa8c-66beaf3ecb14 for instance with vm_state deleted and task_state None.
Aug 27 02:24:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a042f21652059be98bfced14d07ee71ab8cbca7e.part --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-e3a6e13e-f57a-4f68-af13-bc4cca81673a req-8a9a5c4a-60e1-42f7-9a5f-d7450f53286b service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e3a6e13e-f57a-4f68-af13-bc4cca81673a req-8a9a5c4a-60e1-42f7-9a5f-d7450f53286b service nova] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e3a6e13e-f57a-4f68-af13-bc4cca81673a req-8a9a5c4a-60e1-42f7-9a5f-d7450f53286b service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e3a6e13e-f57a-4f68-af13-bc4cca81673a req-8a9a5c4a-60e1-42f7-9a5f-d7450f53286b service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-e3a6e13e-f57a-4f68-af13-bc4cca81673a req-8a9a5c4a-60e1-42f7-9a5f-d7450f53286b service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] No waiting events found dispatching network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:22 user nova-compute[72820]: WARNING nova.compute.manager [req-e3a6e13e-f57a-4f68-af13-bc4cca81673a req-8a9a5c4a-60e1-42f7-9a5f-d7450f53286b service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received unexpected event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 for instance with vm_state active and task_state rescuing.
Aug 27 02:24:22 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a042f21652059be98bfced14d07ee71ab8cbca7e.part --force-share --output=json" returned: 0 in 0.271s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.images [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] 7598acc7-af28-40f4-982a-6d357af985e3 was qcow2, converting to raw {{(pid=72820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.privsep.utils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a042f21652059be98bfced14d07ee71ab8cbca7e.part /opt/stack/data/nova/instances/_base/a042f21652059be98bfced14d07ee71ab8cbca7e.converted {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.095s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:23 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Deleted allocations for instance 0d99438e-e6d1-4fc3-a399-7e844c8f9538
Aug 27 02:24:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bf1b29b7-b646-496f-be8a-ee0b4e4aa52f tempest-VolumesAssistedSnapshotsTest-1276797688 tempest-VolumesAssistedSnapshotsTest-1276797688-project-member] Lock "0d99438e-e6d1-4fc3-a399-7e844c8f9538" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.767s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a042f21652059be98bfced14d07ee71ab8cbca7e.part /opt/stack/data/nova/instances/_base/a042f21652059be98bfced14d07ee71ab8cbca7e.converted" returned: 0 in 0.362s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a042f21652059be98bfced14d07ee71ab8cbca7e.converted --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a042f21652059be98bfced14d07ee71ab8cbca7e.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "a042f21652059be98bfced14d07ee71ab8cbca7e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.547s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "a042f21652059be98bfced14d07ee71ab8cbca7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "a042f21652059be98bfced14d07ee71ab8cbca7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a042f21652059be98bfced14d07ee71ab8cbca7e --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a042f21652059be98bfced14d07ee71ab8cbca7e --force-share --output=json" returned: 0 in 0.201s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a042f21652059be98bfced14d07ee71ab8cbca7e,backing_fmt=raw /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk.rescue {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a042f21652059be98bfced14d07ee71ab8cbca7e,backing_fmt=raw /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk.rescue" returned: 0 in 0.053s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "a042f21652059be98bfced14d07ee71ab8cbca7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.objects.instance [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lazy-loading 'migration_context' on Instance uuid 6ed3c12e-96a8-4a32-8089-f04eba608663 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.objects.base [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Object Instance<6ed3c12e-96a8-4a32-8089-f04eba608663> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Start _get_guest_xml network_info=[{"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "vif_mac": "fa:16:3e:67:6b:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7598acc7-af28-40f4-982a-6d357af985e3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '266bd658-1fc0-4568-9346-be7e438edb76', 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkJBEIvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '6ed3c12e-96a8-4a32-8089-f04eba608663', 'attached_at': '', 'detached_at': '', 'volume_id': '5ba8bce8-8d37-4482-954f-fd1da52b23cc', 'serial': '5ba8bce8-8d37-4482-954f-fd1da52b23cc'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.objects.instance [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lazy-loading 'resources' on Instance uuid 6ed3c12e-96a8-4a32-8089-f04eba608663 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.objects.base [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Object Instance<6ed3c12e-96a8-4a32-8089-f04eba608663> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.objects.instance [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lazy-loading 'numa_topology' on Instance uuid 6ed3c12e-96a8-4a32-8089-f04eba608663 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.objects.base [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Object Instance<6ed3c12e-96a8-4a32-8089-f04eba608663> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:24:23 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:24:23 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:24:23 user nova-compute[72820]: DEBUG nova.objects.instance [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6ed3c12e-96a8-4a32-8089-f04eba608663 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG nova.objects.base [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Object Instance<6ed3c12e-96a8-4a32-8089-f04eba608663> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkJBEIvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:24:24 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:24:24 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:24:24 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6a203e-d00f-443c-812d-3688cb3e695e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QkJBEIvV\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 27 02:24:24 user nova-compute[72820]: node.name = iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc
Aug 27 02:24:24 user nova-compute[72820]: node.tpgt = -1
Aug 27 02:24:24 user nova-compute[72820]: node.startup = automatic
Aug 27 02:24:24 user nova-compute[72820]: node.leading_login = No
Aug 27 02:24:24 user nova-compute[72820]: iface.iscsi_ifacename = default
Aug 27 02:24:24 user nova-compute[72820]: iface.net_ifacename = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.ipaddress = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.prefix_len = 0
Aug 27 02:24:24 user nova-compute[72820]: iface.hwaddress = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.transport_name = tcp
Aug 27 02:24:24 user nova-compute[72820]: iface.initiatorname = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.state = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.vlan_id = 0
Aug 27 02:24:24 user nova-compute[72820]: iface.vlan_priority = 0
Aug 27 02:24:24 user nova-compute[72820]: iface.vlan_state = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.iface_num = 0
Aug 27 02:24:24 user nova-compute[72820]: iface.mtu = 0
Aug 27 02:24:24 user nova-compute[72820]: iface.port = 0
Aug 27 02:24:24 user nova-compute[72820]: iface.bootproto = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.subnet_mask = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.gateway = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.dhcp_alt_client_id_state = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.dhcp_alt_client_id = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.dhcp_dns = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.dhcp_learn_iqn = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.dhcp_req_vendor_id_state = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.dhcp_vendor_id_state = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.dhcp_vendor_id = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.dhcp_slp_da = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.fragmentation = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.gratuitous_arp = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.incoming_forwarding = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.tos_state = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.tos = 0
Aug 27 02:24:24 user nova-compute[72820]: iface.ttl = 0
Aug 27 02:24:24 user nova-compute[72820]: iface.delayed_ack = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.tcp_nagle = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.tcp_wsf_state = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.tcp_wsf = 0
Aug 27 02:24:24 user nova-compute[72820]: iface.tcp_timer_scale = 0
Aug 27 02:24:24 user nova-compute[72820]: iface.tcp_timestamp = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.redirect = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.def_task_mgmt_timeout = 0
Aug 27 02:24:24 user nova-compute[72820]: iface.header_digest = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.data_digest = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.immediate_data = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.initial_r2t = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.data_seq_inorder = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.data_pdu_inorder = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.erl = 0
Aug 27 02:24:24 user nova-compute[72820]: iface.max_receive_data_len = 0
Aug 27 02:24:24 user nova-compute[72820]: iface.first_burst_len = 0
Aug 27 02:24:24 user nova-compute[72820]: iface.max_outstanding_r2t = 0
Aug 27 02:24:24 user nova-compute[72820]: iface.max_burst_len = 0
Aug 27 02:24:24 user nova-compute[72820]: iface.chap_auth = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.bidi_chap = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.strict_login_compliance = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.discovery_auth = <empty>
Aug 27 02:24:24 user nova-compute[72820]: iface.discovery_logout = <empty>
Aug 27 02:24:24 user nova-compute[72820]: node.discovery_address = <empty>
Aug 27 02:24:24 user nova-compute[72820]: node.discovery_port = 0
Aug 27 02:24:24 user nova-compute[72820]: node.discovery_type = static
Aug 27 02:24:24 user nova-compute[72820]: node.session.initial_cmdsn = 0
Aug 27 02:24:24 user nova-compute[72820]: node.session.initial_login_retry_max = 8
Aug 27 02:24:24 user nova-compute[72820]: node.session.xmit_thread_priority = -20
Aug 27 02:24:24 user nova-compute[72820]: node.session.cmds_max = 128
Aug 27 02:24:24 user nova-compute[72820]: node.session.queue_depth = 32
Aug 27 02:24:24 user nova-compute[72820]: node.session.nr_sessions = 1
Aug 27 02:24:24 user nova-compute[72820]: node.session.auth.authmethod = CHAP
Aug 27 02:24:24 user nova-compute[72820]: node.session.auth.username = QkJBEIvV
Aug 27 02:24:24 user nova-compute[72820]: node.session.auth.password = ***
Aug 27 02:24:24 user nova-compute[72820]: node.session.auth.username_in = <empty>
Aug 27 02:24:24 user nova-compute[72820]: node.session.auth.password_in = <empty>
Aug 27 02:24:24 user nova-compute[72820]: node.session.auth.chap_algs = MD5
Aug 27 02:24:24 user nova-compute[72820]: node.session.timeo.replacement_timeout = 120
Aug 27 02:24:24 user nova-compute[72820]: node.session.err_timeo.abort_timeout = 15
Aug 27 02:24:24 user nova-compute[72820]: node.session.err_timeo.lu_reset_timeout = 30
Aug 27 02:24:24 user nova-compute[72820]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 27 02:24:24 user nova-compute[72820]: node.session.err_timeo.host_reset_timeout = 60
Aug 27 02:24:24 user nova-compute[72820]: node.session.iscsi.FastAbort = Yes
Aug 27 02:24:24 user nova-compute[72820]: node.session.iscsi.InitialR2T = No
Aug 27 02:24:24 user nova-compute[72820]: node.session.iscsi.ImmediateData = Yes
Aug 27 02:24:24 user nova-compute[72820]: node.session.iscsi.FirstBurstLength = 262144
Aug 27 02:24:24 user nova-compute[72820]: node.session.iscsi.MaxBurstLength = 16776192
Aug 27 02:24:24 user nova-compute[72820]: node.session.iscsi.DefaultTime2Retain = 0
Aug 27 02:24:24 user nova-compute[72820]: node.session.iscsi.DefaultTime2Wait = 2
Aug 27 02:24:24 user nova-compute[72820]: node.session.iscsi.MaxConnections = 1
Aug 27 02:24:24 user nova-compute[72820]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 27 02:24:24 user nova-compute[72820]: node.session.iscsi.ERL = 0
Aug 27 02:24:24 user nova-compute[72820]: node.session.scan = manual
Aug 27 02:24:24 user nova-compute[72820]: node.session.reopen_max = 0
Aug 27 02:24:24 user nova-compute[72820]: node.conn[0].address = 172.16.0.220
Aug 27 02:24:24 user nova-compute[72820]: node.conn[0].port = 3260
Aug 27 02:24:24 user nova-compute[72820]: node.conn[0].startup = manual
Aug 27 02:24:24 user nova-compute[72820]: node.conn[0].tcp.window_size = 524288
Aug 27 02:24:24 user nova-compute[72820]: node.conn[0].tcp.type_of_service = 0
Aug 27 02:24:24 user nova-compute[72820]: node.conn[0].timeo.logout_timeout = 15
Aug 27 02:24:24 user nova-compute[72820]: node.conn[0].timeo.login_timeout = 15
Aug 27 02:24:24 user nova-compute[72820]: node.conn[0].timeo.auth_timeout = 45
Aug 27 02:24:24 user nova-compute[72820]: node.conn[0].timeo.noop_out_interval = 5
Aug 27 02:24:24 user nova-compute[72820]: node.conn[0].timeo.noop_out_timeout = 5
Aug 27 02:24:24 user nova-compute[72820]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 27 02:24:24 user nova-compute[72820]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 27 02:24:24 user nova-compute[72820]: node.conn[0].iscsi.HeaderDigest = None
Aug 27 02:24:24 user nova-compute[72820]: node.conn[0].iscsi.DataDigest = None
Aug 27 02:24:24 user nova-compute[72820]: node.conn[0].iscsi.IFMarker = No
Aug 27 02:24:24 user nova-compute[72820]: node.conn[0].iscsi.OFMarker = No
Aug 27 02:24:24 user nova-compute[72820]: # END RECORD
Aug 27 02:24:24 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbc241f-54a8-4a9c-b06b-5ded57a769ea]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d4dcfd-a20c-4cc9-ae03-2734411145a5]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QkJBEIvV {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QkJBEIvV" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e869926e-8aa1-4ce8-903b-167a6ef4d438]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QkJBEIvV'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb1f09c-e356-4e59-8f49-b1039bfae14e]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93c2150-8d46-4e89-a23b-8de03dd21f5c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:24:24 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:24:24 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:24:24 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:24:24 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:24:24 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:24:24 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:24:24 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:24:24 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.208s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] HCTL ('35', '0', '0', 0) found on session 13 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2def436-9772-489d-8585-67120ec3ef13]: (4, ('0 0 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Searching for a device in session 13 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkJBEIvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.241s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] <== connect_volume: return (242ms) {'type': 'block', 'scsi_wwn': '23533353430303064', 'path': '/dev/sdd'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533353430303064', 'path': '/dev/sdd'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1676535291',display_name='tempest-ServerStableDeviceRescueTest-server-1676535291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1676535291',id=4,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB04yomk5T62vZJSVvoxy9wjx2XDDI3YyI0pgcUSmDJzHCnRqd17erEpyE4qTQ4t3kM+pbWYbc4lokzsskTc9ooGBqn+1IPsE5tH8dB/xD77C2OIF0/l2pafnLZ4Fi0WQ==',key_name='tempest-keypair-2001966138',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:20:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2f0d3ebcd3c470c8927c690914135d9',ramdisk_id='',reservation_id='r-ku0xay81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-561556641',owner_user_name='tempest-ServerStableDeviceRescueTest-561556641-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250575b5f1464f97b2e95bb1c8e46dbd',uuid=6ed3c12e-96a8-4a32-8089-f04eba608663,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "vif_mac": "fa:16:3e:67:6b:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Converting VIF {"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "vif_mac": "fa:16:3e:67:6b:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:6b:e8,bridge_name='br-int',has_traffic_filtering=True,id=dc035bdf-5877-42fe-b1e2-fa882373f836,network=Network(d4eb66d2-6165-4b86-b42b-f2f65c5e97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc035bdf-58') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG nova.objects.instance [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ed3c12e-96a8-4a32-8089-f04eba608663 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG nova.objects.base [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Object Instance<6ed3c12e-96a8-4a32-8089-f04eba608663> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:24:24 user nova-compute[72820]:   <uuid>6ed3c12e-96a8-4a32-8089-f04eba608663</uuid>
Aug 27 02:24:24 user nova-compute[72820]:   <name>instance-00000004</name>
Aug 27 02:24:24 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:24:24 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:24:24 user nova-compute[72820]:   <metadata>
Aug 27 02:24:24 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:24:24 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:24:24 user nova-compute[72820]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1676535291</nova:name>
Aug 27 02:24:24 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:24:23</nova:creationTime>
Aug 27 02:24:24 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:24:24 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:24:24 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:24:24 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:24:24 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:24:24 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:24:24 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:24:24 user nova-compute[72820]:       <nova:owner>
Aug 27 02:24:24 user nova-compute[72820]:         <nova:user uuid="250575b5f1464f97b2e95bb1c8e46dbd">tempest-ServerStableDeviceRescueTest-561556641-project-member</nova:user>
Aug 27 02:24:24 user nova-compute[72820]:         <nova:project uuid="b2f0d3ebcd3c470c8927c690914135d9">tempest-ServerStableDeviceRescueTest-561556641</nova:project>
Aug 27 02:24:24 user nova-compute[72820]:       </nova:owner>
Aug 27 02:24:24 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:24:24 user nova-compute[72820]:       <nova:ports>
Aug 27 02:24:24 user nova-compute[72820]:         <nova:port uuid="dc035bdf-5877-42fe-b1e2-fa882373f836">
Aug 27 02:24:24 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 02:24:24 user nova-compute[72820]:         </nova:port>
Aug 27 02:24:24 user nova-compute[72820]:       </nova:ports>
Aug 27 02:24:24 user nova-compute[72820]:     </nova:instance>
Aug 27 02:24:24 user nova-compute[72820]:   </metadata>
Aug 27 02:24:24 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:24:24 user nova-compute[72820]:     <system>
Aug 27 02:24:24 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:24:24 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:24:24 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:24:24 user nova-compute[72820]:       <entry name="serial">6ed3c12e-96a8-4a32-8089-f04eba608663</entry>
Aug 27 02:24:24 user nova-compute[72820]:       <entry name="uuid">6ed3c12e-96a8-4a32-8089-f04eba608663</entry>
Aug 27 02:24:24 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:24:24 user nova-compute[72820]:     </system>
Aug 27 02:24:24 user nova-compute[72820]:   </sysinfo>
Aug 27 02:24:24 user nova-compute[72820]:   <os>
Aug 27 02:24:24 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:24:24 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:24:24 user nova-compute[72820]:   </os>
Aug 27 02:24:24 user nova-compute[72820]:   <features>
Aug 27 02:24:24 user nova-compute[72820]:     <acpi/>
Aug 27 02:24:24 user nova-compute[72820]:     <apic/>
Aug 27 02:24:24 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:24:24 user nova-compute[72820]:   </features>
Aug 27 02:24:24 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:24:24 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:24:24 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:24:24 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:24:24 user nova-compute[72820]:   </clock>
Aug 27 02:24:24 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:24:24 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:24:24 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:24:24 user nova-compute[72820]:   </cpu>
Aug 27 02:24:24 user nova-compute[72820]:   <devices>
Aug 27 02:24:24 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:24:24 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:24:24 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk"/>
Aug 27 02:24:24 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:24:24 user nova-compute[72820]:     </disk>
Aug 27 02:24:24 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:24:24 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:24:24 user nova-compute[72820]:       <source dev="/dev/sdd"/>
Aug 27 02:24:24 user nova-compute[72820]:       <target dev="vdb" bus="virtio"/>
Aug 27 02:24:24 user nova-compute[72820]:       <serial>5ba8bce8-8d37-4482-954f-fd1da52b23cc</serial>
Aug 27 02:24:24 user nova-compute[72820]:     </disk>
Aug 27 02:24:24 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:24:24 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:24:24 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk.rescue"/>
Aug 27 02:24:24 user nova-compute[72820]:       <target dev="vdc" bus="virtio"/>
Aug 27 02:24:24 user nova-compute[72820]:       <boot order="1"/>
Aug 27 02:24:24 user nova-compute[72820]:     </disk>
Aug 27 02:24:24 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:24:24 user nova-compute[72820]:       <mac address="fa:16:3e:67:6b:e8"/>
Aug 27 02:24:24 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:24:24 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:24:24 user nova-compute[72820]:       <target dev="tapdc035bdf-58"/>
Aug 27 02:24:24 user nova-compute[72820]:     </interface>
Aug 27 02:24:24 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:24:24 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/console.log" append="off"/>
Aug 27 02:24:24 user nova-compute[72820]:     </serial>
Aug 27 02:24:24 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:24:24 user nova-compute[72820]:     <video>
Aug 27 02:24:24 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:24:24 user nova-compute[72820]:     </video>
Aug 27 02:24:24 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:24:24 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:24:24 user nova-compute[72820]:     </rng>
Aug 27 02:24:24 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:24:24 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:24:24 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:24:24 user nova-compute[72820]:     </memballoon>
Aug 27 02:24:24 user nova-compute[72820]:   </devices>
Aug 27 02:24:24 user nova-compute[72820]: </domain>
Aug 27 02:24:24 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:24:24 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Instance destroyed successfully.
Aug 27 02:24:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:24:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] No VIF found with MAC fa:16:3e:67:6b:e8, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:24:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:26 user nova-compute[72820]: DEBUG nova.compute.manager [req-db2d9019-4da6-4dc6-ba0c-227b544645a6 req-e1319043-d1a9-462d-83e5-f54907ec713a service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-db2d9019-4da6-4dc6-ba0c-227b544645a6 req-e1319043-d1a9-462d-83e5-f54907ec713a service nova] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-db2d9019-4da6-4dc6-ba0c-227b544645a6 req-e1319043-d1a9-462d-83e5-f54907ec713a service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-db2d9019-4da6-4dc6-ba0c-227b544645a6 req-e1319043-d1a9-462d-83e5-f54907ec713a service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:26 user nova-compute[72820]: DEBUG nova.compute.manager [req-db2d9019-4da6-4dc6-ba0c-227b544645a6 req-e1319043-d1a9-462d-83e5-f54907ec713a service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] No waiting events found dispatching network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:26 user nova-compute[72820]: WARNING nova.compute.manager [req-db2d9019-4da6-4dc6-ba0c-227b544645a6 req-e1319043-d1a9-462d-83e5-f54907ec713a service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received unexpected event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 for instance with vm_state active and task_state rescuing.
Aug 27 02:24:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:27 user nova-compute[72820]: DEBUG nova.compute.manager [req-f1fc1b44-0b68-4d99-b463-39dfbbdf34e4 req-76b2274d-12f2-47f3-8623-ea6ed7fc5eee service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-changed-73dd97ef-6247-4cbb-bfe3-834c7abd5361 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:27 user nova-compute[72820]: DEBUG nova.compute.manager [req-f1fc1b44-0b68-4d99-b463-39dfbbdf34e4 req-76b2274d-12f2-47f3-8623-ea6ed7fc5eee service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Refreshing instance network info cache due to event network-changed-73dd97ef-6247-4cbb-bfe3-834c7abd5361. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:24:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f1fc1b44-0b68-4d99-b463-39dfbbdf34e4 req-76b2274d-12f2-47f3-8623-ea6ed7fc5eee service nova] Acquiring lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:24:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f1fc1b44-0b68-4d99-b463-39dfbbdf34e4 req-76b2274d-12f2-47f3-8623-ea6ed7fc5eee service nova] Acquired lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:24:27 user nova-compute[72820]: DEBUG nova.network.neutron [req-f1fc1b44-0b68-4d99-b463-39dfbbdf34e4 req-76b2274d-12f2-47f3-8623-ea6ed7fc5eee service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Refreshing network info cache for port 73dd97ef-6247-4cbb-bfe3-834c7abd5361 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:24:28 user nova-compute[72820]: DEBUG nova.network.neutron [req-f1fc1b44-0b68-4d99-b463-39dfbbdf34e4 req-76b2274d-12f2-47f3-8623-ea6ed7fc5eee service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updated VIF entry in instance network info cache for port 73dd97ef-6247-4cbb-bfe3-834c7abd5361. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:24:28 user nova-compute[72820]: DEBUG nova.network.neutron [req-f1fc1b44-0b68-4d99-b463-39dfbbdf34e4 req-76b2274d-12f2-47f3-8623-ea6ed7fc5eee service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updating instance_info_cache with network_info: [{"id": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "address": "fa:16:3e:1e:15:71", "network": {"id": "e238ffcb-d9ec-4d89-830a-0347bcade186", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1932493438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dd97ef-62", "ovs_interfaceid": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23374c0c-55bc-488f-89ec-741193010838", "address": "fa:16:3e:f3:3d:f2", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23374c0c-55", "ovs_interfaceid": "23374c0c-55bc-488f-89ec-741193010838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5633b66-cc90-48c4-becc-c7e78219cb29", "address": "fa:16:3e:c2:bf:70", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5633b66-cc", "ovs_interfaceid": "d5633b66-cc90-48c4-becc-c7e78219cb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "address": "fa:16:3e:33:0f:06", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd213a9b4-5e", "ovs_interfaceid": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "address": "fa:16:3e:70:8d:6d", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8419c8-b3", "ovs_interfaceid": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "address": "fa:16:3e:33:d5:c4", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9405c97c-5d", "ovs_interfaceid": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "address": "fa:16:3e:73:59:e0", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2ad90b-3b", "ovs_interfaceid": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:24:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f1fc1b44-0b68-4d99-b463-39dfbbdf34e4 req-76b2274d-12f2-47f3-8623-ea6ed7fc5eee service nova] Releasing lock "refresh_cache-c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:24:28 user nova-compute[72820]: DEBUG nova.compute.manager [req-fb62f4ac-642c-41d0-8ba7-c443a9292842 req-8e6d7220-c5cc-43fd-b98b-8b42cba5b926 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fb62f4ac-642c-41d0-8ba7-c443a9292842 req-8e6d7220-c5cc-43fd-b98b-8b42cba5b926 service nova] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fb62f4ac-642c-41d0-8ba7-c443a9292842 req-8e6d7220-c5cc-43fd-b98b-8b42cba5b926 service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fb62f4ac-642c-41d0-8ba7-c443a9292842 req-8e6d7220-c5cc-43fd-b98b-8b42cba5b926 service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:28 user nova-compute[72820]: DEBUG nova.compute.manager [req-fb62f4ac-642c-41d0-8ba7-c443a9292842 req-8e6d7220-c5cc-43fd-b98b-8b42cba5b926 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] No waiting events found dispatching network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:28 user nova-compute[72820]: WARNING nova.compute.manager [req-fb62f4ac-642c-41d0-8ba7-c443a9292842 req-8e6d7220-c5cc-43fd-b98b-8b42cba5b926 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received unexpected event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 for instance with vm_state active and task_state rescuing.
Aug 27 02:24:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-b4039385-e02d-45a3-98b3-d2c38e3b5fad tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:24:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Removed pending event for 6ed3c12e-96a8-4a32-8089-f04eba608663 due to event {{(pid=72820) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 02:24:28 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103068.6683056, 6ed3c12e-96a8-4a32-8089-f04eba608663 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:24:28 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] VM Resumed (Lifecycle Event)
Aug 27 02:24:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:24:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:24:28 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 02:24:28 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103068.676693, 6ed3c12e-96a8-4a32-8089-f04eba608663 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:24:28 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] VM Started (Lifecycle Event)
Aug 27 02:24:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:24:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:24:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:29 user nova-compute[72820]: INFO nova.compute.manager [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Terminating instance
Aug 27 02:24:29 user nova-compute[72820]: DEBUG nova.compute.manager [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-30dc9f3c-b308-44c8-bc69-9378805d2243 req-b966be29-b5da-4938-898e-360d63db7265 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-unplugged-23374c0c-55bc-488f-89ec-741193010838 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-30dc9f3c-b308-44c8-bc69-9378805d2243 req-b966be29-b5da-4938-898e-360d63db7265 service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-30dc9f3c-b308-44c8-bc69-9378805d2243 req-b966be29-b5da-4938-898e-360d63db7265 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-30dc9f3c-b308-44c8-bc69-9378805d2243 req-b966be29-b5da-4938-898e-360d63db7265 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-30dc9f3c-b308-44c8-bc69-9378805d2243 req-b966be29-b5da-4938-898e-360d63db7265 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-unplugged-23374c0c-55bc-488f-89ec-741193010838 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-30dc9f3c-b308-44c8-bc69-9378805d2243 req-b966be29-b5da-4938-898e-360d63db7265 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-unplugged-23374c0c-55bc-488f-89ec-741193010838 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-c6ba514c-648a-4600-8caa-b1241115213d req-312a7a88-ef46-482e-9aa4-12f37c105f21 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-unplugged-d5633b66-cc90-48c4-becc-c7e78219cb29 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c6ba514c-648a-4600-8caa-b1241115213d req-312a7a88-ef46-482e-9aa4-12f37c105f21 service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c6ba514c-648a-4600-8caa-b1241115213d req-312a7a88-ef46-482e-9aa4-12f37c105f21 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c6ba514c-648a-4600-8caa-b1241115213d req-312a7a88-ef46-482e-9aa4-12f37c105f21 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-c6ba514c-648a-4600-8caa-b1241115213d req-312a7a88-ef46-482e-9aa4-12f37c105f21 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-unplugged-d5633b66-cc90-48c4-becc-c7e78219cb29 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-c6ba514c-648a-4600-8caa-b1241115213d req-312a7a88-ef46-482e-9aa4-12f37c105f21 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-unplugged-d5633b66-cc90-48c4-becc-c7e78219cb29 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-b6ba6bba-bafb-4e80-9ce6-6e0cd28eefed req-e562d4be-534e-49fa-b3d3-417140587de7 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-unplugged-73dd97ef-6247-4cbb-bfe3-834c7abd5361 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b6ba6bba-bafb-4e80-9ce6-6e0cd28eefed req-e562d4be-534e-49fa-b3d3-417140587de7 service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b6ba6bba-bafb-4e80-9ce6-6e0cd28eefed req-e562d4be-534e-49fa-b3d3-417140587de7 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b6ba6bba-bafb-4e80-9ce6-6e0cd28eefed req-e562d4be-534e-49fa-b3d3-417140587de7 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-b6ba6bba-bafb-4e80-9ce6-6e0cd28eefed req-e562d4be-534e-49fa-b3d3-417140587de7 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-unplugged-73dd97ef-6247-4cbb-bfe3-834c7abd5361 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-b6ba6bba-bafb-4e80-9ce6-6e0cd28eefed req-e562d4be-534e-49fa-b3d3-417140587de7 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-unplugged-73dd97ef-6247-4cbb-bfe3-834c7abd5361 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:32 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Instance destroyed successfully.
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.objects.instance [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lazy-loading 'resources' on Instance uuid c0644b77-33ce-46e4-a6cb-b6322bdc6a9e {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:22:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:22:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "address": "fa:16:3e:1e:15:71", "network": {"id": "e238ffcb-d9ec-4d89-830a-0347bcade186", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1932493438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dd97ef-62", "ovs_interfaceid": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "address": "fa:16:3e:1e:15:71", "network": {"id": "e238ffcb-d9ec-4d89-830a-0347bcade186", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1932493438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dd97ef-62", "ovs_interfaceid": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:15:71,bridge_name='br-int',has_traffic_filtering=True,id=73dd97ef-6247-4cbb-bfe3-834c7abd5361,network=Network(e238ffcb-d9ec-4d89-830a-0347bcade186),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73dd97ef-62') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:15:71,bridge_name='br-int',has_traffic_filtering=True,id=73dd97ef-6247-4cbb-bfe3-834c7abd5361,network=Network(e238ffcb-d9ec-4d89-830a-0347bcade186),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73dd97ef-62') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73dd97ef-62, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:32 user nova-compute[72820]: INFO os_vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:15:71,bridge_name='br-int',has_traffic_filtering=True,id=73dd97ef-6247-4cbb-bfe3-834c7abd5361,network=Network(e238ffcb-d9ec-4d89-830a-0347bcade186),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73dd97ef-62')
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:22:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:22:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23374c0c-55bc-488f-89ec-741193010838", "address": "fa:16:3e:f3:3d:f2", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23374c0c-55", "ovs_interfaceid": "23374c0c-55bc-488f-89ec-741193010838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "23374c0c-55bc-488f-89ec-741193010838", "address": "fa:16:3e:f3:3d:f2", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23374c0c-55", "ovs_interfaceid": "23374c0c-55bc-488f-89ec-741193010838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:f2,bridge_name='br-int',has_traffic_filtering=True,id=23374c0c-55bc-488f-89ec-741193010838,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23374c0c-55') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:f2,bridge_name='br-int',has_traffic_filtering=True,id=23374c0c-55bc-488f-89ec-741193010838,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23374c0c-55') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23374c0c-55, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:32 user nova-compute[72820]: INFO os_vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:f2,bridge_name='br-int',has_traffic_filtering=True,id=23374c0c-55bc-488f-89ec-741193010838,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23374c0c-55')
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:22:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:22:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5633b66-cc90-48c4-becc-c7e78219cb29", "address": "fa:16:3e:c2:bf:70", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5633b66-cc", "ovs_interfaceid": "d5633b66-cc90-48c4-becc-c7e78219cb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "d5633b66-cc90-48c4-becc-c7e78219cb29", "address": "fa:16:3e:c2:bf:70", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5633b66-cc", "ovs_interfaceid": "d5633b66-cc90-48c4-becc-c7e78219cb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:bf:70,bridge_name='br-int',has_traffic_filtering=True,id=d5633b66-cc90-48c4-becc-c7e78219cb29,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5633b66-cc') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:bf:70,bridge_name='br-int',has_traffic_filtering=True,id=d5633b66-cc90-48c4-becc-c7e78219cb29,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5633b66-cc') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5633b66-cc, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:32 user nova-compute[72820]: INFO os_vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:bf:70,bridge_name='br-int',has_traffic_filtering=True,id=d5633b66-cc90-48c4-becc-c7e78219cb29,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5633b66-cc')
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:22:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:22:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "address": "fa:16:3e:33:0f:06", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd213a9b4-5e", "ovs_interfaceid": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "address": "fa:16:3e:33:0f:06", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd213a9b4-5e", "ovs_interfaceid": "d213a9b4-5eaf-476b-9577-d9583e26a6b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:0f:06,bridge_name='br-int',has_traffic_filtering=True,id=d213a9b4-5eaf-476b-9577-d9583e26a6b0,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd213a9b4-5e') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:0f:06,bridge_name='br-int',has_traffic_filtering=True,id=d213a9b4-5eaf-476b-9577-d9583e26a6b0,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd213a9b4-5e') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd213a9b4-5e, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:32 user nova-compute[72820]: INFO os_vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:0f:06,bridge_name='br-int',has_traffic_filtering=True,id=d213a9b4-5eaf-476b-9577-d9583e26a6b0,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd213a9b4-5e')
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:22:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:22:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "address": "fa:16:3e:70:8d:6d", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8419c8-b3", "ovs_interfaceid": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "address": "fa:16:3e:70:8d:6d", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8419c8-b3", "ovs_interfaceid": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:8d:6d,bridge_name='br-int',has_traffic_filtering=True,id=6a8419c8-b3eb-40ec-8f50-2eebcf714f9f,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a8419c8-b3') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:8d:6d,bridge_name='br-int',has_traffic_filtering=True,id=6a8419c8-b3eb-40ec-8f50-2eebcf714f9f,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a8419c8-b3') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a8419c8-b3, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:32 user nova-compute[72820]: INFO os_vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:8d:6d,bridge_name='br-int',has_traffic_filtering=True,id=6a8419c8-b3eb-40ec-8f50-2eebcf714f9f,network=Network(274f7003-d41f-4fac-9b44-d6a4cd116c8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a8419c8-b3')
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:22:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:22:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "address": "fa:16:3e:33:d5:c4", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9405c97c-5d", "ovs_interfaceid": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "address": "fa:16:3e:33:d5:c4", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9405c97c-5d", "ovs_interfaceid": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:d5:c4,bridge_name='br-int',has_traffic_filtering=True,id=9405c97c-5de6-43e5-b9f1-b8cff3272472,network=Network(123788a2-cb47-4b56-bdeb-38a7ca6cc964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9405c97c-5d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:d5:c4,bridge_name='br-int',has_traffic_filtering=True,id=9405c97c-5de6-43e5-b9f1-b8cff3272472,network=Network(123788a2-cb47-4b56-bdeb-38a7ca6cc964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9405c97c-5d') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9405c97c-5d, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:32 user nova-compute[72820]: INFO os_vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:d5:c4,bridge_name='br-int',has_traffic_filtering=True,id=9405c97c-5de6-43e5-b9f1-b8cff3272472,network=Network(123788a2-cb47-4b56-bdeb-38a7ca6cc964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9405c97c-5d')
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-202888074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-202888074',id=10,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjgCM4SmaqIPvQO3GuaVBL6scM6Fy5sRQUvxzrIZ6biDny0ywkkid3n4tSTLEkUhcGWRhQ8Fxf/KLN4jupaoBdh5jNvqHjMuQMungcNcEpey8M181Y4ksTZH+os7qmZHw==',key_name='tempest-keypair-2043407065',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:22:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18e3cfb8d39743be8aeac5c6c2a665c8',ramdisk_id='',reservation_id='r-1j8y201s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1904740609',owner_user_name='tempest-TaggedBootDevicesTest_v242-1904740609-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:22:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db576ff11e7a4258a2f2a5961a06bf89',uuid=c0644b77-33ce-46e4-a6cb-b6322bdc6a9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "address": "fa:16:3e:73:59:e0", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2ad90b-3b", "ovs_interfaceid": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converting VIF {"id": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "address": "fa:16:3e:73:59:e0", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2ad90b-3b", "ovs_interfaceid": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:59:e0,bridge_name='br-int',has_traffic_filtering=True,id=8c2ad90b-3b97-42d3-ab37-bcc1e83feb03,network=Network(123788a2-cb47-4b56-bdeb-38a7ca6cc964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c2ad90b-3b') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:59:e0,bridge_name='br-int',has_traffic_filtering=True,id=8c2ad90b-3b97-42d3-ab37-bcc1e83feb03,network=Network(123788a2-cb47-4b56-bdeb-38a7ca6cc964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c2ad90b-3b') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c2ad90b-3b, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:24:32 user nova-compute[72820]: INFO os_vif [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:59:e0,bridge_name='br-int',has_traffic_filtering=True,id=8c2ad90b-3b97-42d3-ab37-bcc1e83feb03,network=Network(123788a2-cb47-4b56-bdeb-38a7ca6cc964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c2ad90b-3b')
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBRYCMQi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:24:32 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[afee98f4-6f64-4cac-89e5-d11c6df1ecf8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:24:32 user nova-compute[72820]: No targets found.
Aug 27 02:24:32 user nova-compute[72820]: iSNS:
Aug 27 02:24:32 user nova-compute[72820]: No targets found.
Aug 27 02:24:32 user nova-compute[72820]: STATIC:
Aug 27 02:24:32 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc
Aug 27 02:24:32 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:24:32 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:24:32 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341
Aug 27 02:24:32 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:24:32 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:24:32 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b
Aug 27 02:24:32 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:24:32 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:24:32 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633
Aug 27 02:24:32 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:24:32 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:24:32 user nova-compute[72820]: FIRMWARE:
Aug 27 02:24:32 user nova-compute[72820]: No targets found.
Aug 27 02:24:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:24:32 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:24:32 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b29889e-9c77-4ac4-b4b2-40e848e9c648]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[57afd5bf-7bd3-4dd0-9a03-60ff25e92114]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:24:32 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:24:32 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:24:32 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:24:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:24:32 user nova-compute[72820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b (non-flash)
Aug 27 02:24:32 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:24:32 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:24:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a05a1fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b'): ({'sdb'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Removing single pathed devices sdb {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2a2f83-bafe-4472-aee4-6c8e6db1af64]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-23374c0c-55bc-488f-89ec-741193010838 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-23374c0c-55bc-488f-89ec-741193010838 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:32 user nova-compute[72820]: WARNING nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-23374c0c-55bc-488f-89ec-741193010838 for instance with vm_state active and task_state deleting.
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-unplugged-d213a9b4-5eaf-476b-9577-d9583e26a6b0 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-unplugged-d213a9b4-5eaf-476b-9577-d9583e26a6b0 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-unplugged-d213a9b4-5eaf-476b-9577-d9583e26a6b0 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-d213a9b4-5eaf-476b-9577-d9583e26a6b0 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-d213a9b4-5eaf-476b-9577-d9583e26a6b0 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:32 user nova-compute[72820]: WARNING nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-d213a9b4-5eaf-476b-9577-d9583e26a6b0 for instance with vm_state active and task_state deleting.
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-unplugged-9405c97c-5de6-43e5-b9f1-b8cff3272472 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-unplugged-9405c97c-5de6-43e5-b9f1-b8cff3272472 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-unplugged-9405c97c-5de6-43e5-b9f1-b8cff3272472 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-9405c97c-5de6-43e5-b9f1-b8cff3272472 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-9405c97c-5de6-43e5-b9f1-b8cff3272472 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:32 user nova-compute[72820]: WARNING nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-9405c97c-5de6-43e5-b9f1-b8cff3272472 for instance with vm_state active and task_state deleting.
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-unplugged-8c2ad90b-3b97-42d3-ab37-bcc1e83feb03 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-unplugged-8c2ad90b-3b97-42d3-ab37-bcc1e83feb03 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-unplugged-8c2ad90b-3b97-42d3-ab37-bcc1e83feb03 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-8c2ad90b-3b97-42d3-ab37-bcc1e83feb03 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-8c2ad90b-3b97-42d3-ab37-bcc1e83feb03 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:32 user nova-compute[72820]: WARNING nova.compute.manager [req-0a639077-ae08-41da-998a-3be1704bce48 req-ce99a13a-a857-497e-b0ec-c9b9e8b41561 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-8c2ad90b-3b97-42d3-ab37-bcc1e83feb03 for instance with vm_state active and task_state deleting.
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.036s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dd8c39-21f3-47bb-8f06-c43a5c235c74]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-e4c1e530-7aa6-4889-b785-e4d4e1fa0c65 req-72d017f4-613b-4102-850c-811215535118 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-d5633b66-cc90-48c4-becc-c7e78219cb29 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e4c1e530-7aa6-4889-b785-e4d4e1fa0c65 req-72d017f4-613b-4102-850c-811215535118 service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e4c1e530-7aa6-4889-b785-e4d4e1fa0c65 req-72d017f4-613b-4102-850c-811215535118 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e4c1e530-7aa6-4889-b785-e4d4e1fa0c65 req-72d017f4-613b-4102-850c-811215535118 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-e4c1e530-7aa6-4889-b785-e4d4e1fa0c65 req-72d017f4-613b-4102-850c-811215535118 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-d5633b66-cc90-48c4-becc-c7e78219cb29 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:32 user nova-compute[72820]: WARNING nova.compute.manager [req-e4c1e530-7aa6-4889-b785-e4d4e1fa0c65 req-72d017f4-613b-4102-850c-811215535118 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-d5633b66-cc90-48c4-becc-c7e78219cb29 for instance with vm_state active and task_state deleting.
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-e4c1e530-7aa6-4889-b785-e4d4e1fa0c65 req-72d017f4-613b-4102-850c-811215535118 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-unplugged-6a8419c8-b3eb-40ec-8f50-2eebcf714f9f {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e4c1e530-7aa6-4889-b785-e4d4e1fa0c65 req-72d017f4-613b-4102-850c-811215535118 service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e4c1e530-7aa6-4889-b785-e4d4e1fa0c65 req-72d017f4-613b-4102-850c-811215535118 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e4c1e530-7aa6-4889-b785-e4d4e1fa0c65 req-72d017f4-613b-4102-850c-811215535118 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-e4c1e530-7aa6-4889-b785-e4d4e1fa0c65 req-72d017f4-613b-4102-850c-811215535118 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-unplugged-6a8419c8-b3eb-40ec-8f50-2eebcf714f9f {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-e4c1e530-7aa6-4889-b785-e4d4e1fa0c65 req-72d017f4-613b-4102-850c-811215535118 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-unplugged-6a8419c8-b3eb-40ec-8f50-2eebcf714f9f for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-e4c1e530-7aa6-4889-b785-e4d4e1fa0c65 req-72d017f4-613b-4102-850c-811215535118 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-6a8419c8-b3eb-40ec-8f50-2eebcf714f9f {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e4c1e530-7aa6-4889-b785-e4d4e1fa0c65 req-72d017f4-613b-4102-850c-811215535118 service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e4c1e530-7aa6-4889-b785-e4d4e1fa0c65 req-72d017f4-613b-4102-850c-811215535118 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e4c1e530-7aa6-4889-b785-e4d4e1fa0c65 req-72d017f4-613b-4102-850c-811215535118 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-e4c1e530-7aa6-4889-b785-e4d4e1fa0c65 req-72d017f4-613b-4102-850c-811215535118 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-6a8419c8-b3eb-40ec-8f50-2eebcf714f9f {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:32 user nova-compute[72820]: WARNING nova.compute.manager [req-e4c1e530-7aa6-4889-b785-e4d4e1fa0c65 req-72d017f4-613b-4102-850c-811215535118 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-6a8419c8-b3eb-40ec-8f50-2eebcf714f9f for instance with vm_state active and task_state deleting.
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Flushing IO for device /dev/sdb {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-ed578b03-1315-47f7-a77d-70848c9fb685 req-d1d5d32e-46c5-44e5-99cd-8a3fbb928384 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-plugged-73dd97ef-6247-4cbb-bfe3-834c7abd5361 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ed578b03-1315-47f7-a77d-70848c9fb685 req-d1d5d32e-46c5-44e5-99cd-8a3fbb928384 service nova] Acquiring lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ed578b03-1315-47f7-a77d-70848c9fb685 req-d1d5d32e-46c5-44e5-99cd-8a3fbb928384 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ed578b03-1315-47f7-a77d-70848c9fb685 req-d1d5d32e-46c5-44e5-99cd-8a3fbb928384 service nova] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-ed578b03-1315-47f7-a77d-70848c9fb685 req-d1d5d32e-46c5-44e5-99cd-8a3fbb928384 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] No waiting events found dispatching network-vif-plugged-73dd97ef-6247-4cbb-bfe3-834c7abd5361 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:32 user nova-compute[72820]: WARNING nova.compute.manager [req-ed578b03-1315-47f7-a77d-70848c9fb685 req-d1d5d32e-46c5-44e5-99cd-8a3fbb928384 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received unexpected event network-vif-plugged-73dd97ef-6247-4cbb-bfe3-834c7abd5361 for instance with vm_state active and task_state deleting.
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[06662009-9dc6-4569-90a6-7f72b25dcdb2]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f23b51-f6e1-4792-83f9-82855d800ef7]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f7e3c5-2139-4347-ab33-7ed6aad6bd35]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c692391f-eb55-4c7e-bb4d-cf52c4aa1ba3]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b, portal: 172.16.0.220,3260]
Aug 27 02:24:32 user nova-compute[72820]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b, portal: 172.16.0.220,3260] successful.
Aug 27 02:24:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0408d30-fda0-45f6-856a-de9a2a75572b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c3c9b6-4ffe-4c4f-9227-68d2ff71ce34]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] <== disconnect_volume: return (380ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCgiXwAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:24:32 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d400445-154c-4030-9427-7ef7dbdd8ac6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:24:32 user nova-compute[72820]: No targets found.
Aug 27 02:24:32 user nova-compute[72820]: iSNS:
Aug 27 02:24:32 user nova-compute[72820]: No targets found.
Aug 27 02:24:32 user nova-compute[72820]: STATIC:
Aug 27 02:24:32 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc
Aug 27 02:24:32 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:24:32 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:24:32 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341
Aug 27 02:24:32 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:24:32 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:24:32 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633
Aug 27 02:24:32 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:24:32 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:24:32 user nova-compute[72820]: FIRMWARE:
Aug 27 02:24:32 user nova-compute[72820]: No targets found.
Aug 27 02:24:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:24:32 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:24:32 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:24:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ea3cee-0b95-4641-b0bb-141678bed79b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[700f56ea-6299-43a5-9b15-c852c9dc5e5d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:24:33 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:24:33 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:24:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:24:33 user nova-compute[72820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 (non-flash)
Aug 27 02:24:33 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:24:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a05b8b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633'): ({'sdc'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Removing single pathed devices sdc {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce68b9c5-7945-45f0-a643-1d7cce7b37dc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ac8be4-21c7-47a4-b396-892f4048d43e]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Flushing IO for device /dev/sdc {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f7350e-6f70-4914-a8e4-4453d2ce9117]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7a9d30-31e0-4326-918c-fcacbdf7ffb7]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a28ab1-4abb-4dd0-9a59-6159f4cbe882]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9731c37-7eff-4882-b811-0ad37da81894]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633, portal: 172.16.0.220,3260]
Aug 27 02:24:33 user nova-compute[72820]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633, portal: 172.16.0.220,3260] successful.
Aug 27 02:24:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f67fa6-d4bc-404b-bd73-6c4f14bff633 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b95721-c9b2-4602-8f3f-631ad55f8fbd]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] <== disconnect_volume: return (304ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyLPZnjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:24:33 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a106683b-caf6-4f28-ad28-3244daa6c950]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:24:33 user nova-compute[72820]: No targets found.
Aug 27 02:24:33 user nova-compute[72820]: iSNS:
Aug 27 02:24:33 user nova-compute[72820]: No targets found.
Aug 27 02:24:33 user nova-compute[72820]: STATIC:
Aug 27 02:24:33 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc
Aug 27 02:24:33 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:24:33 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:24:33 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341
Aug 27 02:24:33 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:24:33 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:24:33 user nova-compute[72820]: FIRMWARE:
Aug 27 02:24:33 user nova-compute[72820]: No targets found.
Aug 27 02:24:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:24:33 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:24:33 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7135b29-70d5-485b-962f-c1e351f8625a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaafd0e-eb2b-44e2-a779-3375e2271524]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:24:33 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:24:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:24:33 user nova-compute[72820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 (non-flash)
Aug 27 02:24:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a05bbc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341'): ({'sde'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Removing single pathed devices sde {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[95802780-da8c-413c-8537-5b064682638c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c11a4b0-3da1-49d2-a2a1-38360aa7dcba]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Flushing IO for device /dev/sde {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dc8a61-3254-42f1-bb6a-3d7727b75246]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5f202d-d549-451d-b27d-7373ce64620d]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] SCSI volumes sde have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[975089a6-e42b-4a8d-aba0-ff6caa74b940]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca9df18-5bea-4905-8ffe-5931e7ecb030]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341, portal: 172.16.0.220,3260]
Aug 27 02:24:33 user nova-compute[72820]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341, portal: 172.16.0.220,3260] successful.
Aug 27 02:24:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a485c5-4b50-4a42-93e1-cac518f86341 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[072efe52-8ee0-4ce1-b3b1-d49b43082cfc]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] <== disconnect_volume: return (320ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:24:33 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Deleting instance files /opt/stack/data/nova/instances/c0644b77-33ce-46e4-a6cb-b6322bdc6a9e_del
Aug 27 02:24:33 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Deletion of /opt/stack/data/nova/instances/c0644b77-33ce-46e4-a6cb-b6322bdc6a9e_del complete
Aug 27 02:24:33 user nova-compute[72820]: INFO nova.compute.manager [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Took 3.75 seconds to destroy the instance on the hypervisor.
Aug 27 02:24:33 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:24:33 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:24:34 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103059.3395169, 0d99438e-e6d1-4fc3-a399-7e844c8f9538 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:24:34 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] VM Stopped (Lifecycle Event)
Aug 27 02:24:34 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6758f232-081e-412d-87bd-059675c81502 None None] [instance: 0d99438e-e6d1-4fc3-a399-7e844c8f9538] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:24:35 user nova-compute[72820]: DEBUG nova.compute.manager [req-1146f8e6-95af-48a7-89e7-8988f189755a req-4a0884cf-d661-4bc5-85f7-3b2db9a14543 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-deleted-d213a9b4-5eaf-476b-9577-d9583e26a6b0 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:35 user nova-compute[72820]: INFO nova.compute.manager [req-1146f8e6-95af-48a7-89e7-8988f189755a req-4a0884cf-d661-4bc5-85f7-3b2db9a14543 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Neutron deleted interface d213a9b4-5eaf-476b-9577-d9583e26a6b0; detaching it from the instance and deleting it from the info cache
Aug 27 02:24:35 user nova-compute[72820]: DEBUG nova.network.neutron [req-1146f8e6-95af-48a7-89e7-8988f189755a req-4a0884cf-d661-4bc5-85f7-3b2db9a14543 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updating instance_info_cache with network_info: [{"id": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "address": "fa:16:3e:1e:15:71", "network": {"id": "e238ffcb-d9ec-4d89-830a-0347bcade186", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1932493438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dd97ef-62", "ovs_interfaceid": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23374c0c-55bc-488f-89ec-741193010838", "address": "fa:16:3e:f3:3d:f2", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23374c0c-55", "ovs_interfaceid": "23374c0c-55bc-488f-89ec-741193010838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5633b66-cc90-48c4-becc-c7e78219cb29", "address": "fa:16:3e:c2:bf:70", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5633b66-cc", "ovs_interfaceid": "d5633b66-cc90-48c4-becc-c7e78219cb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "address": "fa:16:3e:70:8d:6d", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8419c8-b3", "ovs_interfaceid": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "address": "fa:16:3e:33:d5:c4", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9405c97c-5d", "ovs_interfaceid": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "address": "fa:16:3e:73:59:e0", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2ad90b-3b", "ovs_interfaceid": "8c2ad90b-3b97-42d3-ab37-bcc1e83feb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:24:35 user nova-compute[72820]: DEBUG nova.compute.manager [req-1146f8e6-95af-48a7-89e7-8988f189755a req-4a0884cf-d661-4bc5-85f7-3b2db9a14543 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Detach interface failed, port_id=d213a9b4-5eaf-476b-9577-d9583e26a6b0, reason: Instance c0644b77-33ce-46e4-a6cb-b6322bdc6a9e could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 02:24:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Acquiring lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Acquiring lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:37 user nova-compute[72820]: INFO nova.compute.manager [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Terminating instance
Aug 27 02:24:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-334b9fad-5699-4cc6-8fb5-bcedf88c0370 req-c9cb8553-f607-4495-8e0d-cf3bd9e6b1c1 service nova] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Received event network-vif-unplugged-a4cb14fa-35f7-4063-a940-2eef65a83094 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-334b9fad-5699-4cc6-8fb5-bcedf88c0370 req-c9cb8553-f607-4495-8e0d-cf3bd9e6b1c1 service nova] Acquiring lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-334b9fad-5699-4cc6-8fb5-bcedf88c0370 req-c9cb8553-f607-4495-8e0d-cf3bd9e6b1c1 service nova] Lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-334b9fad-5699-4cc6-8fb5-bcedf88c0370 req-c9cb8553-f607-4495-8e0d-cf3bd9e6b1c1 service nova] Lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-334b9fad-5699-4cc6-8fb5-bcedf88c0370 req-c9cb8553-f607-4495-8e0d-cf3bd9e6b1c1 service nova] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] No waiting events found dispatching network-vif-unplugged-a4cb14fa-35f7-4063-a940-2eef65a83094 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-334b9fad-5699-4cc6-8fb5-bcedf88c0370 req-c9cb8553-f607-4495-8e0d-cf3bd9e6b1c1 service nova] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Received event network-vif-unplugged-a4cb14fa-35f7-4063-a940-2eef65a83094 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:24:37 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Instance destroyed successfully.
Aug 27 02:24:37 user nova-compute[72820]: DEBUG nova.objects.instance [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Lazy-loading 'resources' on Instance uuid 717fb1d8-6d09-440b-bc50-7132a8ebe8d9 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-e5b1abc7-965f-4898-8189-1aa744d2fbbd req-861899fd-d2ef-4083-af82-7bfe70899322 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-deleted-8c2ad90b-3b97-42d3-ab37-bcc1e83feb03 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:37 user nova-compute[72820]: INFO nova.compute.manager [req-e5b1abc7-965f-4898-8189-1aa744d2fbbd req-861899fd-d2ef-4083-af82-7bfe70899322 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Neutron deleted interface 8c2ad90b-3b97-42d3-ab37-bcc1e83feb03; detaching it from the instance and deleting it from the info cache
Aug 27 02:24:37 user nova-compute[72820]: DEBUG nova.network.neutron [req-e5b1abc7-965f-4898-8189-1aa744d2fbbd req-861899fd-d2ef-4083-af82-7bfe70899322 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updating instance_info_cache with network_info: [{"id": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "address": "fa:16:3e:1e:15:71", "network": {"id": "e238ffcb-d9ec-4d89-830a-0347bcade186", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1932493438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dd97ef-62", "ovs_interfaceid": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23374c0c-55bc-488f-89ec-741193010838", "address": "fa:16:3e:f3:3d:f2", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23374c0c-55", "ovs_interfaceid": "23374c0c-55bc-488f-89ec-741193010838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5633b66-cc90-48c4-becc-c7e78219cb29", "address": "fa:16:3e:c2:bf:70", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5633b66-cc", "ovs_interfaceid": "d5633b66-cc90-48c4-becc-c7e78219cb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "address": "fa:16:3e:70:8d:6d", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8419c8-b3", "ovs_interfaceid": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "address": "fa:16:3e:33:d5:c4", "network": {"id": "123788a2-cb47-4b56-bdeb-38a7ca6cc964", "bridge": "br-int", "label": "tempest-device-tagging-net2-787674605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9405c97c-5d", "ovs_interfaceid": "9405c97c-5de6-43e5-b9f1-b8cff3272472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1137563261',display_name='tempest-VolumesActionsTest-instance-1137563261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1137563261',id=11,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:22:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c569ce2e5c548d891e3a20961f941c4',ramdisk_id='',reservation_id='r-34wfg8qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1929444069',owner_user_name='tempest-VolumesActionsTest-1929444069-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:22:35Z,user_data=None,user_id='1a40eb2b2f734333991595552aea697d',uuid=717fb1d8-6d09-440b-bc50-7132a8ebe8d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4cb14fa-35f7-4063-a940-2eef65a83094", "address": "fa:16:3e:be:1c:c8", "network": {"id": "76fd0f4e-ddb4-41ec-b2d0-ac28d7174226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553554658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c569ce2e5c548d891e3a20961f941c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb14fa-35", "ovs_interfaceid": "a4cb14fa-35f7-4063-a940-2eef65a83094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Converting VIF {"id": "a4cb14fa-35f7-4063-a940-2eef65a83094", "address": "fa:16:3e:be:1c:c8", "network": {"id": "76fd0f4e-ddb4-41ec-b2d0-ac28d7174226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553554658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c569ce2e5c548d891e3a20961f941c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb14fa-35", "ovs_interfaceid": "a4cb14fa-35f7-4063-a940-2eef65a83094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:c8,bridge_name='br-int',has_traffic_filtering=True,id=a4cb14fa-35f7-4063-a940-2eef65a83094,network=Network(76fd0f4e-ddb4-41ec-b2d0-ac28d7174226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb14fa-35') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG os_vif [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:c8,bridge_name='br-int',has_traffic_filtering=True,id=a4cb14fa-35f7-4063-a940-2eef65a83094,network=Network(76fd0f4e-ddb4-41ec-b2d0-ac28d7174226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb14fa-35') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4cb14fa-35, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:24:37 user nova-compute[72820]: INFO os_vif [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:c8,bridge_name='br-int',has_traffic_filtering=True,id=a4cb14fa-35f7-4063-a940-2eef65a83094,network=Network(76fd0f4e-ddb4-41ec-b2d0-ac28d7174226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb14fa-35')
Aug 27 02:24:37 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Deleting instance files /opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9_del
Aug 27 02:24:37 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Deletion of /opt/stack/data/nova/instances/717fb1d8-6d09-440b-bc50-7132a8ebe8d9_del complete
Aug 27 02:24:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-e5b1abc7-965f-4898-8189-1aa744d2fbbd req-861899fd-d2ef-4083-af82-7bfe70899322 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Detach interface failed, port_id=8c2ad90b-3b97-42d3-ab37-bcc1e83feb03, reason: Instance c0644b77-33ce-46e4-a6cb-b6322bdc6a9e could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-e5b1abc7-965f-4898-8189-1aa744d2fbbd req-861899fd-d2ef-4083-af82-7bfe70899322 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-deleted-9405c97c-5de6-43e5-b9f1-b8cff3272472 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:37 user nova-compute[72820]: INFO nova.compute.manager [req-e5b1abc7-965f-4898-8189-1aa744d2fbbd req-861899fd-d2ef-4083-af82-7bfe70899322 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Neutron deleted interface 9405c97c-5de6-43e5-b9f1-b8cff3272472; detaching it from the instance and deleting it from the info cache
Aug 27 02:24:37 user nova-compute[72820]: DEBUG nova.network.neutron [req-e5b1abc7-965f-4898-8189-1aa744d2fbbd req-861899fd-d2ef-4083-af82-7bfe70899322 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updating instance_info_cache with network_info: [{"id": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "address": "fa:16:3e:1e:15:71", "network": {"id": "e238ffcb-d9ec-4d89-830a-0347bcade186", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1932493438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dd97ef-62", "ovs_interfaceid": "73dd97ef-6247-4cbb-bfe3-834c7abd5361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23374c0c-55bc-488f-89ec-741193010838", "address": "fa:16:3e:f3:3d:f2", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23374c0c-55", "ovs_interfaceid": "23374c0c-55bc-488f-89ec-741193010838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5633b66-cc90-48c4-becc-c7e78219cb29", "address": "fa:16:3e:c2:bf:70", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5633b66-cc", "ovs_interfaceid": "d5633b66-cc90-48c4-becc-c7e78219cb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "address": "fa:16:3e:70:8d:6d", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8419c8-b3", "ovs_interfaceid": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-e5b1abc7-965f-4898-8189-1aa744d2fbbd req-861899fd-d2ef-4083-af82-7bfe70899322 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Detach interface failed, port_id=9405c97c-5de6-43e5-b9f1-b8cff3272472, reason: Instance c0644b77-33ce-46e4-a6cb-b6322bdc6a9e could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 02:24:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-e5b1abc7-965f-4898-8189-1aa744d2fbbd req-861899fd-d2ef-4083-af82-7bfe70899322 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-deleted-73dd97ef-6247-4cbb-bfe3-834c7abd5361 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:37 user nova-compute[72820]: INFO nova.compute.manager [req-e5b1abc7-965f-4898-8189-1aa744d2fbbd req-861899fd-d2ef-4083-af82-7bfe70899322 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Neutron deleted interface 73dd97ef-6247-4cbb-bfe3-834c7abd5361; detaching it from the instance and deleting it from the info cache
Aug 27 02:24:37 user nova-compute[72820]: DEBUG nova.network.neutron [req-e5b1abc7-965f-4898-8189-1aa744d2fbbd req-861899fd-d2ef-4083-af82-7bfe70899322 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updating instance_info_cache with network_info: [{"id": "23374c0c-55bc-488f-89ec-741193010838", "address": "fa:16:3e:f3:3d:f2", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23374c0c-55", "ovs_interfaceid": "23374c0c-55bc-488f-89ec-741193010838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5633b66-cc90-48c4-becc-c7e78219cb29", "address": "fa:16:3e:c2:bf:70", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5633b66-cc", "ovs_interfaceid": "d5633b66-cc90-48c4-becc-c7e78219cb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "address": "fa:16:3e:70:8d:6d", "network": {"id": "274f7003-d41f-4fac-9b44-d6a4cd116c8d", "bridge": "br-int", "label": "tempest-device-tagging-net1-920696045", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "18e3cfb8d39743be8aeac5c6c2a665c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8419c8-b3", "ovs_interfaceid": "6a8419c8-b3eb-40ec-8f50-2eebcf714f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:24:38 user nova-compute[72820]: INFO nova.compute.manager [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 27 02:24:38 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:24:38 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:24:38 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:24:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-e5b1abc7-965f-4898-8189-1aa744d2fbbd req-861899fd-d2ef-4083-af82-7bfe70899322 service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Detach interface failed, port_id=73dd97ef-6247-4cbb-bfe3-834c7abd5361, reason: Instance c0644b77-33ce-46e4-a6cb-b6322bdc6a9e could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 02:24:38 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:24:38 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Took 4.55 seconds to deallocate network for instance.
Aug 27 02:24:39 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:24:39 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Took 1.14 seconds to deallocate network for instance.
Aug 27 02:24:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:39 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:24:39 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:24:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-fdf94808-7d5e-4bc5-9754-fc9bfa5e54f9 req-70dc4498-e4f6-41ad-aab3-f69efeb3c391 service nova] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Received event network-vif-plugged-a4cb14fa-35f7-4063-a940-2eef65a83094 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fdf94808-7d5e-4bc5-9754-fc9bfa5e54f9 req-70dc4498-e4f6-41ad-aab3-f69efeb3c391 service nova] Acquiring lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fdf94808-7d5e-4bc5-9754-fc9bfa5e54f9 req-70dc4498-e4f6-41ad-aab3-f69efeb3c391 service nova] Lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fdf94808-7d5e-4bc5-9754-fc9bfa5e54f9 req-70dc4498-e4f6-41ad-aab3-f69efeb3c391 service nova] Lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-fdf94808-7d5e-4bc5-9754-fc9bfa5e54f9 req-70dc4498-e4f6-41ad-aab3-f69efeb3c391 service nova] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] No waiting events found dispatching network-vif-plugged-a4cb14fa-35f7-4063-a940-2eef65a83094 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:39 user nova-compute[72820]: WARNING nova.compute.manager [req-fdf94808-7d5e-4bc5-9754-fc9bfa5e54f9 req-70dc4498-e4f6-41ad-aab3-f69efeb3c391 service nova] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Received unexpected event network-vif-plugged-a4cb14fa-35f7-4063-a940-2eef65a83094 for instance with vm_state deleted and task_state None.
Aug 27 02:24:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-fdf94808-7d5e-4bc5-9754-fc9bfa5e54f9 req-70dc4498-e4f6-41ad-aab3-f69efeb3c391 service nova] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Received event network-vif-deleted-a4cb14fa-35f7-4063-a940-2eef65a83094 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.488s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:39 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Deleted allocations for instance 717fb1d8-6d09-440b-bc50-7132a8ebe8d9
Aug 27 02:24:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-b2478342-c30a-4ec3-bfb3-277aca317cc1 req-e1f5a325-9b01-4956-a040-8fd85e5b0fef service nova] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Received event network-vif-deleted-6a8419c8-b3eb-40ec-8f50-2eebcf714f9f {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8fe8fe71-be1e-4737-8e98-be1a3ffc4861 tempest-VolumesActionsTest-1929444069 tempest-VolumesActionsTest-1929444069-project-member] Lock "717fb1d8-6d09-440b-bc50-7132a8ebe8d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.742s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:41 user nova-compute[72820]: INFO nova.compute.manager [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Took 2.87 seconds to detach 3 volumes for instance.
Aug 27 02:24:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:41 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:24:41 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:24:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:41 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Deleted allocations for instance c0644b77-33ce-46e4-a6cb-b6322bdc6a9e
Aug 27 02:24:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-054922c2-bb4e-44d6-8246-00fc196f9c7c tempest-TaggedBootDevicesTest_v242-1904740609 tempest-TaggedBootDevicesTest_v242-1904740609-project-member] Lock "c0644b77-33ce-46e4-a6cb-b6322bdc6a9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.709s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:47 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103072.1578305, c0644b77-33ce-46e4-a6cb-b6322bdc6a9e => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:24:47 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] VM Stopped (Lifecycle Event)
Aug 27 02:24:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e401a91a-80a2-480d-b996-19eff666c39c None None] [instance: c0644b77-33ce-46e4-a6cb-b6322bdc6a9e] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:24:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Acquiring lock "abe48a87-2a54-468d-98e5-afae2577e541" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "abe48a87-2a54-468d-98e5-afae2577e541" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Acquiring lock "abe48a87-2a54-468d-98e5-afae2577e541-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "abe48a87-2a54-468d-98e5-afae2577e541-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "abe48a87-2a54-468d-98e5-afae2577e541-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:51 user nova-compute[72820]: INFO nova.compute.manager [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Terminating instance
Aug 27 02:24:51 user nova-compute[72820]: DEBUG nova.compute.manager [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:24:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-36c5f950-afe9-42ab-888c-f57a599932fe req-190968f2-c989-42e3-bac6-cd853b78de33 service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Received event network-vif-unplugged-7f134260-3849-4dea-bc03-f14fa02d4e17 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-36c5f950-afe9-42ab-888c-f57a599932fe req-190968f2-c989-42e3-bac6-cd853b78de33 service nova] Acquiring lock "abe48a87-2a54-468d-98e5-afae2577e541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-36c5f950-afe9-42ab-888c-f57a599932fe req-190968f2-c989-42e3-bac6-cd853b78de33 service nova] Lock "abe48a87-2a54-468d-98e5-afae2577e541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-36c5f950-afe9-42ab-888c-f57a599932fe req-190968f2-c989-42e3-bac6-cd853b78de33 service nova] Lock "abe48a87-2a54-468d-98e5-afae2577e541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-36c5f950-afe9-42ab-888c-f57a599932fe req-190968f2-c989-42e3-bac6-cd853b78de33 service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] No waiting events found dispatching network-vif-unplugged-7f134260-3849-4dea-bc03-f14fa02d4e17 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-36c5f950-afe9-42ab-888c-f57a599932fe req-190968f2-c989-42e3-bac6-cd853b78de33 service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Received event network-vif-unplugged-7f134260-3849-4dea-bc03-f14fa02d4e17 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:52 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Instance destroyed successfully.
Aug 27 02:24:52 user nova-compute[72820]: DEBUG nova.objects.instance [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lazy-loading 'resources' on Instance uuid abe48a87-2a54-468d-98e5-afae2577e541 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-953097995',display_name='tempest-TestVolumeSwap-server-953097995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-953097995',id=8,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoz2u142IJT8XJGXdw3UfSoburxqSszh/xiQAXLHnK60gdoLcZzd2wDn3FqLScZkoDc+5ULhfLQbYXGZdmf1WgEDwkXl5ztutqIReCYhQBSjYZooP1j3oPXiY5cpJDCkQ==',key_name='tempest-keypair-1244368154',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:21:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='390ad1b0be83481fa07c91e508c5cfd8',ramdisk_id='',reservation_id='r-17m3skli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1356089657',owner_user_name='tempest-TestVolumeSwap-1356089657-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17f292f6541f4b77a29c3b48933ecddb',uuid=abe48a87-2a54-468d-98e5-afae2577e541,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f134260-3849-4dea-bc03-f14fa02d4e17", "address": "fa:16:3e:fc:a5:b0", "network": {"id": "fe558211-ecb3-4bc8-b195-e03c52142d69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-252580199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390ad1b0be83481fa07c91e508c5cfd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f134260-38", "ovs_interfaceid": "7f134260-3849-4dea-bc03-f14fa02d4e17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Converting VIF {"id": "7f134260-3849-4dea-bc03-f14fa02d4e17", "address": "fa:16:3e:fc:a5:b0", "network": {"id": "fe558211-ecb3-4bc8-b195-e03c52142d69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-252580199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390ad1b0be83481fa07c91e508c5cfd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f134260-38", "ovs_interfaceid": "7f134260-3849-4dea-bc03-f14fa02d4e17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:a5:b0,bridge_name='br-int',has_traffic_filtering=True,id=7f134260-3849-4dea-bc03-f14fa02d4e17,network=Network(fe558211-ecb3-4bc8-b195-e03c52142d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f134260-38') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG os_vif [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:a5:b0,bridge_name='br-int',has_traffic_filtering=True,id=7f134260-3849-4dea-bc03-f14fa02d4e17,network=Network(fe558211-ecb3-4bc8-b195-e03c52142d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f134260-38') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f134260-38, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:24:52 user nova-compute[72820]: INFO os_vif [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:a5:b0,bridge_name='br-int',has_traffic_filtering=True,id=7f134260-3849-4dea-bc03-f14fa02d4e17,network=Network(fe558211-ecb3-4bc8-b195-e03c52142d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f134260-38')
Aug 27 02:24:52 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Deleting instance files /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541_del
Aug 27 02:24:52 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Deletion of /opt/stack/data/nova/instances/abe48a87-2a54-468d-98e5-afae2577e541_del complete
Aug 27 02:24:52 user nova-compute[72820]: INFO nova.compute.manager [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 27 02:24:52 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: abe48a87-2a54-468d-98e5-afae2577e541] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:24:52 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103077.7906146, 717fb1d8-6d09-440b-bc50-7132a8ebe8d9 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:24:52 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] VM Stopped (Lifecycle Event)
Aug 27 02:24:52 user nova-compute[72820]: DEBUG nova.compute.manager [None req-63e4bba2-cdda-4720-ab38-b9ff96f33b1b None None] [instance: 717fb1d8-6d09-440b-bc50-7132a8ebe8d9] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:24:53 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:24:53 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Took 1.00 seconds to deallocate network for instance.
Aug 27 02:24:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-389b0621-b950-4380-8c10-6c795ce5a821 req-ecb23ff2-3626-4d84-a96c-ac04f560395f service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Received event network-vif-deleted-7f134260-3849-4dea-bc03-f14fa02d4e17 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:54 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:24:54 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:24:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:54 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Deleted allocations for instance abe48a87-2a54-468d-98e5-afae2577e541
Aug 27 02:24:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-436f6b0b-2229-4530-8d08-14091672bdd2 req-6b4a7e8d-90e3-4a55-ab75-58ac82ac18fe service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Received event network-vif-plugged-7f134260-3849-4dea-bc03-f14fa02d4e17 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-436f6b0b-2229-4530-8d08-14091672bdd2 req-6b4a7e8d-90e3-4a55-ab75-58ac82ac18fe service nova] Acquiring lock "abe48a87-2a54-468d-98e5-afae2577e541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-436f6b0b-2229-4530-8d08-14091672bdd2 req-6b4a7e8d-90e3-4a55-ab75-58ac82ac18fe service nova] Lock "abe48a87-2a54-468d-98e5-afae2577e541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-436f6b0b-2229-4530-8d08-14091672bdd2 req-6b4a7e8d-90e3-4a55-ab75-58ac82ac18fe service nova] Lock "abe48a87-2a54-468d-98e5-afae2577e541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-436f6b0b-2229-4530-8d08-14091672bdd2 req-6b4a7e8d-90e3-4a55-ab75-58ac82ac18fe service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] No waiting events found dispatching network-vif-plugged-7f134260-3849-4dea-bc03-f14fa02d4e17 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:54 user nova-compute[72820]: WARNING nova.compute.manager [req-436f6b0b-2229-4530-8d08-14091672bdd2 req-6b4a7e8d-90e3-4a55-ab75-58ac82ac18fe service nova] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Received unexpected event network-vif-plugged-7f134260-3849-4dea-bc03-f14fa02d4e17 for instance with vm_state deleted and task_state None.
Aug 27 02:24:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d25f28aa-3549-422e-9ac3-834df5a8864f tempest-TestVolumeSwap-1356089657 tempest-TestVolumeSwap-1356089657-project-member] Lock "abe48a87-2a54-468d-98e5-afae2577e541" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.557s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:58 user nova-compute[72820]: INFO nova.compute.manager [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Rescuing
Aug 27 02:24:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:24:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquired lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:24:58 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:24:59 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Updating instance_info_cache with network_info: [{"id": "4a579280-0dce-49fb-861a-4577ba1d70a3", "address": "fa:16:3e:37:4e:12", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a579280-0d", "ovs_interfaceid": "4a579280-0dce-49fb-861a-4577ba1d70a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:24:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Releasing lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:24:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-9c14ab76-2311-4806-9b8f-42ad0faa73fa req-85601ca4-8036-454a-846b-77eacfbb5997 service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received event network-vif-unplugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:24:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9c14ab76-2311-4806-9b8f-42ad0faa73fa req-85601ca4-8036-454a-846b-77eacfbb5997 service nova] Acquiring lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:24:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9c14ab76-2311-4806-9b8f-42ad0faa73fa req-85601ca4-8036-454a-846b-77eacfbb5997 service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:24:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9c14ab76-2311-4806-9b8f-42ad0faa73fa req-85601ca4-8036-454a-846b-77eacfbb5997 service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:24:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-9c14ab76-2311-4806-9b8f-42ad0faa73fa req-85601ca4-8036-454a-846b-77eacfbb5997 service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] No waiting events found dispatching network-vif-unplugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:24:59 user nova-compute[72820]: WARNING nova.compute.manager [req-9c14ab76-2311-4806-9b8f-42ad0faa73fa req-85601ca4-8036-454a-846b-77eacfbb5997 service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received unexpected event network-vif-unplugged-4a579280-0dce-49fb-861a-4577ba1d70a3 for instance with vm_state active and task_state rescuing.
Aug 27 02:24:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:24:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:00 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Instance destroyed successfully.
Aug 27 02:25:00 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Attempting rescue
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72820) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Instance directory exists: not creating {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 02:25:00 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Creating image(s)
Aug 27 02:25:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "/opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "/opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "/opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.objects.instance [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'trusted_certs' on Instance uuid 26581695-c4b9-40b8-ab7a-34c99db0dadb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.193s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk.rescue {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk.rescue" returned: 0 in 0.058s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.objects.instance [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'migration_context' on Instance uuid 26581695-c4b9-40b8-ab7a-34c99db0dadb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.objects.base [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Object Instance<26581695-c4b9-40b8-ab7a-34c99db0dadb> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Start _get_guest_xml network_info=[{"id": "4a579280-0dce-49fb-861a-4577ba1d70a3", "address": "fa:16:3e:37:4e:12", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "vif_mac": "fa:16:3e:37:4e:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a579280-0d", "ovs_interfaceid": "4a579280-0dce-49fb-861a-4577ba1d70a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.objects.instance [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'resources' on Instance uuid 26581695-c4b9-40b8-ab7a-34c99db0dadb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.objects.base [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Object Instance<26581695-c4b9-40b8-ab7a-34c99db0dadb> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.objects.instance [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'numa_topology' on Instance uuid 26581695-c4b9-40b8-ab7a-34c99db0dadb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.objects.base [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Object Instance<26581695-c4b9-40b8-ab7a-34c99db0dadb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:25:00 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:25:00 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.objects.instance [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'vcpu_model' on Instance uuid 26581695-c4b9-40b8-ab7a-34c99db0dadb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.objects.base [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Object Instance<26581695-c4b9-40b8-ab7a-34c99db0dadb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1979247934',display_name='tempest-ServerRescueNegativeTestJSON-server-1979247934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1979247934',id=2,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:20:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca683dd78dbf41ec8fbe3d3f76011272',ramdisk_id='',reservation_id='r-wryc5lmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1600105144',owner_user_name='tempest-ServerRescueNegativeTestJSON-1600105144-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:20:25Z,user_data=None,user_id='a7f59dea3a6f4315828320a9ae6c721d',uuid=26581695-c4b9-40b8-ab7a-34c99db0dadb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a579280-0dce-49fb-861a-4577ba1d70a3", "address": "fa:16:3e:37:4e:12", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "vif_mac": "fa:16:3e:37:4e:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a579280-0d", "ovs_interfaceid": "4a579280-0dce-49fb-861a-4577ba1d70a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converting VIF {"id": "4a579280-0dce-49fb-861a-4577ba1d70a3", "address": "fa:16:3e:37:4e:12", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "vif_mac": "fa:16:3e:37:4e:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a579280-0d", "ovs_interfaceid": "4a579280-0dce-49fb-861a-4577ba1d70a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:4e:12,bridge_name='br-int',has_traffic_filtering=True,id=4a579280-0dce-49fb-861a-4577ba1d70a3,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a579280-0d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.objects.instance [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'pci_devices' on Instance uuid 26581695-c4b9-40b8-ab7a-34c99db0dadb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.objects.base [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Object Instance<26581695-c4b9-40b8-ab7a-34c99db0dadb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:25:00 user nova-compute[72820]:   <uuid>26581695-c4b9-40b8-ab7a-34c99db0dadb</uuid>
Aug 27 02:25:00 user nova-compute[72820]:   <name>instance-00000002</name>
Aug 27 02:25:00 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:25:00 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:25:00 user nova-compute[72820]:   <metadata>
Aug 27 02:25:00 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:25:00 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:25:00 user nova-compute[72820]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1979247934</nova:name>
Aug 27 02:25:00 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:25:00</nova:creationTime>
Aug 27 02:25:00 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:25:00 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:25:00 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:25:00 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:25:00 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:25:00 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:25:00 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:25:00 user nova-compute[72820]:       <nova:owner>
Aug 27 02:25:00 user nova-compute[72820]:         <nova:user uuid="a7f59dea3a6f4315828320a9ae6c721d">tempest-ServerRescueNegativeTestJSON-1600105144-project-member</nova:user>
Aug 27 02:25:00 user nova-compute[72820]:         <nova:project uuid="ca683dd78dbf41ec8fbe3d3f76011272">tempest-ServerRescueNegativeTestJSON-1600105144</nova:project>
Aug 27 02:25:00 user nova-compute[72820]:       </nova:owner>
Aug 27 02:25:00 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:25:00 user nova-compute[72820]:       <nova:ports>
Aug 27 02:25:00 user nova-compute[72820]:         <nova:port uuid="4a579280-0dce-49fb-861a-4577ba1d70a3">
Aug 27 02:25:00 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 02:25:00 user nova-compute[72820]:         </nova:port>
Aug 27 02:25:00 user nova-compute[72820]:       </nova:ports>
Aug 27 02:25:00 user nova-compute[72820]:     </nova:instance>
Aug 27 02:25:00 user nova-compute[72820]:   </metadata>
Aug 27 02:25:00 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:25:00 user nova-compute[72820]:     <system>
Aug 27 02:25:00 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:25:00 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:25:00 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:25:00 user nova-compute[72820]:       <entry name="serial">26581695-c4b9-40b8-ab7a-34c99db0dadb</entry>
Aug 27 02:25:00 user nova-compute[72820]:       <entry name="uuid">26581695-c4b9-40b8-ab7a-34c99db0dadb</entry>
Aug 27 02:25:00 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:25:00 user nova-compute[72820]:     </system>
Aug 27 02:25:00 user nova-compute[72820]:   </sysinfo>
Aug 27 02:25:00 user nova-compute[72820]:   <os>
Aug 27 02:25:00 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:25:00 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:25:00 user nova-compute[72820]:   </os>
Aug 27 02:25:00 user nova-compute[72820]:   <features>
Aug 27 02:25:00 user nova-compute[72820]:     <acpi/>
Aug 27 02:25:00 user nova-compute[72820]:     <apic/>
Aug 27 02:25:00 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:25:00 user nova-compute[72820]:   </features>
Aug 27 02:25:00 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:25:00 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:25:00 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:25:00 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:25:00 user nova-compute[72820]:   </clock>
Aug 27 02:25:00 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:25:00 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:25:00 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:25:00 user nova-compute[72820]:   </cpu>
Aug 27 02:25:00 user nova-compute[72820]:   <devices>
Aug 27 02:25:00 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:25:00 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:25:00 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk.rescue"/>
Aug 27 02:25:00 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:25:00 user nova-compute[72820]:     </disk>
Aug 27 02:25:00 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:25:00 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:25:00 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk"/>
Aug 27 02:25:00 user nova-compute[72820]:       <target dev="vdb" bus="virtio"/>
Aug 27 02:25:00 user nova-compute[72820]:     </disk>
Aug 27 02:25:00 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:25:00 user nova-compute[72820]:       <mac address="fa:16:3e:37:4e:12"/>
Aug 27 02:25:00 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:25:00 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:25:00 user nova-compute[72820]:       <target dev="tap4a579280-0d"/>
Aug 27 02:25:00 user nova-compute[72820]:     </interface>
Aug 27 02:25:00 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:25:00 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/console.log" append="off"/>
Aug 27 02:25:00 user nova-compute[72820]:     </serial>
Aug 27 02:25:00 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:25:00 user nova-compute[72820]:     <video>
Aug 27 02:25:00 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:25:00 user nova-compute[72820]:     </video>
Aug 27 02:25:00 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:25:00 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:25:00 user nova-compute[72820]:     </rng>
Aug 27 02:25:00 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:25:00 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:25:00 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:25:00 user nova-compute[72820]:     </memballoon>
Aug 27 02:25:00 user nova-compute[72820]:   </devices>
Aug 27 02:25:00 user nova-compute[72820]: </domain>
Aug 27 02:25:00 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:25:00 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Instance destroyed successfully.
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:25:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] No VIF found with MAC fa:16:3e:37:4e:12, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:25:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-391a43d3-9b1f-47e8-a022-0a0111290edd req-c4afa739-1f2c-47c6-a8ad-a5760eb5491b service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received event network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:25:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-391a43d3-9b1f-47e8-a022-0a0111290edd req-c4afa739-1f2c-47c6-a8ad-a5760eb5491b service nova] Acquiring lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:25:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-391a43d3-9b1f-47e8-a022-0a0111290edd req-c4afa739-1f2c-47c6-a8ad-a5760eb5491b service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:25:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-391a43d3-9b1f-47e8-a022-0a0111290edd req-c4afa739-1f2c-47c6-a8ad-a5760eb5491b service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:25:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-391a43d3-9b1f-47e8-a022-0a0111290edd req-c4afa739-1f2c-47c6-a8ad-a5760eb5491b service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] No waiting events found dispatching network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:25:01 user nova-compute[72820]: WARNING nova.compute.manager [req-391a43d3-9b1f-47e8-a022-0a0111290edd req-c4afa739-1f2c-47c6-a8ad-a5760eb5491b service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received unexpected event network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 for instance with vm_state active and task_state rescuing.
Aug 27 02:25:01 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:02 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:25:02 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:25:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:03 user nova-compute[72820]: DEBUG nova.compute.manager [req-ab2441fe-dfb4-4352-a709-6c427b90df72 req-92fb09ef-374b-4a0d-a7d3-8a39a270325a service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received event network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:25:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ab2441fe-dfb4-4352-a709-6c427b90df72 req-92fb09ef-374b-4a0d-a7d3-8a39a270325a service nova] Acquiring lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:25:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ab2441fe-dfb4-4352-a709-6c427b90df72 req-92fb09ef-374b-4a0d-a7d3-8a39a270325a service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:25:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ab2441fe-dfb4-4352-a709-6c427b90df72 req-92fb09ef-374b-4a0d-a7d3-8a39a270325a service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:25:03 user nova-compute[72820]: DEBUG nova.compute.manager [req-ab2441fe-dfb4-4352-a709-6c427b90df72 req-92fb09ef-374b-4a0d-a7d3-8a39a270325a service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] No waiting events found dispatching network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:25:03 user nova-compute[72820]: WARNING nova.compute.manager [req-ab2441fe-dfb4-4352-a709-6c427b90df72 req-92fb09ef-374b-4a0d-a7d3-8a39a270325a service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received unexpected event network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 for instance with vm_state active and task_state rescuing.
Aug 27 02:25:03 user nova-compute[72820]: DEBUG nova.compute.manager [req-ab2441fe-dfb4-4352-a709-6c427b90df72 req-92fb09ef-374b-4a0d-a7d3-8a39a270325a service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received event network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:25:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ab2441fe-dfb4-4352-a709-6c427b90df72 req-92fb09ef-374b-4a0d-a7d3-8a39a270325a service nova] Acquiring lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:25:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ab2441fe-dfb4-4352-a709-6c427b90df72 req-92fb09ef-374b-4a0d-a7d3-8a39a270325a service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:25:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ab2441fe-dfb4-4352-a709-6c427b90df72 req-92fb09ef-374b-4a0d-a7d3-8a39a270325a service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:25:03 user nova-compute[72820]: DEBUG nova.compute.manager [req-ab2441fe-dfb4-4352-a709-6c427b90df72 req-92fb09ef-374b-4a0d-a7d3-8a39a270325a service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] No waiting events found dispatching network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:25:03 user nova-compute[72820]: WARNING nova.compute.manager [req-ab2441fe-dfb4-4352-a709-6c427b90df72 req-92fb09ef-374b-4a0d-a7d3-8a39a270325a service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received unexpected event network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 for instance with vm_state active and task_state rescuing.
Aug 27 02:25:04 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:25:04 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:25:04 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:25:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:25:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:25:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:25:04 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:25:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Removed pending event for 26581695-c4b9-40b8-ab7a-34c99db0dadb due to event {{(pid=72820) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 02:25:04 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103104.3802042, 26581695-c4b9-40b8-ab7a-34c99db0dadb => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:25:04 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] VM Resumed (Lifecycle Event)
Aug 27 02:25:04 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c1da4e25-1a5f-4d12-9512-8d718181ec8d tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:25:04 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:25:04 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:25:04 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 02:25:04 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103104.3805244, 26581695-c4b9-40b8-ab7a-34c99db0dadb => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:25:04 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] VM Started (Lifecycle Event)
Aug 27 02:25:04 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:25:04 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:25:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.244s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.287s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:25:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:07 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103092.6535616, abe48a87-2a54-468d-98e5-afae2577e541 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:25:07 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: abe48a87-2a54-468d-98e5-afae2577e541] VM Stopped (Lifecycle Event)
Aug 27 02:25:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f3a1bec9-8659-45d5-bda0-e4c5a63c39cd None None] [instance: abe48a87-2a54-468d-98e5-afae2577e541] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:25:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk.rescue --force-share --output=json" returned: 0 in 0.257s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:09 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:25:09 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:25:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7813MB free_disk=25.45357894897461GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:25:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:25:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:25:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 26581695-c4b9-40b8-ab7a-34c99db0dadb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:25:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f8f612f3-41c9-4dae-8d49-218d61720b15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:25:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6ed3c12e-96a8-4a32-8089-f04eba608663 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:25:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:25:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:25:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f37dfe42-3b22-4111-b10d-9459c8c42b2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:25:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:25:09 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:25:09 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:25:09 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:25:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:10 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:25:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:25:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:25:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:25:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:25:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:25:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:25:11 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:25:12 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Updating instance_info_cache with network_info: [{"id": "a0280116-060c-4078-b415-7abd9005c221", "address": "fa:16:3e:dc:2f:1b", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0280116-06", "ovs_interfaceid": "a0280116-060c-4078-b415-7abd9005c221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:25:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:25:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:25:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:25:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:25:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:25:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:25:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "050e0c2b-9244-4987-b07d-e4712e46f936" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:25:40 user nova-compute[72820]: DEBUG nova.compute.manager [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:25:40 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:25:40 user nova-compute[72820]: INFO nova.compute.manager [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] instance snapshotting
Aug 27 02:25:40 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Beginning live snapshot process
Aug 27 02:25:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:25:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:25:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:25:40 user nova-compute[72820]: INFO nova.compute.claims [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Claim successful on node user
Aug 27 02:25:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json -f qcow2 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json -f qcow2" returned: 0 in 0.248s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json -f qcow2 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:40 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:25:40 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:25:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:25:40 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG nova.network.neutron [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:25:41 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:25:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp83_yyvb_/12e98410116c4a15b461a78252290a6b.delta 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG nova.policy [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbbf87fbd76543bab71f44d664bec48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70199cb55f74880a86a7f4d2342054e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:25:41 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Creating image(s)
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "/opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "/opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "/opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp83_yyvb_/12e98410116c4a15b461a78252290a6b.delta 1073741824" returned: 0 in 0.086s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:41 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.210s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.202s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk 1073741824" returned: 0 in 0.059s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.194s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Checking if we can resize image /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:25:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:42 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Cannot resize image /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:25:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:25:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Ensure instance console log exists: /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:25:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:25:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:25:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:25:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:25:42 user nova-compute[72820]: DEBUG nova.network.neutron [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Successfully created port: a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:25:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:25:42 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 02:25:42 user nova-compute[72820]: DEBUG nova.privsep.utils [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 02:25:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp83_yyvb_/12e98410116c4a15b461a78252290a6b.delta /opt/stack/data/nova/instances/snapshots/tmp83_yyvb_/12e98410116c4a15b461a78252290a6b {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp83_yyvb_/12e98410116c4a15b461a78252290a6b.delta /opt/stack/data/nova/instances/snapshots/tmp83_yyvb_/12e98410116c4a15b461a78252290a6b" returned: 0 in 0.603s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:43 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Snapshot extracted, beginning image upload
Aug 27 02:25:43 user nova-compute[72820]: DEBUG nova.network.neutron [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Successfully updated port: a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:25:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "refresh_cache-050e0c2b-9244-4987-b07d-e4712e46f936" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:25:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquired lock "refresh_cache-050e0c2b-9244-4987-b07d-e4712e46f936" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:25:43 user nova-compute[72820]: DEBUG nova.network.neutron [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:25:43 user nova-compute[72820]: DEBUG nova.compute.manager [req-44b6a761-47fb-4e8d-9b70-724185adc1d2 req-071bcdab-5f44-45e0-bbd0-36b9e61ef7c9 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received event network-changed-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:25:43 user nova-compute[72820]: DEBUG nova.compute.manager [req-44b6a761-47fb-4e8d-9b70-724185adc1d2 req-071bcdab-5f44-45e0-bbd0-36b9e61ef7c9 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Refreshing instance network info cache due to event network-changed-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:25:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-44b6a761-47fb-4e8d-9b70-724185adc1d2 req-071bcdab-5f44-45e0-bbd0-36b9e61ef7c9 service nova] Acquiring lock "refresh_cache-050e0c2b-9244-4987-b07d-e4712e46f936" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:25:43 user nova-compute[72820]: DEBUG nova.network.neutron [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:25:43 user nova-compute[72820]: DEBUG nova.network.neutron [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Updating instance_info_cache with network_info: [{"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Releasing lock "refresh_cache-050e0c2b-9244-4987-b07d-e4712e46f936" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Instance network_info: |[{"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-44b6a761-47fb-4e8d-9b70-724185adc1d2 req-071bcdab-5f44-45e0-bbd0-36b9e61ef7c9 service nova] Acquired lock "refresh_cache-050e0c2b-9244-4987-b07d-e4712e46f936" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.network.neutron [req-44b6a761-47fb-4e8d-9b70-724185adc1d2 req-071bcdab-5f44-45e0-bbd0-36b9e61ef7c9 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Refreshing network info cache for port a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Start _get_guest_xml network_info=[{"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:25:44 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:25:44 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1528827756',display_name='tempest-AttachVolumeTestJSON-server-1528827756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1528827756',id=14,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnSgUcneqrQT+fSR64ZBXTU7w6gH3FRUC28AIjZT1OTuPJeA2iK/PRvmUdcnaeRQRx9F2cfuohCq3KKKqoUGjjYwRrOZbZ+RipxFTfAfbkjmPR9pHpU0nOexJ+36eDqvA==',key_name='tempest-keypair-290646663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a70199cb55f74880a86a7f4d2342054e',ramdisk_id='',reservation_id='r-iy5ykdf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-316094052',owner_user_name='tempest-AttachVolumeTestJSON-316094052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:25:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbbf87fbd76543bab71f44d664bec48c',uuid=050e0c2b-9244-4987-b07d-e4712e46f936,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converting VIF {"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.objects.instance [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'pci_devices' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:25:44 user nova-compute[72820]:   <uuid>050e0c2b-9244-4987-b07d-e4712e46f936</uuid>
Aug 27 02:25:44 user nova-compute[72820]:   <name>instance-0000000e</name>
Aug 27 02:25:44 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:25:44 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:25:44 user nova-compute[72820]:   <metadata>
Aug 27 02:25:44 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:25:44 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:25:44 user nova-compute[72820]:       <nova:name>tempest-AttachVolumeTestJSON-server-1528827756</nova:name>
Aug 27 02:25:44 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:25:44</nova:creationTime>
Aug 27 02:25:44 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:25:44 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:25:44 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:25:44 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:25:44 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:25:44 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:25:44 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:25:44 user nova-compute[72820]:       <nova:owner>
Aug 27 02:25:44 user nova-compute[72820]:         <nova:user uuid="bbbf87fbd76543bab71f44d664bec48c">tempest-AttachVolumeTestJSON-316094052-project-member</nova:user>
Aug 27 02:25:44 user nova-compute[72820]:         <nova:project uuid="a70199cb55f74880a86a7f4d2342054e">tempest-AttachVolumeTestJSON-316094052</nova:project>
Aug 27 02:25:44 user nova-compute[72820]:       </nova:owner>
Aug 27 02:25:44 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:25:44 user nova-compute[72820]:       <nova:ports>
Aug 27 02:25:44 user nova-compute[72820]:         <nova:port uuid="a6c019c8-6c53-44fd-a6f0-004d2f9b5a55">
Aug 27 02:25:44 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 02:25:44 user nova-compute[72820]:         </nova:port>
Aug 27 02:25:44 user nova-compute[72820]:       </nova:ports>
Aug 27 02:25:44 user nova-compute[72820]:     </nova:instance>
Aug 27 02:25:44 user nova-compute[72820]:   </metadata>
Aug 27 02:25:44 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:25:44 user nova-compute[72820]:     <system>
Aug 27 02:25:44 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:25:44 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:25:44 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:25:44 user nova-compute[72820]:       <entry name="serial">050e0c2b-9244-4987-b07d-e4712e46f936</entry>
Aug 27 02:25:44 user nova-compute[72820]:       <entry name="uuid">050e0c2b-9244-4987-b07d-e4712e46f936</entry>
Aug 27 02:25:44 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:25:44 user nova-compute[72820]:     </system>
Aug 27 02:25:44 user nova-compute[72820]:   </sysinfo>
Aug 27 02:25:44 user nova-compute[72820]:   <os>
Aug 27 02:25:44 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:25:44 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:25:44 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:25:44 user nova-compute[72820]:   </os>
Aug 27 02:25:44 user nova-compute[72820]:   <features>
Aug 27 02:25:44 user nova-compute[72820]:     <acpi/>
Aug 27 02:25:44 user nova-compute[72820]:     <apic/>
Aug 27 02:25:44 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:25:44 user nova-compute[72820]:   </features>
Aug 27 02:25:44 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:25:44 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:25:44 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:25:44 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:25:44 user nova-compute[72820]:   </clock>
Aug 27 02:25:44 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:25:44 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:25:44 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:25:44 user nova-compute[72820]:   </cpu>
Aug 27 02:25:44 user nova-compute[72820]:   <devices>
Aug 27 02:25:44 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:25:44 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:25:44 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk"/>
Aug 27 02:25:44 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:25:44 user nova-compute[72820]:     </disk>
Aug 27 02:25:44 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:25:44 user nova-compute[72820]:       <mac address="fa:16:3e:a4:94:7e"/>
Aug 27 02:25:44 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:25:44 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:25:44 user nova-compute[72820]:       <target dev="tapa6c019c8-6c"/>
Aug 27 02:25:44 user nova-compute[72820]:     </interface>
Aug 27 02:25:44 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:25:44 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/console.log" append="off"/>
Aug 27 02:25:44 user nova-compute[72820]:     </serial>
Aug 27 02:25:44 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:25:44 user nova-compute[72820]:     <video>
Aug 27 02:25:44 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:25:44 user nova-compute[72820]:     </video>
Aug 27 02:25:44 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:25:44 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:25:44 user nova-compute[72820]:     </rng>
Aug 27 02:25:44 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:25:44 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:25:44 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:25:44 user nova-compute[72820]:     </memballoon>
Aug 27 02:25:44 user nova-compute[72820]:   </devices>
Aug 27 02:25:44 user nova-compute[72820]: </domain>
Aug 27 02:25:44 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1528827756',display_name='tempest-AttachVolumeTestJSON-server-1528827756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1528827756',id=14,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnSgUcneqrQT+fSR64ZBXTU7w6gH3FRUC28AIjZT1OTuPJeA2iK/PRvmUdcnaeRQRx9F2cfuohCq3KKKqoUGjjYwRrOZbZ+RipxFTfAfbkjmPR9pHpU0nOexJ+36eDqvA==',key_name='tempest-keypair-290646663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a70199cb55f74880a86a7f4d2342054e',ramdisk_id='',reservation_id='r-iy5ykdf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-316094052',owner_user_name='tempest-AttachVolumeTestJSON-316094052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:25:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbbf87fbd76543bab71f44d664bec48c',uuid=050e0c2b-9244-4987-b07d-e4712e46f936,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converting VIF {"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG os_vif [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6c019c8-6c, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa6c019c8-6c, col_values=(('external_ids', {'iface-id': 'a6c019c8-6c53-44fd-a6f0-004d2f9b5a55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:94:7e', 'vm-uuid': '050e0c2b-9244-4987-b07d-e4712e46f936'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:44 user nova-compute[72820]: INFO os_vif [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c')
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:25:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] No VIF found with MAC fa:16:3e:a4:94:7e, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:25:45 user nova-compute[72820]: DEBUG nova.network.neutron [req-44b6a761-47fb-4e8d-9b70-724185adc1d2 req-071bcdab-5f44-45e0-bbd0-36b9e61ef7c9 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Updated VIF entry in instance network info cache for port a6c019c8-6c53-44fd-a6f0-004d2f9b5a55. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:25:45 user nova-compute[72820]: DEBUG nova.network.neutron [req-44b6a761-47fb-4e8d-9b70-724185adc1d2 req-071bcdab-5f44-45e0-bbd0-36b9e61ef7c9 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Updating instance_info_cache with network_info: [{"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:25:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-44b6a761-47fb-4e8d-9b70-724185adc1d2 req-071bcdab-5f44-45e0-bbd0-36b9e61ef7c9 service nova] Releasing lock "refresh_cache-050e0c2b-9244-4987-b07d-e4712e46f936" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:25:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:46 user nova-compute[72820]: DEBUG nova.compute.manager [req-c0cbeed8-338d-457c-a8a8-c0a752814130 req-d64b03b0-446f-4f4d-8d99-1e4aac3164a2 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received event network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:25:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c0cbeed8-338d-457c-a8a8-c0a752814130 req-d64b03b0-446f-4f4d-8d99-1e4aac3164a2 service nova] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:25:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c0cbeed8-338d-457c-a8a8-c0a752814130 req-d64b03b0-446f-4f4d-8d99-1e4aac3164a2 service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:25:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c0cbeed8-338d-457c-a8a8-c0a752814130 req-d64b03b0-446f-4f4d-8d99-1e4aac3164a2 service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:25:46 user nova-compute[72820]: DEBUG nova.compute.manager [req-c0cbeed8-338d-457c-a8a8-c0a752814130 req-d64b03b0-446f-4f4d-8d99-1e4aac3164a2 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] No waiting events found dispatching network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:25:46 user nova-compute[72820]: WARNING nova.compute.manager [req-c0cbeed8-338d-457c-a8a8-c0a752814130 req-d64b03b0-446f-4f4d-8d99-1e4aac3164a2 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received unexpected event network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 for instance with vm_state building and task_state spawning.
Aug 27 02:25:46 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Snapshot image upload complete
Aug 27 02:25:46 user nova-compute[72820]: INFO nova.compute.manager [None req-57a6d2cf-37a8-45d1-97a7-b6d80faef8f9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Took 6.04 seconds to snapshot the instance on the hypervisor.
Aug 27 02:25:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-8f597c27-6a5e-476e-b69a-1ea3b9edb0e0 req-ff205638-f271-4dd8-b5ee-c2c48b1ade62 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received event network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:25:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8f597c27-6a5e-476e-b69a-1ea3b9edb0e0 req-ff205638-f271-4dd8-b5ee-c2c48b1ade62 service nova] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:25:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8f597c27-6a5e-476e-b69a-1ea3b9edb0e0 req-ff205638-f271-4dd8-b5ee-c2c48b1ade62 service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:25:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8f597c27-6a5e-476e-b69a-1ea3b9edb0e0 req-ff205638-f271-4dd8-b5ee-c2c48b1ade62 service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:25:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-8f597c27-6a5e-476e-b69a-1ea3b9edb0e0 req-ff205638-f271-4dd8-b5ee-c2c48b1ade62 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] No waiting events found dispatching network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:25:48 user nova-compute[72820]: WARNING nova.compute.manager [req-8f597c27-6a5e-476e-b69a-1ea3b9edb0e0 req-ff205638-f271-4dd8-b5ee-c2c48b1ade62 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received unexpected event network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 for instance with vm_state building and task_state spawning.
Aug 27 02:25:48 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103148.5546215, 050e0c2b-9244-4987-b07d-e4712e46f936 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:25:48 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] VM Resumed (Lifecycle Event)
Aug 27 02:25:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:25:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:25:48 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Instance spawned successfully.
Aug 27 02:25:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:25:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:25:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:25:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:25:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:25:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:25:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:25:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:25:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:25:48 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:25:48 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103148.5562599, 050e0c2b-9244-4987-b07d-e4712e46f936 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:25:48 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] VM Started (Lifecycle Event)
Aug 27 02:25:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:25:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:25:48 user nova-compute[72820]: INFO nova.compute.manager [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Took 7.42 seconds to spawn the instance on the hypervisor.
Aug 27 02:25:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:25:48 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:25:48 user nova-compute[72820]: INFO nova.compute.manager [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Took 8.39 seconds to build instance.
Aug 27 02:25:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5948cd44-6c40-44a3-95c1-925d79468881 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "050e0c2b-9244-4987-b07d-e4712e46f936" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.593s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:25:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:25:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-6c160fee-64fe-444d-bcb2-470f244373bf req-a5adfb7b-bd2f-4aaa-838a-ff0566ddc6c1 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received event network-changed-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:25:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-6c160fee-64fe-444d-bcb2-470f244373bf req-a5adfb7b-bd2f-4aaa-838a-ff0566ddc6c1 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Refreshing instance network info cache due to event network-changed-525fd1df-177d-44ee-a88d-e6dcde84e9d4. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:25:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6c160fee-64fe-444d-bcb2-470f244373bf req-a5adfb7b-bd2f-4aaa-838a-ff0566ddc6c1 service nova] Acquiring lock "refresh_cache-f37dfe42-3b22-4111-b10d-9459c8c42b2d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:25:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6c160fee-64fe-444d-bcb2-470f244373bf req-a5adfb7b-bd2f-4aaa-838a-ff0566ddc6c1 service nova] Acquired lock "refresh_cache-f37dfe42-3b22-4111-b10d-9459c8c42b2d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:25:57 user nova-compute[72820]: DEBUG nova.network.neutron [req-6c160fee-64fe-444d-bcb2-470f244373bf req-a5adfb7b-bd2f-4aaa-838a-ff0566ddc6c1 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Refreshing network info cache for port 525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:25:57 user nova-compute[72820]: DEBUG nova.network.neutron [req-6c160fee-64fe-444d-bcb2-470f244373bf req-a5adfb7b-bd2f-4aaa-838a-ff0566ddc6c1 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Updated VIF entry in instance network info cache for port 525fd1df-177d-44ee-a88d-e6dcde84e9d4. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:25:57 user nova-compute[72820]: DEBUG nova.network.neutron [req-6c160fee-64fe-444d-bcb2-470f244373bf req-a5adfb7b-bd2f-4aaa-838a-ff0566ddc6c1 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Updating instance_info_cache with network_info: [{"id": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "address": "fa:16:3e:8f:f1:36", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd1df-17", "ovs_interfaceid": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:25:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:25:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:25:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6c160fee-64fe-444d-bcb2-470f244373bf req-a5adfb7b-bd2f-4aaa-838a-ff0566ddc6c1 service nova] Releasing lock "refresh_cache-f37dfe42-3b22-4111-b10d-9459c8c42b2d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:25:57 user nova-compute[72820]: DEBUG nova.objects.instance [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lazy-loading 'flavor' on Instance uuid f37dfe42-3b22-4111-b10d-9459c8c42b2d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:25:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:25:58 user nova-compute[72820]: INFO nova.compute.manager [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Attaching volume db346c69-45aa-475a-95bc-348731d6815a to /dev/vdb
Aug 27 02:25:58 user nova-compute[72820]: DEBUG os_brick.utils [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[70806bc4-2080-4413-b0ab-f9c7cf22d16c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c71fff2-4b6b-49f2-bb2c-100db5e2355d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5e94cf-1917-4abb-8588-0b3ae2ab86c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90c755a-5b25-4e1b-a5d0-245a0d1d4597]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:25:58 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:25:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe0dbb3-c471-4f79-b330-902b783bd15b]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG os_brick.utils [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:25:58 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Updating existing volume attachment record: 97fa422a-0521-4f8f-acad-aefed88448d9 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:25:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:02 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:26:02 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:26:03 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:26:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:04 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:26:04 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:26:05 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:26:05 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:26:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:05 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:26:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:07 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.387s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:26:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk.rescue --force-share --output=json" returned: 0 in 0.244s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:10 user nova-compute[72820]: INFO nova.compute.manager [None req-796b3a11-be53-440d-b978-a26a4a656d62 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Unrescuing
Aug 27 02:26:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-796b3a11-be53-440d-b978-a26a4a656d62 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:26:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-796b3a11-be53-440d-b978-a26a4a656d62 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquired lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:26:10 user nova-compute[72820]: DEBUG nova.network.neutron [None req-796b3a11-be53-440d-b978-a26a4a656d62 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:26:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:10 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:26:10 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:26:10 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7735MB free_disk=25.354522705078125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:26:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 26581695-c4b9-40b8-ab7a-34c99db0dadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f8f612f3-41c9-4dae-8d49-218d61720b15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6ed3c12e-96a8-4a32-8089-f04eba608663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f37dfe42-3b22-4111-b10d-9459c8c42b2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 050e0c2b-9244-4987-b07d-e4712e46f936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing inventories for resource provider a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Updating ProviderTree inventory for provider a962b30a-2750-431c-be10-075d0f991065 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Updating inventory in ProviderTree for provider a962b30a-2750-431c-be10-075d0f991065 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing aggregate associations for resource provider a962b30a-2750-431c-be10-075d0f991065, aggregates: None {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing trait associations for resource provider a962b30a-2750-431c-be10-075d0f991065, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.923s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 02:26:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] There are 0 instances to clean {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG nova.network.neutron [None req-796b3a11-be53-440d-b978-a26a4a656d62 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Updating instance_info_cache with network_info: [{"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-796b3a11-be53-440d-b978-a26a4a656d62 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Releasing lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG nova.objects.instance [None req-796b3a11-be53-440d-b978-a26a4a656d62 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lazy-loading 'flavor' on Instance uuid 6ed3c12e-96a8-4a32-8089-f04eba608663 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:26:12 user nova-compute[72820]: INFO nova.compute.claims [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Claim successful on node user
Aug 27 02:26:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Didn't find any instances for network info cache update. {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG nova.compute.manager [req-91a79430-0239-4504-b869-4cdc83fd2f4f req-92f6755b-0657-460a-a1ae-9392c9137f3f service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-changed-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG nova.compute.manager [req-91a79430-0239-4504-b869-4cdc83fd2f4f req-92f6755b-0657-460a-a1ae-9392c9137f3f service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Refreshing instance network info cache due to event network-changed-dc035bdf-5877-42fe-b1e2-fa882373f836. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-91a79430-0239-4504-b869-4cdc83fd2f4f req-92f6755b-0657-460a-a1ae-9392c9137f3f service nova] Acquiring lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-91a79430-0239-4504-b869-4cdc83fd2f4f req-92f6755b-0657-460a-a1ae-9392c9137f3f service nova] Acquired lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG nova.network.neutron [req-91a79430-0239-4504-b869-4cdc83fd2f4f req-92f6755b-0657-460a-a1ae-9392c9137f3f service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Refreshing network info cache for port dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:26:12 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-d2bb5deb-36fd-4000-9ed8-6106d14d9971 req-a5339a7c-8b64-47b2-a965-f151abf2f68f service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-vif-unplugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d2bb5deb-36fd-4000-9ed8-6106d14d9971 req-a5339a7c-8b64-47b2-a965-f151abf2f68f service nova] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d2bb5deb-36fd-4000-9ed8-6106d14d9971 req-a5339a7c-8b64-47b2-a965-f151abf2f68f service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d2bb5deb-36fd-4000-9ed8-6106d14d9971 req-a5339a7c-8b64-47b2-a965-f151abf2f68f service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-d2bb5deb-36fd-4000-9ed8-6106d14d9971 req-a5339a7c-8b64-47b2-a965-f151abf2f68f service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] No waiting events found dispatching network-vif-unplugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:26:13 user nova-compute[72820]: WARNING nova.compute.manager [req-d2bb5deb-36fd-4000-9ed8-6106d14d9971 req-a5339a7c-8b64-47b2-a965-f151abf2f68f service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received unexpected event network-vif-unplugged-dc035bdf-5877-42fe-b1e2-fa882373f836 for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:26:13 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:26:13 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Instance destroyed successfully.
Aug 27 02:26:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:26:13 user nova-compute[72820]: INFO nova.virt.block_device [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Booting with volume 9232106a-0c47-4086-9e35-8d5f6d454ee5 at /dev/vda
Aug 27 02:26:13 user nova-compute[72820]: DEBUG nova.network.neutron [req-91a79430-0239-4504-b869-4cdc83fd2f4f req-92f6755b-0657-460a-a1ae-9392c9137f3f service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Updated VIF entry in instance network info cache for port dc035bdf-5877-42fe-b1e2-fa882373f836. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG nova.network.neutron [req-91a79430-0239-4504-b869-4cdc83fd2f4f req-92f6755b-0657-460a-a1ae-9392c9137f3f service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Updating instance_info_cache with network_info: [{"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-91a79430-0239-4504-b869-4cdc83fd2f4f req-92f6755b-0657-460a-a1ae-9392c9137f3f service nova] Releasing lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG os_brick.utils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd22010c-1e6a-4fa6-839a-dd6ecc17ad4e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c730bac-a88b-4675-ab8d-cc56f9a0a32f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3137a5ef-5027-434b-9b84-7cf5a43c8293]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f066a007-fd52-4ab2-ac08-98e078cd3ce4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG nova.policy [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0acc5b76a48348b4b02aecee3a35e096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14062f1cf8e4244ae629536b131ac0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:26:13 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:26:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a96b52-e288-44aa-9c13-c5bff27b582e]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG os_brick.utils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:26:13 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Updating existing volume attachment record: a432c287-f931-4c65-95c3-bb24ab1703ed {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:26:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:14 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Successfully created port: 82460091-aebf-4691-a20c-d7c0affbbba0 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:26:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-9749bfc5-2d6d-4611-b4c0-92d4b354b25d req-0540159b-29fd-4947-b1de-5dd2c84116de service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-changed-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-9749bfc5-2d6d-4611-b4c0-92d4b354b25d req-0540159b-29fd-4947-b1de-5dd2c84116de service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Refreshing instance network info cache due to event network-changed-dc035bdf-5877-42fe-b1e2-fa882373f836. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:26:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9749bfc5-2d6d-4611-b4c0-92d4b354b25d req-0540159b-29fd-4947-b1de-5dd2c84116de service nova] Acquiring lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:26:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9749bfc5-2d6d-4611-b4c0-92d4b354b25d req-0540159b-29fd-4947-b1de-5dd2c84116de service nova] Acquired lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:26:14 user nova-compute[72820]: DEBUG nova.network.neutron [req-9749bfc5-2d6d-4611-b4c0-92d4b354b25d req-0540159b-29fd-4947-b1de-5dd2c84116de service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Refreshing network info cache for port dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:26:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:15 user nova-compute[72820]: DEBUG nova.compute.manager [req-5b97c7bb-adef-4951-9b3a-3311d0b03940 req-a46f9f6d-f3ce-4854-89df-25fbdeada40f service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5b97c7bb-adef-4951-9b3a-3311d0b03940 req-a46f9f6d-f3ce-4854-89df-25fbdeada40f service nova] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5b97c7bb-adef-4951-9b3a-3311d0b03940 req-a46f9f6d-f3ce-4854-89df-25fbdeada40f service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5b97c7bb-adef-4951-9b3a-3311d0b03940 req-a46f9f6d-f3ce-4854-89df-25fbdeada40f service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:15 user nova-compute[72820]: DEBUG nova.compute.manager [req-5b97c7bb-adef-4951-9b3a-3311d0b03940 req-a46f9f6d-f3ce-4854-89df-25fbdeada40f service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] No waiting events found dispatching network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:26:15 user nova-compute[72820]: WARNING nova.compute.manager [req-5b97c7bb-adef-4951-9b3a-3311d0b03940 req-a46f9f6d-f3ce-4854-89df-25fbdeada40f service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received unexpected event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:26:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:15 user nova-compute[72820]: DEBUG nova.network.neutron [req-9749bfc5-2d6d-4611-b4c0-92d4b354b25d req-0540159b-29fd-4947-b1de-5dd2c84116de service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Updated VIF entry in instance network info cache for port dc035bdf-5877-42fe-b1e2-fa882373f836. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:26:15 user nova-compute[72820]: DEBUG nova.network.neutron [req-9749bfc5-2d6d-4611-b4c0-92d4b354b25d req-0540159b-29fd-4947-b1de-5dd2c84116de service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Updating instance_info_cache with network_info: [{"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:26:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9749bfc5-2d6d-4611-b4c0-92d4b354b25d req-0540159b-29fd-4947-b1de-5dd2c84116de service nova] Releasing lock "refresh_cache-6ed3c12e-96a8-4a32-8089-f04eba608663" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:26:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:15 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Successfully created port: 4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:26:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:26:16 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmHeTLfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:26:16 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:26:16 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:26:16 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:26:16 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:26:16 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:26:16 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:26:16 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:26:17 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Successfully created port: 966580e7-4512-4064-aa4e-c78c12545f99 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[59677ac2-9eac-4b46-a2da-f57b3188ed67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:26:17 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[14943315-7d32-447d-b5c9-1663fdfbdab7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a] added
Aug 27 02:26:17 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[51903782-4027-418e-8f77-8ba3ce9aeec5]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b1981a-373a-4731-a55f-e445cdb24bdd]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pmHeTLfC {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG nova.compute.manager [req-020b5030-ea88-4670-bdc0-23b26ac351f1 req-d383282b-1f08-46b8-a05e-f9584182056f service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-020b5030-ea88-4670-bdc0-23b26ac351f1 req-d383282b-1f08-46b8-a05e-f9584182056f service nova] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-020b5030-ea88-4670-bdc0-23b26ac351f1 req-d383282b-1f08-46b8-a05e-f9584182056f service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-020b5030-ea88-4670-bdc0-23b26ac351f1 req-d383282b-1f08-46b8-a05e-f9584182056f service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG nova.compute.manager [req-020b5030-ea88-4670-bdc0-23b26ac351f1 req-d383282b-1f08-46b8-a05e-f9584182056f service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] No waiting events found dispatching network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:26:17 user nova-compute[72820]: WARNING nova.compute.manager [req-020b5030-ea88-4670-bdc0-23b26ac351f1 req-d383282b-1f08-46b8-a05e-f9584182056f service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received unexpected event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:26:17 user nova-compute[72820]: DEBUG nova.compute.manager [req-020b5030-ea88-4670-bdc0-23b26ac351f1 req-d383282b-1f08-46b8-a05e-f9584182056f service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-020b5030-ea88-4670-bdc0-23b26ac351f1 req-d383282b-1f08-46b8-a05e-f9584182056f service nova] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-020b5030-ea88-4670-bdc0-23b26ac351f1 req-d383282b-1f08-46b8-a05e-f9584182056f service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-020b5030-ea88-4670-bdc0-23b26ac351f1 req-d383282b-1f08-46b8-a05e-f9584182056f service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG nova.compute.manager [req-020b5030-ea88-4670-bdc0-23b26ac351f1 req-d383282b-1f08-46b8-a05e-f9584182056f service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] No waiting events found dispatching network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:26:17 user nova-compute[72820]: WARNING nova.compute.manager [req-020b5030-ea88-4670-bdc0-23b26ac351f1 req-d383282b-1f08-46b8-a05e-f9584182056f service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received unexpected event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pmHeTLfC" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfb81ef-a150-4c1a-9896-d3302a8acbd2]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pmHeTLfC'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.110s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fef9f8d-55da-4707-b9d1-ab3e8bfd9ba5]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[500d294b-311d-4d5e-b015-44c157e5622d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:26:17 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:26:17 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4308f859-61e5-4ba3-a485-27b8cc0c48e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a, portal: 172.16.0.220,3260]
Aug 27 02:26:17 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a, portal: 172.16.0.220,3260] successful.
Aug 27 02:26:17 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f40169b-9d18-4f13-954d-a1cf739bc5a7]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2ea194-b9d4-4181-8486-f20fe53d6045]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:26:17 user nova-compute[72820]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:26:17 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:26:17 user nova-compute[72820]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:26:17 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.442s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.037s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29aed34-b0ad-4024-a505-6b5033c829a1]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmHeTLfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG nova.compute.manager [None req-796b3a11-be53-440d-b978-a26a4a656d62 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Removed pending event for 6ed3c12e-96a8-4a32-8089-f04eba608663 due to event {{(pid=72820) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103177.717252, 6ed3c12e-96a8-4a32-8089-f04eba608663 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:26:17 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] VM Resumed (Lifecycle Event)
Aug 27 02:26:17 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103177.7175672, 6ed3c12e-96a8-4a32-8089-f04eba608663 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:26:17 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] VM Started (Lifecycle Event)
Aug 27 02:26:17 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:26:17 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:26:18 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Successfully created port: b13d4895-4841-4176-b770-88848fc8e5e2 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:26:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.495s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:26:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] <== connect_volume: return (1498ms) {'type': 'block', 'scsi_wwn': '26237616430613561', 'path': '/dev/sdb'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:26:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237616430613561', 'path': '/dev/sdb'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:26:18 user nova-compute[72820]: DEBUG nova.objects.instance [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lazy-loading 'flavor' on Instance uuid f37dfe42-3b22-4111-b10d-9459c8c42b2d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:26:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:26:18 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:26:18 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:26:18 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:26:18 user nova-compute[72820]:   <serial>db346c69-45aa-475a-95bc-348731d6815a</serial>
Aug 27 02:26:18 user nova-compute[72820]: </disk>
Aug 27 02:26:18 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:26:18 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Successfully created port: 14ea855b-ce40-4fa2-ab19-ea385ca9c65c {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:26:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:26:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:26:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] No VIF found with MAC fa:16:3e:8f:f1:36, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:26:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-18899d2c-5fa3-479f-86ad-edb34ed518b0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.056s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:19 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Successfully updated port: 82460091-aebf-4691-a20c-d7c0affbbba0 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:26:19 user nova-compute[72820]: DEBUG nova.compute.manager [req-3532ecb5-b48b-493b-a4ba-2c65bf6c586a req-810f4470-9455-47d2-9439-588d5f65422b service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-changed-82460091-aebf-4691-a20c-d7c0affbbba0 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:19 user nova-compute[72820]: DEBUG nova.compute.manager [req-3532ecb5-b48b-493b-a4ba-2c65bf6c586a req-810f4470-9455-47d2-9439-588d5f65422b service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Refreshing instance network info cache due to event network-changed-82460091-aebf-4691-a20c-d7c0affbbba0. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:26:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3532ecb5-b48b-493b-a4ba-2c65bf6c586a req-810f4470-9455-47d2-9439-588d5f65422b service nova] Acquiring lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:26:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3532ecb5-b48b-493b-a4ba-2c65bf6c586a req-810f4470-9455-47d2-9439-588d5f65422b service nova] Acquired lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:26:19 user nova-compute[72820]: DEBUG nova.network.neutron [req-3532ecb5-b48b-493b-a4ba-2c65bf6c586a req-810f4470-9455-47d2-9439-588d5f65422b service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Refreshing network info cache for port 82460091-aebf-4691-a20c-d7c0affbbba0 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:26:20 user nova-compute[72820]: DEBUG nova.network.neutron [req-3532ecb5-b48b-493b-a4ba-2c65bf6c586a req-810f4470-9455-47d2-9439-588d5f65422b service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:26:21 user nova-compute[72820]: INFO nova.compute.manager [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Rebuilding instance
Aug 27 02:26:21 user nova-compute[72820]: DEBUG nova.network.neutron [req-3532ecb5-b48b-493b-a4ba-2c65bf6c586a req-810f4470-9455-47d2-9439-588d5f65422b service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:26:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3532ecb5-b48b-493b-a4ba-2c65bf6c586a req-810f4470-9455-47d2-9439-588d5f65422b service nova] Releasing lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:26:21 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Successfully updated port: 1647fafb-02da-4fa5-a62f-d43919dd49a6 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:26:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:26:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-f0a9c197-8b8e-44c5-852f-4a9f9d3e6aad req-b3d9fb9b-73f8-4a59-95e2-8d94d7b30fba service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-changed-1647fafb-02da-4fa5-a62f-d43919dd49a6 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-f0a9c197-8b8e-44c5-852f-4a9f9d3e6aad req-b3d9fb9b-73f8-4a59-95e2-8d94d7b30fba service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Refreshing instance network info cache due to event network-changed-1647fafb-02da-4fa5-a62f-d43919dd49a6. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f0a9c197-8b8e-44c5-852f-4a9f9d3e6aad req-b3d9fb9b-73f8-4a59-95e2-8d94d7b30fba service nova] Acquiring lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f0a9c197-8b8e-44c5-852f-4a9f9d3e6aad req-b3d9fb9b-73f8-4a59-95e2-8d94d7b30fba service nova] Acquired lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG nova.network.neutron [req-f0a9c197-8b8e-44c5-852f-4a9f9d3e6aad req-b3d9fb9b-73f8-4a59-95e2-8d94d7b30fba service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Refreshing network info cache for port 1647fafb-02da-4fa5-a62f-d43919dd49a6 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:26:22 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Instance destroyed successfully.
Aug 27 02:26:22 user nova-compute[72820]: DEBUG nova.network.neutron [req-f0a9c197-8b8e-44c5-852f-4a9f9d3e6aad req-b3d9fb9b-73f8-4a59-95e2-8d94d7b30fba service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:26:22 user nova-compute[72820]: INFO nova.compute.manager [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Detaching volume db346c69-45aa-475a-95bc-348731d6815a
Aug 27 02:26:22 user nova-compute[72820]: INFO nova.virt.block_device [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Attempting to driver detach volume db346c69-45aa-475a-95bc-348731d6815a from mountpoint /dev/vdb
Aug 27 02:26:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Attempting to detach device vdb from instance f37dfe42-3b22-4111-b10d-9459c8c42b2d from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:26:22 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:26:22 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:26:22 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:26:22 user nova-compute[72820]:   <serial>db346c69-45aa-475a-95bc-348731d6815a</serial>
Aug 27 02:26:22 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:26:22 user nova-compute[72820]: </disk>
Aug 27 02:26:22 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:26:22 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Successfully detached device vdb from instance f37dfe42-3b22-4111-b10d-9459c8c42b2d from the persistent domain config.
Aug 27 02:26:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmHeTLfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:26:22 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 02:26:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c801f48-20c5-44a4-8d1f-3177cd4e868a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:26:22 user nova-compute[72820]: No targets found.
Aug 27 02:26:22 user nova-compute[72820]: iSNS:
Aug 27 02:26:22 user nova-compute[72820]: No targets found.
Aug 27 02:26:22 user nova-compute[72820]: STATIC:
Aug 27 02:26:22 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc
Aug 27 02:26:22 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:26:22 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:26:22 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a
Aug 27 02:26:22 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:26:22 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:26:22 user nova-compute[72820]: FIRMWARE:
Aug 27 02:26:22 user nova-compute[72820]: No targets found.
Aug 27 02:26:22 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:26:22 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:26:22 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe3acd1-6db5-4e21-b95f-38df5e445632]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c1bcb8-e9b5-474c-b57b-d4211249ebab]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:26:22 user nova-compute[72820]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:26:22 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:26:22 user nova-compute[72820]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:26:22 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a0597370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a'): ({'sdb'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Removing single pathed devices sdb {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b884e5e-6935-40c6-bee0-1a55420e81a4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG nova.network.neutron [req-f0a9c197-8b8e-44c5-852f-4a9f9d3e6aad req-b3d9fb9b-73f8-4a59-95e2-8d94d7b30fba service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce41c1b-4313-4ea9-958b-ba43882b6486]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Flushing IO for device /dev/sdb {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f0a9c197-8b8e-44c5-852f-4a9f9d3e6aad req-b3d9fb9b-73f8-4a59-95e2-8d94d7b30fba service nova] Releasing lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-f0a9c197-8b8e-44c5-852f-4a9f9d3e6aad req-b3d9fb9b-73f8-4a59-95e2-8d94d7b30fba service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received event network-vif-unplugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f0a9c197-8b8e-44c5-852f-4a9f9d3e6aad req-b3d9fb9b-73f8-4a59-95e2-8d94d7b30fba service nova] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f0a9c197-8b8e-44c5-852f-4a9f9d3e6aad req-b3d9fb9b-73f8-4a59-95e2-8d94d7b30fba service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f0a9c197-8b8e-44c5-852f-4a9f9d3e6aad req-b3d9fb9b-73f8-4a59-95e2-8d94d7b30fba service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-f0a9c197-8b8e-44c5-852f-4a9f9d3e6aad req-b3d9fb9b-73f8-4a59-95e2-8d94d7b30fba service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] No waiting events found dispatching network-vif-unplugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:26:22 user nova-compute[72820]: WARNING nova.compute.manager [req-f0a9c197-8b8e-44c5-852f-4a9f9d3e6aad req-b3d9fb9b-73f8-4a59-95e2-8d94d7b30fba service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received unexpected event network-vif-unplugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 for instance with vm_state active and task_state rebuilding.
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a66f4c9-3163-47d2-b7f3-622071f29482]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2ed712-8dd2-4263-9abc-0fd0cb785416]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:26:23 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:26:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:26:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[02425ffe-57ad-411e-8c56-a8982f61b94f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f26c2c-7cf0-47d0-8099-7948dd173707]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a, portal: 172.16.0.220,3260]
Aug 27 02:26:23 user nova-compute[72820]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a, portal: 172.16.0.220,3260] successful.
Aug 27 02:26:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a1a3dd-0c1d-4249-a0b2-e58ded9cdf85]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:26:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] <== disconnect_volume: return (376ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:26:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:26:23 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Successfully updated port: 4c2ff677-b994-41bc-94e5-e542ad18fb4e {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Successfully updated port: 4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received event network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] No waiting events found dispatching network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:26:24 user nova-compute[72820]: WARNING nova.compute.manager [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received unexpected event network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 for instance with vm_state active and task_state rebuilding.
Aug 27 02:26:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-changed-4c2ff677-b994-41bc-94e5-e542ad18fb4e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Refreshing instance network info cache due to event network-changed-4c2ff677-b994-41bc-94e5-e542ad18fb4e. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] Acquiring lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] Acquired lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG nova.network.neutron [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Refreshing network info cache for port 4c2ff677-b994-41bc-94e5-e542ad18fb4e {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:26:24 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Instance destroyed successfully.
Aug 27 02:26:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-421019104',display_name='tempest-ServerActionsTestOtherA-server-879680922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-421019104',id=13,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMw/Y2giaEd949A8TrcWBPdl2Eikv6Xenmfv4cllzQw8aisIhzqkeUdBQYtbr+OYny0m8MqNxEwe+yjAuXRnQEEmz90bzQRRLT4my2+BuCn44VZPZT8Z8gGsdaV35h+jg==',key_name='tempest-keypair-1823346990',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:24:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7797569db44f40f193483e6e6933a0d0',ramdisk_id='',reservation_id='r-251z002r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-892102693',owner_user_name='tempest-ServerActionsTestOtherA-892102693-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='275f713edfd042d4b4fa32620956484a',uuid=f37dfe42-3b22-4111-b10d-9459c8c42b2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "address": "fa:16:3e:8f:f1:36", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd1df-17", "ovs_interfaceid": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converting VIF {"id": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "address": "fa:16:3e:8f:f1:36", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd1df-17", "ovs_interfaceid": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=525fd1df-177d-44ee-a88d-e6dcde84e9d4,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd1df-17') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG os_vif [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=525fd1df-177d-44ee-a88d-e6dcde84e9d4,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd1df-17') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap525fd1df-17, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:24 user nova-compute[72820]: INFO os_vif [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=525fd1df-177d-44ee-a88d-e6dcde84e9d4,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd1df-17')
Aug 27 02:26:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmHeTLfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:26:24 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 02:26:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d592fb-a200-4732-bb87-90323f4dd2e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:26:24 user nova-compute[72820]: No targets found.
Aug 27 02:26:24 user nova-compute[72820]: iSNS:
Aug 27 02:26:24 user nova-compute[72820]: No targets found.
Aug 27 02:26:24 user nova-compute[72820]: STATIC:
Aug 27 02:26:24 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc
Aug 27 02:26:24 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:26:24 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:26:24 user nova-compute[72820]: FIRMWARE:
Aug 27 02:26:24 user nova-compute[72820]: No targets found.
Aug 27 02:26:24 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:26:24 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:26:24 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7df0785-6898-4c72-9c48-525dc369701a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd6f5cc-4ac5-4256-afe5-2f4e332c7200]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:26:24 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:26:24 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a06029e0>, {}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Disconnecting from: [] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] <== disconnect_volume: return (84ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:26:24 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Deleting instance files /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d_del
Aug 27 02:26:24 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Deletion of /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d_del complete
Aug 27 02:26:24 user nova-compute[72820]: DEBUG nova.network.neutron [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:26:24 user nova-compute[72820]: INFO nova.virt.block_device [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Booting with volume db346c69-45aa-475a-95bc-348731d6815a at /dev/vdb
Aug 27 02:26:24 user nova-compute[72820]: DEBUG os_brick.utils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a05cf71-e17c-4e74-bed5-dc0f66dcf48a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2109415-d1cc-4e49-8065-20f9e1a6e414]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebb4e50-23e6-4fb6-8dc7-ac9bfcd3f0c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc93a3f4-9b61-476a-87ca-001226277fb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:26:24 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:26:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65bf4c4-45ba-47de-9994-4d0e2166cef1]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:26:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:26:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:26:25 user nova-compute[72820]: DEBUG os_brick.utils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:26:25 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Updating existing volume attachment record: 6e24d67e-b2d5-4bbd-b640-b512f56b650b {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:26:25 user nova-compute[72820]: DEBUG nova.network.neutron [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:26:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] Releasing lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:26:25 user nova-compute[72820]: DEBUG nova.compute.manager [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-changed-4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:25 user nova-compute[72820]: DEBUG nova.compute.manager [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Refreshing instance network info cache due to event network-changed-4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:26:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] Acquiring lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:26:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] Acquired lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:26:25 user nova-compute[72820]: DEBUG nova.network.neutron [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Refreshing network info cache for port 4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:26:25 user nova-compute[72820]: DEBUG nova.network.neutron [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:26:25 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Successfully updated port: 966580e7-4512-4064-aa4e-c78c12545f99 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:26:25 user nova-compute[72820]: DEBUG nova.network.neutron [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:26:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ccc0a74b-ae90-4ed9-b5bd-9c6c1a13e9d8 req-ea404ea8-a2e0-4bc8-8c8c-fa235b764ed9 service nova] Releasing lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:26:26 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Successfully updated port: b13d4895-4841-4176-b770-88848fc8e5e2 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:26:26 user nova-compute[72820]: DEBUG nova.compute.manager [req-04497f7d-b8be-4035-a995-f79b8baadd32 req-3087a814-7dcf-4644-8b31-4b5e93af538c service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-changed-966580e7-4512-4064-aa4e-c78c12545f99 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:26 user nova-compute[72820]: DEBUG nova.compute.manager [req-04497f7d-b8be-4035-a995-f79b8baadd32 req-3087a814-7dcf-4644-8b31-4b5e93af538c service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Refreshing instance network info cache due to event network-changed-966580e7-4512-4064-aa4e-c78c12545f99. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:26:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-04497f7d-b8be-4035-a995-f79b8baadd32 req-3087a814-7dcf-4644-8b31-4b5e93af538c service nova] Acquiring lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:26:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-04497f7d-b8be-4035-a995-f79b8baadd32 req-3087a814-7dcf-4644-8b31-4b5e93af538c service nova] Acquired lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:26:26 user nova-compute[72820]: DEBUG nova.network.neutron [req-04497f7d-b8be-4035-a995-f79b8baadd32 req-3087a814-7dcf-4644-8b31-4b5e93af538c service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Refreshing network info cache for port 966580e7-4512-4064-aa4e-c78c12545f99 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:26:26 user nova-compute[72820]: DEBUG nova.network.neutron [req-04497f7d-b8be-4035-a995-f79b8baadd32 req-3087a814-7dcf-4644-8b31-4b5e93af538c service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:26:27 user nova-compute[72820]: DEBUG nova.network.neutron [req-04497f7d-b8be-4035-a995-f79b8baadd32 req-3087a814-7dcf-4644-8b31-4b5e93af538c service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:26:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-04497f7d-b8be-4035-a995-f79b8baadd32 req-3087a814-7dcf-4644-8b31-4b5e93af538c service nova] Releasing lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:26:27 user nova-compute[72820]: DEBUG nova.compute.manager [req-04497f7d-b8be-4035-a995-f79b8baadd32 req-3087a814-7dcf-4644-8b31-4b5e93af538c service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-changed-b13d4895-4841-4176-b770-88848fc8e5e2 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:27 user nova-compute[72820]: DEBUG nova.compute.manager [req-04497f7d-b8be-4035-a995-f79b8baadd32 req-3087a814-7dcf-4644-8b31-4b5e93af538c service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Refreshing instance network info cache due to event network-changed-b13d4895-4841-4176-b770-88848fc8e5e2. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:26:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-04497f7d-b8be-4035-a995-f79b8baadd32 req-3087a814-7dcf-4644-8b31-4b5e93af538c service nova] Acquiring lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:26:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-04497f7d-b8be-4035-a995-f79b8baadd32 req-3087a814-7dcf-4644-8b31-4b5e93af538c service nova] Acquired lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:26:27 user nova-compute[72820]: DEBUG nova.network.neutron [req-04497f7d-b8be-4035-a995-f79b8baadd32 req-3087a814-7dcf-4644-8b31-4b5e93af538c service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Refreshing network info cache for port b13d4895-4841-4176-b770-88848fc8e5e2 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:26:27 user nova-compute[72820]: DEBUG nova.network.neutron [req-04497f7d-b8be-4035-a995-f79b8baadd32 req-3087a814-7dcf-4644-8b31-4b5e93af538c service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:26:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:27 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Successfully updated port: 14ea855b-ce40-4fa2-ab19-ea385ca9c65c {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:26:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Acquiring lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:26:27 user nova-compute[72820]: DEBUG nova.network.neutron [req-04497f7d-b8be-4035-a995-f79b8baadd32 req-3087a814-7dcf-4644-8b31-4b5e93af538c service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:26:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-04497f7d-b8be-4035-a995-f79b8baadd32 req-3087a814-7dcf-4644-8b31-4b5e93af538c service nova] Releasing lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:26:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Acquired lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:26:27 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:26:27 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:26:28 user nova-compute[72820]: DEBUG nova.compute.manager [req-9dbc6842-8ed2-4c3c-b95c-79c04f884760 req-979046e7-deff-4dde-b07f-fa7f9c8bfe04 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-changed-14ea855b-ce40-4fa2-ab19-ea385ca9c65c {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:28 user nova-compute[72820]: DEBUG nova.compute.manager [req-9dbc6842-8ed2-4c3c-b95c-79c04f884760 req-979046e7-deff-4dde-b07f-fa7f9c8bfe04 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Refreshing instance network info cache due to event network-changed-14ea855b-ce40-4fa2-ab19-ea385ca9c65c. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:26:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9dbc6842-8ed2-4c3c-b95c-79c04f884760 req-979046e7-deff-4dde-b07f-fa7f9c8bfe04 service nova] Acquiring lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:26:28 user nova-compute[72820]: INFO nova.virt.block_device [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Booting with volume eb336f72-5156-4865-b694-6f854b1b99eb at /dev/vdb
Aug 27 02:26:29 user nova-compute[72820]: DEBUG os_brick.utils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07091ac-7048-4e91-9b15-959830a6cb77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e73306f-82a4-4e3a-b34a-07dabff11a82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18c602c-8665-4e2a-bc5a-961c56191f7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb571e76-f5a1-4961-ac49-955d1931cc02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:26:29 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:26:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f388bd98-9f6a-4056-b4dd-89b209884a88]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG os_brick.utils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Updating existing volume attachment record: 478fedab-eda5-4530-a462-2f5731fdf64e {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:32 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Updating instance_info_cache with network_info: [{"id": "82460091-aebf-4691-a20c-d7c0affbbba0", "address": "fa:16:3e:27:73:18", "network": {"id": "3c12368b-d5bc-4102-bff5-87b009efa11e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1403358780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82460091-ae", "ovs_interfaceid": "82460091-aebf-4691-a20c-d7c0affbbba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "address": "fa:16:3e:4b:0b:e4", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1647fafb-02", "ovs_interfaceid": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "address": "fa:16:3e:ea:a2:5b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2ff677-b9", "ovs_interfaceid": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "address": "fa:16:3e:21:74:13", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9aa8aa-1d", "ovs_interfaceid": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "966580e7-4512-4064-aa4e-c78c12545f99", "address": "fa:16:3e:35:a4:3b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966580e7-45", "ovs_interfaceid": "966580e7-4512-4064-aa4e-c78c12545f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b13d4895-4841-4176-b770-88848fc8e5e2", "address": "fa:16:3e:0e:f0:9d", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13d4895-48", "ovs_interfaceid": "b13d4895-4841-4176-b770-88848fc8e5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "address": "fa:16:3e:6c:bd:3e", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ea855b-ce", "ovs_interfaceid": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:26:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Releasing lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:26:32 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Instance network_info: |[{"id": "82460091-aebf-4691-a20c-d7c0affbbba0", "address": "fa:16:3e:27:73:18", "network": {"id": "3c12368b-d5bc-4102-bff5-87b009efa11e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1403358780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82460091-ae", "ovs_interfaceid": "82460091-aebf-4691-a20c-d7c0affbbba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "address": "fa:16:3e:4b:0b:e4", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1647fafb-02", "ovs_interfaceid": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "address": "fa:16:3e:ea:a2:5b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2ff677-b9", "ovs_interfaceid": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "address": "fa:16:3e:21:74:13", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9aa8aa-1d", "ovs_interfaceid": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "966580e7-4512-4064-aa4e-c78c12545f99", "address": "fa:16:3e:35:a4:3b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966580e7-45", "ovs_interfaceid": "966580e7-4512-4064-aa4e-c78c12545f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b13d4895-4841-4176-b770-88848fc8e5e2", "address": "fa:16:3e:0e:f0:9d", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13d4895-48", "ovs_interfaceid": "b13d4895-4841-4176-b770-88848fc8e5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "address": "fa:16:3e:6c:bd:3e", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ea855b-ce", "ovs_interfaceid": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:26:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9dbc6842-8ed2-4c3c-b95c-79c04f884760 req-979046e7-deff-4dde-b07f-fa7f9c8bfe04 service nova] Acquired lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:26:32 user nova-compute[72820]: DEBUG nova.network.neutron [req-9dbc6842-8ed2-4c3c-b95c-79c04f884760 req-979046e7-deff-4dde-b07f-fa7f9c8bfe04 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Refreshing network info cache for port 14ea855b-ce40-4fa2-ab19-ea385ca9c65c {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:26:32 user nova-compute[72820]: DEBUG nova.network.neutron [req-9dbc6842-8ed2-4c3c-b95c-79c04f884760 req-979046e7-deff-4dde-b07f-fa7f9c8bfe04 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Updated VIF entry in instance network info cache for port 14ea855b-ce40-4fa2-ab19-ea385ca9c65c. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:26:32 user nova-compute[72820]: DEBUG nova.network.neutron [req-9dbc6842-8ed2-4c3c-b95c-79c04f884760 req-979046e7-deff-4dde-b07f-fa7f9c8bfe04 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Updating instance_info_cache with network_info: [{"id": "82460091-aebf-4691-a20c-d7c0affbbba0", "address": "fa:16:3e:27:73:18", "network": {"id": "3c12368b-d5bc-4102-bff5-87b009efa11e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1403358780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82460091-ae", "ovs_interfaceid": "82460091-aebf-4691-a20c-d7c0affbbba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "address": "fa:16:3e:4b:0b:e4", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1647fafb-02", "ovs_interfaceid": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "address": "fa:16:3e:ea:a2:5b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2ff677-b9", "ovs_interfaceid": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "address": "fa:16:3e:21:74:13", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9aa8aa-1d", "ovs_interfaceid": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "966580e7-4512-4064-aa4e-c78c12545f99", "address": "fa:16:3e:35:a4:3b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966580e7-45", "ovs_interfaceid": "966580e7-4512-4064-aa4e-c78c12545f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b13d4895-4841-4176-b770-88848fc8e5e2", "address": "fa:16:3e:0e:f0:9d", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13d4895-48", "ovs_interfaceid": "b13d4895-4841-4176-b770-88848fc8e5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "address": "fa:16:3e:6c:bd:3e", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ea855b-ce", "ovs_interfaceid": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:26:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9dbc6842-8ed2-4c3c-b95c-79c04f884760 req-979046e7-deff-4dde-b07f-fa7f9c8bfe04 service nova] Releasing lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:26:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:26:37 user nova-compute[72820]: WARNING nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] While synchronizing instance power states, found 8 instances in the database and 6 instances on the hypervisor.
Aug 27 02:26:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid 26581695-c4b9-40b8-ab7a-34c99db0dadb {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid f8f612f3-41c9-4dae-8d49-218d61720b15 {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid 6ed3c12e-96a8-4a32-8089-f04eba608663 {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid 6f37daba-9183-4111-bd01-f30cc4b83c2f {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid f37dfe42-3b22-4111-b10d-9459c8c42b2d {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "26581695-c4b9-40b8-ab7a-34c99db0dadb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "f8f612f3-41c9-4dae-8d49-218d61720b15" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "6f37daba-9183-4111-bd01-f30cc4b83c2f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "6f37daba-9183-4111-bd01-f30cc4b83c2f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "050e0c2b-9244-4987-b07d-e4712e46f936" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:37 user nova-compute[72820]: INFO nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "6f37daba-9183-4111-bd01-f30cc4b83c2f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "050e0c2b-9244-4987-b07d-e4712e46f936" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103182.4008677, f37dfe42-3b22-4111-b10d-9459c8c42b2d => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:26:37 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] VM Stopped (Lifecycle Event)
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a584197b-a136-46fc-a4f9-4d7c6f7d3dfb None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:37 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:26:37 user nova-compute[72820]: INFO nova.compute.claims [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Claim successful on node user
Aug 27 02:26:37 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:26:38 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:26:38 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:26:38 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Creating image(s)
Aug 27 02:26:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "/opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "/opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG nova.policy [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '555eff4f50e9450aac65344bec772685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb32c350e1a44044bc5b19942df53d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.202s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:26:38 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Creating image(s)
Aug 27 02:26:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "/opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "/opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "/opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.258s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk 1073741824" returned: 0 in 0.078s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.341s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.192s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.190s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.218s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk 1073741824" returned: 0 in 0.049s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Cannot resize image /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Ensure instance console log exists: /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.292s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Cannot resize image /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Ensure instance console log exists: /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Start _get_guest_xml network_info=[{"id": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "address": "fa:16:3e:8f:f1:36", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd1df-17", "ovs_interfaceid": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6e24d67e-b2d5-4bbd-b640-b512f56b650b', 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmHeTLfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f37dfe42-3b22-4111-b10d-9459c8c42b2d', 'attached_at': '', 'detached_at': '', 'volume_id': 'db346c69-45aa-475a-95bc-348731d6815a', 'serial': 'db346c69-45aa-475a-95bc-348731d6815a'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:26:39 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 02:26:39 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:26:39 user nova-compute[72820]: DEBUG nova.objects.instance [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lazy-loading 'vcpu_model' on Instance uuid f37dfe42-3b22-4111-b10d-9459c8c42b2d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmHeTLfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:26:40 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:26:40 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:26:40 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f36b2d-d33b-44a7-981e-3b38874f3940]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:26:40 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Successfully created port: 553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b1d50d-8711-4499-9426-04851c8407e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a] added
Aug 27 02:26:40 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1b8057-b773-47bc-a312-20947fb11d36]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3356f11-2ba7-4a51-b13a-fcdfccaa51e7]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pmHeTLfC {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pmHeTLfC" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b13b7b-bfa3-46c7-918a-64330a4f0397]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pmHeTLfC'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca39922b-4b91-45be-b8ef-dd4f27f95a43]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ba3ba3-d93c-484e-b619-9d090edf22a2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:26:40 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:26:40 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ee7f29-2eef-408a-a09c-1645ccbb30af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a, portal: 172.16.0.220,3260]
Aug 27 02:26:40 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a, portal: 172.16.0.220,3260] successful.
Aug 27 02:26:40 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee00097-dc76-4afb-8d5d-1d8906ea2c9a]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d454ba-0556-41a5-85b9-dac863169447]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:26:40 user nova-compute[72820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:26:40 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:26:40 user nova-compute[72820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:26:40 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0da36a3-aa6d-4122-b09e-c80994f9b5ec]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:26:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmHeTLfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Successfully updated port: 553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquired lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.compute.manager [req-1e588b3b-98df-4074-b5c2-4de9a734d399 req-53c79beb-bc66-474c-bff4-21e9c4186385 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received event network-changed-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.compute.manager [req-1e588b3b-98df-4074-b5c2-4de9a734d399 req-53c79beb-bc66-474c-bff4-21e9c4186385 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Refreshing instance network info cache due to event network-changed-553b0551-3051-4ed5-9c80-27d77670620d. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1e588b3b-98df-4074-b5c2-4de9a734d399 req-53c79beb-bc66-474c-bff4-21e9c4186385 service nova] Acquiring lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26237616430613561', 'path': '/dev/sdb'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237616430613561', 'path': '/dev/sdb'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T02:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-421019104',display_name='tempest-ServerActionsTestOtherA-server-879680922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-421019104',id=13,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMw/Y2giaEd949A8TrcWBPdl2Eikv6Xenmfv4cllzQw8aisIhzqkeUdBQYtbr+OYny0m8MqNxEwe+yjAuXRnQEEmz90bzQRRLT4my2+BuCn44VZPZT8Z8gGsdaV35h+jg==',key_name='tempest-keypair-1823346990',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:24:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7797569db44f40f193483e6e6933a0d0',ramdisk_id='',reservation_id='r-251z002r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-892102693',owner_user_name='tempest-ServerActionsTestOtherA-892102693-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='275f713edfd042d4b4fa32620956484a',uuid=f37dfe42-3b22-4111-b10d-9459c8c42b2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "address": "fa:16:3e:8f:f1:36", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd1df-17", "ovs_interfaceid": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converting VIF {"id": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "address": "fa:16:3e:8f:f1:36", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd1df-17", "ovs_interfaceid": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=525fd1df-177d-44ee-a88d-e6dcde84e9d4,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd1df-17') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:26:41 user nova-compute[72820]:   <uuid>f37dfe42-3b22-4111-b10d-9459c8c42b2d</uuid>
Aug 27 02:26:41 user nova-compute[72820]:   <name>instance-0000000d</name>
Aug 27 02:26:41 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:26:41 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:26:41 user nova-compute[72820]:   <metadata>
Aug 27 02:26:41 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:26:41 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:26:41 user nova-compute[72820]:       <nova:name>tempest-ServerActionsTestOtherA-server-879680922</nova:name>
Aug 27 02:26:41 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:26:39</nova:creationTime>
Aug 27 02:26:41 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:26:41 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:26:41 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:26:41 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:26:41 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:26:41 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:26:41 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:26:41 user nova-compute[72820]:       <nova:owner>
Aug 27 02:26:41 user nova-compute[72820]:         <nova:user uuid="275f713edfd042d4b4fa32620956484a">tempest-ServerActionsTestOtherA-892102693-project-member</nova:user>
Aug 27 02:26:41 user nova-compute[72820]:         <nova:project uuid="7797569db44f40f193483e6e6933a0d0">tempest-ServerActionsTestOtherA-892102693</nova:project>
Aug 27 02:26:41 user nova-compute[72820]:       </nova:owner>
Aug 27 02:26:41 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:26:41 user nova-compute[72820]:       <nova:ports>
Aug 27 02:26:41 user nova-compute[72820]:         <nova:port uuid="525fd1df-177d-44ee-a88d-e6dcde84e9d4">
Aug 27 02:26:41 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 02:26:41 user nova-compute[72820]:         </nova:port>
Aug 27 02:26:41 user nova-compute[72820]:       </nova:ports>
Aug 27 02:26:41 user nova-compute[72820]:     </nova:instance>
Aug 27 02:26:41 user nova-compute[72820]:   </metadata>
Aug 27 02:26:41 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:26:41 user nova-compute[72820]:     <system>
Aug 27 02:26:41 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:26:41 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:26:41 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:26:41 user nova-compute[72820]:       <entry name="serial">f37dfe42-3b22-4111-b10d-9459c8c42b2d</entry>
Aug 27 02:26:41 user nova-compute[72820]:       <entry name="uuid">f37dfe42-3b22-4111-b10d-9459c8c42b2d</entry>
Aug 27 02:26:41 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:26:41 user nova-compute[72820]:     </system>
Aug 27 02:26:41 user nova-compute[72820]:   </sysinfo>
Aug 27 02:26:41 user nova-compute[72820]:   <os>
Aug 27 02:26:41 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:26:41 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:26:41 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:26:41 user nova-compute[72820]:   </os>
Aug 27 02:26:41 user nova-compute[72820]:   <features>
Aug 27 02:26:41 user nova-compute[72820]:     <acpi/>
Aug 27 02:26:41 user nova-compute[72820]:     <apic/>
Aug 27 02:26:41 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:26:41 user nova-compute[72820]:   </features>
Aug 27 02:26:41 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:26:41 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:26:41 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:26:41 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:26:41 user nova-compute[72820]:   </clock>
Aug 27 02:26:41 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:26:41 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:26:41 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:26:41 user nova-compute[72820]:   </cpu>
Aug 27 02:26:41 user nova-compute[72820]:   <devices>
Aug 27 02:26:41 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:26:41 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:26:41 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk"/>
Aug 27 02:26:41 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:26:41 user nova-compute[72820]:     </disk>
Aug 27 02:26:41 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:26:41 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:26:41 user nova-compute[72820]:       <source dev="/dev/sdb"/>
Aug 27 02:26:41 user nova-compute[72820]:       <target dev="vdb" bus="virtio"/>
Aug 27 02:26:41 user nova-compute[72820]:       <serial>db346c69-45aa-475a-95bc-348731d6815a</serial>
Aug 27 02:26:41 user nova-compute[72820]:     </disk>
Aug 27 02:26:41 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:26:41 user nova-compute[72820]:       <mac address="fa:16:3e:8f:f1:36"/>
Aug 27 02:26:41 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:26:41 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:26:41 user nova-compute[72820]:       <target dev="tap525fd1df-17"/>
Aug 27 02:26:41 user nova-compute[72820]:     </interface>
Aug 27 02:26:41 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:26:41 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/console.log" append="off"/>
Aug 27 02:26:41 user nova-compute[72820]:     </serial>
Aug 27 02:26:41 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:26:41 user nova-compute[72820]:     <video>
Aug 27 02:26:41 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:26:41 user nova-compute[72820]:     </video>
Aug 27 02:26:41 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:26:41 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:26:41 user nova-compute[72820]:     </rng>
Aug 27 02:26:41 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:26:41 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:26:41 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:26:41 user nova-compute[72820]:     </memballoon>
Aug 27 02:26:41 user nova-compute[72820]:   </devices>
Aug 27 02:26:41 user nova-compute[72820]: </domain>
Aug 27 02:26:41 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T02:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-421019104',display_name='tempest-ServerActionsTestOtherA-server-879680922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-421019104',id=13,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMw/Y2giaEd949A8TrcWBPdl2Eikv6Xenmfv4cllzQw8aisIhzqkeUdBQYtbr+OYny0m8MqNxEwe+yjAuXRnQEEmz90bzQRRLT4my2+BuCn44VZPZT8Z8gGsdaV35h+jg==',key_name='tempest-keypair-1823346990',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:24:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7797569db44f40f193483e6e6933a0d0',ramdisk_id='',reservation_id='r-251z002r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-892102693',owner_user_name='tempest-ServerActionsTestOtherA-892102693-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='275f713edfd042d4b4fa32620956484a',uuid=f37dfe42-3b22-4111-b10d-9459c8c42b2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "address": "fa:16:3e:8f:f1:36", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd1df-17", "ovs_interfaceid": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converting VIF {"id": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "address": "fa:16:3e:8f:f1:36", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd1df-17", "ovs_interfaceid": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=525fd1df-177d-44ee-a88d-e6dcde84e9d4,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd1df-17') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG os_vif [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=525fd1df-177d-44ee-a88d-e6dcde84e9d4,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd1df-17') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap525fd1df-17, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap525fd1df-17, col_values=(('external_ids', {'iface-id': '525fd1df-177d-44ee-a88d-e6dcde84e9d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:f1:36', 'vm-uuid': 'f37dfe42-3b22-4111-b10d-9459c8c42b2d'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:41 user nova-compute[72820]: INFO os_vif [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=525fd1df-177d-44ee-a88d-e6dcde84e9d4,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd1df-17')
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] No VIF found with MAC fa:16:3e:8f:f1:36, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Updating instance_info_cache with network_info: [{"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Releasing lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Instance network_info: |[{"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1e588b3b-98df-4074-b5c2-4de9a734d399 req-53c79beb-bc66-474c-bff4-21e9c4186385 service nova] Acquired lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.network.neutron [req-1e588b3b-98df-4074-b5c2-4de9a734d399 req-53c79beb-bc66-474c-bff4-21e9c4186385 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Refreshing network info cache for port 553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Start _get_guest_xml network_info=[{"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:26:41 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:26:41 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:26:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-75697122',display_name='tempest-ServerActionsTestOtherB-server-75697122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-75697122',id=16,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp3hR8w9f7AOU3wBlGjx2QgjVCzjqvm+j+8m+weDqKoVqafaUie8myGeBPk3f9wFUM+nLfm1AWiPS+cjE0rgULgjP5MomAJch5aNo42dwR8Sd4aT6HChhwUBzyy0SaiOg==',key_name='tempest-keypair-1915839179',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb32c350e1a44044bc5b19942df53d05',ramdisk_id='',reservation_id='r-gmwi89nk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-657110753',owner_user_name='tempest-ServerActionsTestOtherB-657110753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='555eff4f50e9450aac65344bec772685',uuid=ac2f6797-8b7c-47d3-836d-fc1c617e23dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Converting VIF {"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.objects.instance [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lazy-loading 'pci_devices' on Instance uuid ac2f6797-8b7c-47d3-836d-fc1c617e23dd {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:26:41 user nova-compute[72820]:   <uuid>ac2f6797-8b7c-47d3-836d-fc1c617e23dd</uuid>
Aug 27 02:26:41 user nova-compute[72820]:   <name>instance-00000010</name>
Aug 27 02:26:41 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:26:41 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:26:41 user nova-compute[72820]:   <metadata>
Aug 27 02:26:41 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:26:41 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:26:41 user nova-compute[72820]:       <nova:name>tempest-ServerActionsTestOtherB-server-75697122</nova:name>
Aug 27 02:26:41 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:26:41</nova:creationTime>
Aug 27 02:26:41 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:26:41 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:26:41 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:26:41 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:26:41 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:26:41 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:26:41 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:26:41 user nova-compute[72820]:       <nova:owner>
Aug 27 02:26:41 user nova-compute[72820]:         <nova:user uuid="555eff4f50e9450aac65344bec772685">tempest-ServerActionsTestOtherB-657110753-project-member</nova:user>
Aug 27 02:26:41 user nova-compute[72820]:         <nova:project uuid="eb32c350e1a44044bc5b19942df53d05">tempest-ServerActionsTestOtherB-657110753</nova:project>
Aug 27 02:26:41 user nova-compute[72820]:       </nova:owner>
Aug 27 02:26:41 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:26:41 user nova-compute[72820]:       <nova:ports>
Aug 27 02:26:41 user nova-compute[72820]:         <nova:port uuid="553b0551-3051-4ed5-9c80-27d77670620d">
Aug 27 02:26:41 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 02:26:41 user nova-compute[72820]:         </nova:port>
Aug 27 02:26:41 user nova-compute[72820]:       </nova:ports>
Aug 27 02:26:41 user nova-compute[72820]:     </nova:instance>
Aug 27 02:26:41 user nova-compute[72820]:   </metadata>
Aug 27 02:26:41 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:26:41 user nova-compute[72820]:     <system>
Aug 27 02:26:41 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:26:41 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:26:41 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:26:41 user nova-compute[72820]:       <entry name="serial">ac2f6797-8b7c-47d3-836d-fc1c617e23dd</entry>
Aug 27 02:26:41 user nova-compute[72820]:       <entry name="uuid">ac2f6797-8b7c-47d3-836d-fc1c617e23dd</entry>
Aug 27 02:26:41 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:26:41 user nova-compute[72820]:     </system>
Aug 27 02:26:41 user nova-compute[72820]:   </sysinfo>
Aug 27 02:26:41 user nova-compute[72820]:   <os>
Aug 27 02:26:41 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:26:41 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:26:41 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:26:41 user nova-compute[72820]:   </os>
Aug 27 02:26:41 user nova-compute[72820]:   <features>
Aug 27 02:26:41 user nova-compute[72820]:     <acpi/>
Aug 27 02:26:41 user nova-compute[72820]:     <apic/>
Aug 27 02:26:41 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:26:41 user nova-compute[72820]:   </features>
Aug 27 02:26:41 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:26:41 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:26:41 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:26:41 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:26:41 user nova-compute[72820]:   </clock>
Aug 27 02:26:41 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:26:41 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:26:41 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:26:41 user nova-compute[72820]:   </cpu>
Aug 27 02:26:41 user nova-compute[72820]:   <devices>
Aug 27 02:26:41 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:26:41 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:26:41 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk"/>
Aug 27 02:26:41 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:26:41 user nova-compute[72820]:     </disk>
Aug 27 02:26:41 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:26:41 user nova-compute[72820]:       <mac address="fa:16:3e:b6:ef:6b"/>
Aug 27 02:26:41 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:26:41 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:26:41 user nova-compute[72820]:       <target dev="tap553b0551-30"/>
Aug 27 02:26:41 user nova-compute[72820]:     </interface>
Aug 27 02:26:41 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:26:41 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/console.log" append="off"/>
Aug 27 02:26:41 user nova-compute[72820]:     </serial>
Aug 27 02:26:41 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:26:41 user nova-compute[72820]:     <video>
Aug 27 02:26:41 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:26:41 user nova-compute[72820]:     </video>
Aug 27 02:26:41 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:26:41 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:26:41 user nova-compute[72820]:     </rng>
Aug 27 02:26:41 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:26:41 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:26:41 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:26:41 user nova-compute[72820]:     </memballoon>
Aug 27 02:26:41 user nova-compute[72820]:   </devices>
Aug 27 02:26:41 user nova-compute[72820]: </domain>
Aug 27 02:26:41 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:26:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-75697122',display_name='tempest-ServerActionsTestOtherB-server-75697122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-75697122',id=16,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp3hR8w9f7AOU3wBlGjx2QgjVCzjqvm+j+8m+weDqKoVqafaUie8myGeBPk3f9wFUM+nLfm1AWiPS+cjE0rgULgjP5MomAJch5aNo42dwR8Sd4aT6HChhwUBzyy0SaiOg==',key_name='tempest-keypair-1915839179',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb32c350e1a44044bc5b19942df53d05',ramdisk_id='',reservation_id='r-gmwi89nk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-657110753',owner_user_name='tempest-ServerActionsTestOtherB-657110753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='555eff4f50e9450aac65344bec772685',uuid=ac2f6797-8b7c-47d3-836d-fc1c617e23dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Converting VIF {"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG os_vif [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap553b0551-30, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap553b0551-30, col_values=(('external_ids', {'iface-id': '553b0551-3051-4ed5-9c80-27d77670620d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:ef:6b', 'vm-uuid': 'ac2f6797-8b7c-47d3-836d-fc1c617e23dd'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:41 user nova-compute[72820]: INFO os_vif [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30')
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:26:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] No VIF found with MAC fa:16:3e:b6:ef:6b, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:26:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:42 user nova-compute[72820]: DEBUG nova.network.neutron [req-1e588b3b-98df-4074-b5c2-4de9a734d399 req-53c79beb-bc66-474c-bff4-21e9c4186385 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Updated VIF entry in instance network info cache for port 553b0551-3051-4ed5-9c80-27d77670620d. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:26:42 user nova-compute[72820]: DEBUG nova.network.neutron [req-1e588b3b-98df-4074-b5c2-4de9a734d399 req-53c79beb-bc66-474c-bff4-21e9c4186385 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Updating instance_info_cache with network_info: [{"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:26:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1e588b3b-98df-4074-b5c2-4de9a734d399 req-53c79beb-bc66-474c-bff4-21e9c4186385 service nova] Releasing lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:26:43 user nova-compute[72820]: INFO nova.virt.block_device [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Booting with volume 62523bd5-843e-4f3a-95bc-3312cef1e591 at /dev/vdc
Aug 27 02:26:43 user nova-compute[72820]: DEBUG os_brick.utils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c50c987-49cc-44ff-b8a8-36ddf5f8aac3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab1812f-c612-4844-8118-882e47655d0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d807ce-960c-49fe-a8a4-8bbbea5e615c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f334cc5-b9a6-4313-a2dd-27e677af0261]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:26:43 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:26:43 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9e0657-9d5f-401c-98e7-bd47b3d59b6d]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG os_brick.utils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:26:43 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Updating existing volume attachment record: f2d72832-525c-4893-ae5c-548b62a54003 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:26:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:44 user nova-compute[72820]: DEBUG nova.compute.manager [req-60afeb6c-270b-4a94-ba25-914d2f4d8550 req-22b5f109-0b49-4b88-9e1d-ecdffeea16f3 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received event network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-60afeb6c-270b-4a94-ba25-914d2f4d8550 req-22b5f109-0b49-4b88-9e1d-ecdffeea16f3 service nova] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-60afeb6c-270b-4a94-ba25-914d2f4d8550 req-22b5f109-0b49-4b88-9e1d-ecdffeea16f3 service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-60afeb6c-270b-4a94-ba25-914d2f4d8550 req-22b5f109-0b49-4b88-9e1d-ecdffeea16f3 service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:44 user nova-compute[72820]: DEBUG nova.compute.manager [req-60afeb6c-270b-4a94-ba25-914d2f4d8550 req-22b5f109-0b49-4b88-9e1d-ecdffeea16f3 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] No waiting events found dispatching network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:26:44 user nova-compute[72820]: WARNING nova.compute.manager [req-60afeb6c-270b-4a94-ba25-914d2f4d8550 req-22b5f109-0b49-4b88-9e1d-ecdffeea16f3 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received unexpected event network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 for instance with vm_state active and task_state rebuild_spawning.
Aug 27 02:26:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:44 user nova-compute[72820]: INFO nova.compute.manager [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Detaching volume 5ba8bce8-8d37-4482-954f-fd1da52b23cc
Aug 27 02:26:45 user nova-compute[72820]: INFO nova.virt.block_device [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Attempting to driver detach volume 5ba8bce8-8d37-4482-954f-fd1da52b23cc from mountpoint /dev/vdb
Aug 27 02:26:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Attempting to detach device vdb from instance 6ed3c12e-96a8-4a32-8089-f04eba608663 from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:26:45 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:26:45 user nova-compute[72820]:   <source dev="/dev/sdd"/>
Aug 27 02:26:45 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:26:45 user nova-compute[72820]:   <serial>5ba8bce8-8d37-4482-954f-fd1da52b23cc</serial>
Aug 27 02:26:45 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:26:45 user nova-compute[72820]: </disk>
Aug 27 02:26:45 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:26:45 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Successfully detached device vdb from instance 6ed3c12e-96a8-4a32-8089-f04eba608663 from the persistent domain config.
Aug 27 02:26:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ed3c12e-96a8-4a32-8089-f04eba608663 from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:26:45 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:26:45 user nova-compute[72820]:   <source dev="/dev/sdd"/>
Aug 27 02:26:45 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:26:45 user nova-compute[72820]:   <serial>5ba8bce8-8d37-4482-954f-fd1da52b23cc</serial>
Aug 27 02:26:45 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:26:45 user nova-compute[72820]: </disk>
Aug 27 02:26:45 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693103205.585564, 6ed3c12e-96a8-4a32-8089-f04eba608663 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ed3c12e-96a8-4a32-8089-f04eba608663 {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:26:45 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Successfully detached device vdb from instance 6ed3c12e-96a8-4a32-8089-f04eba608663 from the live domain config.
Aug 27 02:26:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkJBEIvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:26:45 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf706fd-c6ba-4733-9a8a-2a7a2dfce307]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:26:45 user nova-compute[72820]: No targets found.
Aug 27 02:26:45 user nova-compute[72820]: iSNS:
Aug 27 02:26:45 user nova-compute[72820]: No targets found.
Aug 27 02:26:45 user nova-compute[72820]: STATIC:
Aug 27 02:26:45 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc
Aug 27 02:26:45 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:26:45 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:26:45 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a
Aug 27 02:26:45 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:26:45 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:26:45 user nova-compute[72820]: FIRMWARE:
Aug 27 02:26:45 user nova-compute[72820]: No targets found.
Aug 27 02:26:45 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:26:45 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:26:45 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1f68f4-8629-4032-bbf8-fdd4d628f266]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c243104-9c8b-44a9-9cae-0170a51c182e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:26:45 user nova-compute[72820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:26:45 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc (non-flash)
Aug 27 02:26:45 user nova-compute[72820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:26:45 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a0603a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc'): ({'sdd'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Removing single pathed devices sdd {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebabeca-ef7b-44a6-ac43-d6dbd3a3c977]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dd3762-6292-47c1-bbe2-642d6f8f7ff9]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Flushing IO for device /dev/sdd {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bc55f0-4599-4c86-908f-3cd836ab0ed4]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d4a0a6-c8c5-4d4e-acf4-ea85fe8784fc]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd1355c-7c6a-416b-b5b9-b4425349b974]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[57570cf9-cc2f-41f5-ba31-796346760627]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc, portal: 172.16.0.220,3260]
Aug 27 02:26:45 user nova-compute[72820]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc, portal: 172.16.0.220,3260] successful.
Aug 27 02:26:45 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba8bce8-8d37-4482-954f-fd1da52b23cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f439440d-c313-40e5-9719-4f67506ef44f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] <== disconnect_volume: return (348ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:26:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:26:46 user nova-compute[72820]: DEBUG nova.compute.manager [req-4ef417ef-919d-4a09-824d-4d4d830ce3b3 req-64aa7b69-1843-4562-bb67-a1b0bdc23051 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received event network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ef417ef-919d-4a09-824d-4d4d830ce3b3 req-64aa7b69-1843-4562-bb67-a1b0bdc23051 service nova] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ef417ef-919d-4a09-824d-4d4d830ce3b3 req-64aa7b69-1843-4562-bb67-a1b0bdc23051 service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ef417ef-919d-4a09-824d-4d4d830ce3b3 req-64aa7b69-1843-4562-bb67-a1b0bdc23051 service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:46 user nova-compute[72820]: DEBUG nova.compute.manager [req-4ef417ef-919d-4a09-824d-4d4d830ce3b3 req-64aa7b69-1843-4562-bb67-a1b0bdc23051 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] No waiting events found dispatching network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:26:46 user nova-compute[72820]: WARNING nova.compute.manager [req-4ef417ef-919d-4a09-824d-4d4d830ce3b3 req-64aa7b69-1843-4562-bb67-a1b0bdc23051 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received unexpected event network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 for instance with vm_state active and task_state rebuild_spawning.
Aug 27 02:26:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.objects.instance [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lazy-loading 'flavor' on Instance uuid 6ed3c12e-96a8-4a32-8089-f04eba608663 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-05e8268e-be31-4fe0-b566-11eed97a723e tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.226s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103207.6386826, ac2f6797-8b7c-47d3-836d-fc1c617e23dd => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:26:47 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] VM Resumed (Lifecycle Event)
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:26:47 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Instance spawned successfully.
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:26:47 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103207.6395957, ac2f6797-8b7c-47d3-836d-fc1c617e23dd => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:26:47 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] VM Started (Lifecycle Event)
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:26:47 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Instance spawned successfully.
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:26:47 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103207.757047, f37dfe42-3b22-4111-b10d-9459c8c42b2d => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:26:47 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] VM Resumed (Lifecycle Event)
Aug 27 02:26:47 user nova-compute[72820]: INFO nova.compute.manager [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Took 9.48 seconds to spawn the instance on the hypervisor.
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:26:47 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103207.7589128, f37dfe42-3b22-4111-b10d-9459c8c42b2d => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:26:47 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] VM Started (Lifecycle Event)
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:26:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:26:48 user nova-compute[72820]: INFO nova.compute.manager [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Took 10.51 seconds to build instance.
Aug 27 02:26:48 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 02:26:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3c20bc06-73b1-4d58-ab48-e4159acae457 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.639s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:48 user nova-compute[72820]: DEBUG nova.objects.instance [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72820) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 27 02:26:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a11b430b-9db3-4c14-82b9-d469a0076086 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.150s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-f8a9cf31-0fc5-45a1-8141-032f6b69addc req-f435dde5-3b38-44ea-9f92-d2014cba59d0 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received event network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f8a9cf31-0fc5-45a1-8141-032f6b69addc req-f435dde5-3b38-44ea-9f92-d2014cba59d0 service nova] Acquiring lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f8a9cf31-0fc5-45a1-8141-032f6b69addc req-f435dde5-3b38-44ea-9f92-d2014cba59d0 service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f8a9cf31-0fc5-45a1-8141-032f6b69addc req-f435dde5-3b38-44ea-9f92-d2014cba59d0 service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-f8a9cf31-0fc5-45a1-8141-032f6b69addc req-f435dde5-3b38-44ea-9f92-d2014cba59d0 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] No waiting events found dispatching network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:26:48 user nova-compute[72820]: WARNING nova.compute.manager [req-f8a9cf31-0fc5-45a1-8141-032f6b69addc req-f435dde5-3b38-44ea-9f92-d2014cba59d0 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received unexpected event network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d for instance with vm_state active and task_state None.
Aug 27 02:26:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "1591319d-3d15-4c46-b823-4edddf018b5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:26:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:48 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:26:48 user nova-compute[72820]: INFO nova.compute.claims [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Claim successful on node user
Aug 27 02:26:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:49 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:26:49 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:26:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.823s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:49 user nova-compute[72820]: DEBUG nova.compute.manager [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:26:49 user nova-compute[72820]: DEBUG nova.compute.manager [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:26:49 user nova-compute[72820]: DEBUG nova.network.neutron [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:26:49 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:26:49 user nova-compute[72820]: DEBUG nova.compute.manager [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:26:50 user nova-compute[72820]: INFO nova.virt.block_device [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Booting with blank volume at /dev/vda
Aug 27 02:26:50 user nova-compute[72820]: INFO nova.compute.manager [None req-04e6d4af-2496-4918-a7b0-637e07d19229 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Unrescuing
Aug 27 02:26:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-04e6d4af-2496-4918-a7b0-637e07d19229 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:26:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-04e6d4af-2496-4918-a7b0-637e07d19229 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquired lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:26:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-04e6d4af-2496-4918-a7b0-637e07d19229 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:26:50 user nova-compute[72820]: DEBUG nova.policy [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb67e11ecdd648a89dd58b4bf416060a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f023daf1767f4088bf0a23524587e662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:26:50 user nova-compute[72820]: DEBUG nova.compute.manager [req-ea646d38-ecac-47f3-a2f7-e744da188ac7 req-d207d986-97e6-4959-b06d-60289ebcb057 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received event network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ea646d38-ecac-47f3-a2f7-e744da188ac7 req-d207d986-97e6-4959-b06d-60289ebcb057 service nova] Acquiring lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ea646d38-ecac-47f3-a2f7-e744da188ac7 req-d207d986-97e6-4959-b06d-60289ebcb057 service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ea646d38-ecac-47f3-a2f7-e744da188ac7 req-d207d986-97e6-4959-b06d-60289ebcb057 service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:50 user nova-compute[72820]: DEBUG nova.compute.manager [req-ea646d38-ecac-47f3-a2f7-e744da188ac7 req-d207d986-97e6-4959-b06d-60289ebcb057 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] No waiting events found dispatching network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:26:50 user nova-compute[72820]: WARNING nova.compute.manager [req-ea646d38-ecac-47f3-a2f7-e744da188ac7 req-d207d986-97e6-4959-b06d-60289ebcb057 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received unexpected event network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d for instance with vm_state active and task_state None.
Aug 27 02:26:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-04e6d4af-2496-4918-a7b0-637e07d19229 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Updating instance_info_cache with network_info: [{"id": "4a579280-0dce-49fb-861a-4577ba1d70a3", "address": "fa:16:3e:37:4e:12", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a579280-0d", "ovs_interfaceid": "4a579280-0dce-49fb-861a-4577ba1d70a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:26:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-04e6d4af-2496-4918-a7b0-637e07d19229 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Releasing lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:26:50 user nova-compute[72820]: DEBUG nova.objects.instance [None req-04e6d4af-2496-4918-a7b0-637e07d19229 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'flavor' on Instance uuid 26581695-c4b9-40b8-ab7a-34c99db0dadb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:26:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:52 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Instance destroyed successfully.
Aug 27 02:26:52 user nova-compute[72820]: DEBUG nova.network.neutron [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Successfully created port: db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:26:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:54 user nova-compute[72820]: DEBUG nova.network.neutron [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Successfully updated port: db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:26:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "refresh_cache-1591319d-3d15-4c46-b823-4edddf018b5f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:26:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquired lock "refresh_cache-1591319d-3d15-4c46-b823-4edddf018b5f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:26:54 user nova-compute[72820]: DEBUG nova.network.neutron [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:26:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-0788b830-30a6-4363-891c-d8717a180a2e req-6fa892b5-fe01-46f5-a881-4fc7f992766d service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-changed-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-0788b830-30a6-4363-891c-d8717a180a2e req-6fa892b5-fe01-46f5-a881-4fc7f992766d service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Refreshing instance network info cache due to event network-changed-db04bdd2-29ba-41ba-a78f-ab10b81ae54e. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:26:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0788b830-30a6-4363-891c-d8717a180a2e req-6fa892b5-fe01-46f5-a881-4fc7f992766d service nova] Acquiring lock "refresh_cache-1591319d-3d15-4c46-b823-4edddf018b5f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:26:54 user nova-compute[72820]: DEBUG nova.network.neutron [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:26:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:54 user nova-compute[72820]: DEBUG nova.network.neutron [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Updating instance_info_cache with network_info: [{"id": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "address": "fa:16:3e:05:00:70", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb04bdd2-29", "ovs_interfaceid": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:26:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Releasing lock "refresh_cache-1591319d-3d15-4c46-b823-4edddf018b5f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:26:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Instance network_info: |[{"id": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "address": "fa:16:3e:05:00:70", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb04bdd2-29", "ovs_interfaceid": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:26:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0788b830-30a6-4363-891c-d8717a180a2e req-6fa892b5-fe01-46f5-a881-4fc7f992766d service nova] Acquired lock "refresh_cache-1591319d-3d15-4c46-b823-4edddf018b5f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:26:54 user nova-compute[72820]: DEBUG nova.network.neutron [req-0788b830-30a6-4363-891c-d8717a180a2e req-6fa892b5-fe01-46f5-a881-4fc7f992766d service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Refreshing network info cache for port db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:26:55 user nova-compute[72820]: DEBUG nova.network.neutron [req-0788b830-30a6-4363-891c-d8717a180a2e req-6fa892b5-fe01-46f5-a881-4fc7f992766d service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Updated VIF entry in instance network info cache for port db04bdd2-29ba-41ba-a78f-ab10b81ae54e. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:26:55 user nova-compute[72820]: DEBUG nova.network.neutron [req-0788b830-30a6-4363-891c-d8717a180a2e req-6fa892b5-fe01-46f5-a881-4fc7f992766d service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Updating instance_info_cache with network_info: [{"id": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "address": "fa:16:3e:05:00:70", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb04bdd2-29", "ovs_interfaceid": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:26:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0788b830-30a6-4363-891c-d8717a180a2e req-6fa892b5-fe01-46f5-a881-4fc7f992766d service nova] Releasing lock "refresh_cache-1591319d-3d15-4c46-b823-4edddf018b5f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:26:55 user nova-compute[72820]: DEBUG os_brick.utils [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:26:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[504c61f0-fde2-43c1-9303-1197b8bca434]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8d4bfc-1da2-4e29-a898-a169bb533b8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2779af4a-d974-4224-b911-8bda0870b7ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[609d8e3f-bd9f-4c85-a856-b0530b3c557f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:26:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:26:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:26:56 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:26:56 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5649c44-72f9-4ae9-beb5-841403d1d531]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:26:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:26:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:26:56 user nova-compute[72820]: DEBUG os_brick.utils [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:26:56 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Updating existing volume attachment record: 26690c69-6db5-48db-9c11-665f8fcddd4c {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:26:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "7c42c4ae-0f80-4295-a64e-b426225b94c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:56 user nova-compute[72820]: DEBUG nova.compute.manager [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:26:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:56 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:26:56 user nova-compute[72820]: INFO nova.compute.claims [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Claim successful on node user
Aug 27 02:26:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Removed pending event for 26581695-c4b9-40b8-ab7a-34c99db0dadb due to event {{(pid=72820) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 02:26:56 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103216.9653425, 26581695-c4b9-40b8-ab7a-34c99db0dadb => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:26:56 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] VM Resumed (Lifecycle Event)
Aug 27 02:26:56 user nova-compute[72820]: DEBUG nova.compute.manager [None req-04e6d4af-2496-4918-a7b0-637e07d19229 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:26:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:26:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:26:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:26:57 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 02:26:57 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103216.968003, 26581695-c4b9-40b8-ab7a-34c99db0dadb => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:26:57 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] VM Started (Lifecycle Event)
Aug 27 02:26:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:26:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:26:57 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:26:57 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:26:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.763s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:26:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:26:57 user nova-compute[72820]: DEBUG nova.network.neutron [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:26:57 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:26:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:26:57 user nova-compute[72820]: DEBUG nova.policy [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76b3417256eb4ff7924db6912e97726c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddd7d54478749cba3988913864379ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:26:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:26:57 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:26:57 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Creating image(s)
Aug 27 02:26:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "/opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "/opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.312s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.238s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk 1073741824" returned: 0 in 0.075s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.243s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-513dbbcc-96c5-43aa-928d-c4988d2f6c59 req-83881f9d-9fd0-43c3-97b1-39a771fb918f service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received event network-vif-unplugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-513dbbcc-96c5-43aa-928d-c4988d2f6c59 req-83881f9d-9fd0-43c3-97b1-39a771fb918f service nova] Acquiring lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-513dbbcc-96c5-43aa-928d-c4988d2f6c59 req-83881f9d-9fd0-43c3-97b1-39a771fb918f service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-513dbbcc-96c5-43aa-928d-c4988d2f6c59 req-83881f9d-9fd0-43c3-97b1-39a771fb918f service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-513dbbcc-96c5-43aa-928d-c4988d2f6c59 req-83881f9d-9fd0-43c3-97b1-39a771fb918f service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] No waiting events found dispatching network-vif-unplugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:26:58 user nova-compute[72820]: WARNING nova.compute.manager [req-513dbbcc-96c5-43aa-928d-c4988d2f6c59 req-83881f9d-9fd0-43c3-97b1-39a771fb918f service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received unexpected event network-vif-unplugged-4a579280-0dce-49fb-861a-4577ba1d70a3 for instance with vm_state active and task_state None.
Aug 27 02:26:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Cannot resize image /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Ensure instance console log exists: /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:26:59 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Creating image(s)
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Did not create local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Ensure instance console log exists: /opt/stack/data/nova/instances/edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Start _get_guest_xml network_info=[{"id": "82460091-aebf-4691-a20c-d7c0affbbba0", "address": "fa:16:3e:27:73:18", "network": {"id": "3c12368b-d5bc-4102-bff5-87b009efa11e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1403358780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82460091-ae", "ovs_interfaceid": "82460091-aebf-4691-a20c-d7c0affbbba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "address": "fa:16:3e:4b:0b:e4", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1647fafb-02", "ovs_interfaceid": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "address": "fa:16:3e:ea:a2:5b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2ff677-b9", "ovs_interfaceid": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "address": "fa:16:3e:21:74:13", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9aa8aa-1d", "ovs_interfaceid": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "966580e7-4512-4064-aa4e-c78c12545f99", "address": "fa:16:3e:35:a4:3b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966580e7-45", "ovs_interfaceid": "966580e7-4512-4064-aa4e-c78c12545f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b13d4895-4841-4176-b770-88848fc8e5e2", "address": "fa:16:3e:0e:f0:9d", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13d4895-48", "ovs_interfaceid": "b13d4895-4841-4176-b770-88848fc8e5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "address": "fa:16:3e:6c:bd:3e", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ea855b-ce", "ovs_interfaceid": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a432c287-f931-4c65-95c3-bb24ab1703ed', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bNlZPgKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd', 'attached_at': '', 'detached_at': '', 'volume_id': '9232106a-0c47-4086-9e35-8d5f6d454ee5', 'serial': '9232106a-0c47-4086-9e35-8d5f6d454ee5'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '478fedab-eda5-4530-a462-2f5731fdf64e', 'mount_device': '/dev/vdb', 'boot_index': 1, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHuFwRjI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb336f72-5156-4865-b694-6f854b1b99eb', 'serial': 'eb336f72-5156-4865-b694-6f854b1b99eb'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': 'f2d72832-525c-4893-ae5c-548b62a54003', 'mount_device': '/dev/vdc', 'boot_index': 2, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJVgPTKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd', 'attached_at': '', 'detached_at': '', 'volume_id': '62523bd5-843e-4f3a-95bc-3312cef1e591', 'serial': '62523bd5-843e-4f3a-95bc-3312cef1e591'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:26:59 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:26:59 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bNlZPgKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:26:59 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:26:59 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:26:59 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:26:59 user nova-compute[72820]: DEBUG nova.network.neutron [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Successfully created port: d901c17c-746e-41ac-8066-cb1d4c4b0d69 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8383217-7487-4be3-a342-1e0a57376f26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:26:59 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea5c0d6-c494-4a04-b395-329bab8a9db9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5] added
Aug 27 02:26:59 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b408e77-b296-473d-8039-63c5dd94d893]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[70088a23-aa9b-4ae6-ba68-5236693adb5f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bNlZPgKk {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bNlZPgKk" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9e4152-4533-458b-9686-b95ac789dfb1]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bNlZPgKk'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[395eec89-e351-4156-a479-d95c84e5080f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0686b3-00f2-49fa-b657-bedf913b132e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:26:59 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:26:59 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[279cd768-57e1-4aac-bcd6-2e87135c438b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5, portal: 172.16.0.220,3260]
Aug 27 02:26:59 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5, portal: 172.16.0.220,3260] successful.
Aug 27 02:26:59 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b397ec2b-00c2-4974-94b2-5048be516f6d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec9019d-923f-4fc2-a788-e49156825aaa]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:26:59 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:26:59 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:26:59 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:26:59 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:26:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.092s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18f239c-9a42-465f-a343-d9fe79ba132d]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:27:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bNlZPgKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:27:00 user nova-compute[72820]: DEBUG nova.network.neutron [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Successfully updated port: d901c17c-746e-41ac-8066-cb1d4c4b0d69 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:27:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "refresh_cache-7c42c4ae-0f80-4295-a64e-b426225b94c5" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:27:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquired lock "refresh_cache-7c42c4ae-0f80-4295-a64e-b426225b94c5" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:27:00 user nova-compute[72820]: DEBUG nova.network.neutron [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received event network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] Acquiring lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] No waiting events found dispatching network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:01 user nova-compute[72820]: WARNING nova.compute.manager [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received unexpected event network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 for instance with vm_state active and task_state None.
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received event network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] Acquiring lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] No waiting events found dispatching network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:01 user nova-compute[72820]: WARNING nova.compute.manager [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received unexpected event network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 for instance with vm_state active and task_state None.
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received event network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] Acquiring lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] No waiting events found dispatching network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:01 user nova-compute[72820]: WARNING nova.compute.manager [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received unexpected event network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 for instance with vm_state active and task_state None.
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Received event network-changed-d901c17c-746e-41ac-8066-cb1d4c4b0d69 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Refreshing instance network info cache due to event network-changed-d901c17c-746e-41ac-8066-cb1d4c4b0d69. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] Acquiring lock "refresh_cache-7c42c4ae-0f80-4295-a64e-b426225b94c5" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.485s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] <== connect_volume: return (1487ms) {'type': 'block', 'scsi_wwn': '26362356638306531', 'path': '/dev/sdc'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362356638306531', 'path': '/dev/sdc'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.network.neutron [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHuFwRjI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:27:01 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:27:01 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:27:01 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da88ca0-87fd-4ada-8e71-9a80395cd578]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:27:01 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf33851-ac52-48c1-9a00-6f2d2ea374f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb] added
Aug 27 02:27:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9204f936-3e82-4933-84db-72d2286f9eb1]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[44769c68-9b5b-48dd-8d30-7fb787adc553]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UHuFwRjI {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UHuFwRjI" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bead97-5153-4c4d-a72a-549370cbccdc]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UHuFwRjI'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96b14bb-6d87-4a6f-8195-ffd0434d9c7d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fb16fb-02b6-45d0-b54b-de77f4f526d5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:27:01 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:27:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:27:01 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:27:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff396d2-03e1-437e-8c71-4efacf80bff3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb, portal: 172.16.0.220,3260]
Aug 27 02:27:01 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb, portal: 172.16.0.220,3260] successful.
Aug 27 02:27:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedc2be6-084b-478b-b589-0857a77e1f85]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[657dd062-b7f5-473b-8ae6-cb1a93844eb7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:27:01 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:27:01 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:27:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:27:01 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:27:01 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:27:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.417s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33fd8d1-4f04-4edd-96d2-3405c0934e36]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHuFwRjI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.network.neutron [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Updating instance_info_cache with network_info: [{"id": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "address": "fa:16:3e:51:e5:4a", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd901c17c-74", "ovs_interfaceid": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Releasing lock "refresh_cache-7c42c4ae-0f80-4295-a64e-b426225b94c5" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Instance network_info: |[{"id": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "address": "fa:16:3e:51:e5:4a", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd901c17c-74", "ovs_interfaceid": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] Acquired lock "refresh_cache-7c42c4ae-0f80-4295-a64e-b426225b94c5" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.network.neutron [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Refreshing network info cache for port d901c17c-746e-41ac-8066-cb1d4c4b0d69 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Start _get_guest_xml network_info=[{"id": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "address": "fa:16:3e:51:e5:4a", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd901c17c-74", "ovs_interfaceid": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:27:01 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:27:01 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:27:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:26:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-468413800',display_name='tempest-VolumesAdminNegativeTest-server-468413800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-468413800',id=18,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8iM92FaA00mKy2De9QnWQRjd2n/WUAKku5o4xuj5gyiqETxjfoVzQfjhLqNf9EJzi+mx2g9bBlU6/XhebjHQBxb+GrQRtr+ScNA4C44LcxSwaYMihvVrbfUJsoyJDgrA==',key_name='tempest-keypair-301165627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ddd7d54478749cba3988913864379ed',ramdisk_id='',reservation_id='r-5607uo4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1861523875',owner_user_name='tempest-VolumesAdminNegativeTest-1861523875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76b3417256eb4ff7924db6912e97726c',uuid=7c42c4ae-0f80-4295-a64e-b426225b94c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "address": "fa:16:3e:51:e5:4a", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd901c17c-74", "ovs_interfaceid": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Converting VIF {"id": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "address": "fa:16:3e:51:e5:4a", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd901c17c-74", "ovs_interfaceid": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:e5:4a,bridge_name='br-int',has_traffic_filtering=True,id=d901c17c-746e-41ac-8066-cb1d4c4b0d69,network=Network(8741024c-a257-4a16-b983-d6ac4f6b5ad2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd901c17c-74') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG nova.objects.instance [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c42c4ae-0f80-4295-a64e-b426225b94c5 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:27:02 user nova-compute[72820]:   <uuid>7c42c4ae-0f80-4295-a64e-b426225b94c5</uuid>
Aug 27 02:27:02 user nova-compute[72820]:   <name>instance-00000012</name>
Aug 27 02:27:02 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:27:02 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:27:02 user nova-compute[72820]:   <metadata>
Aug 27 02:27:02 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:27:02 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:27:02 user nova-compute[72820]:       <nova:name>tempest-VolumesAdminNegativeTest-server-468413800</nova:name>
Aug 27 02:27:02 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:27:01</nova:creationTime>
Aug 27 02:27:02 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:27:02 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:27:02 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:27:02 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:27:02 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:27:02 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:27:02 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:27:02 user nova-compute[72820]:       <nova:owner>
Aug 27 02:27:02 user nova-compute[72820]:         <nova:user uuid="76b3417256eb4ff7924db6912e97726c">tempest-VolumesAdminNegativeTest-1861523875-project-member</nova:user>
Aug 27 02:27:02 user nova-compute[72820]:         <nova:project uuid="6ddd7d54478749cba3988913864379ed">tempest-VolumesAdminNegativeTest-1861523875</nova:project>
Aug 27 02:27:02 user nova-compute[72820]:       </nova:owner>
Aug 27 02:27:02 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:27:02 user nova-compute[72820]:       <nova:ports>
Aug 27 02:27:02 user nova-compute[72820]:         <nova:port uuid="d901c17c-746e-41ac-8066-cb1d4c4b0d69">
Aug 27 02:27:02 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 02:27:02 user nova-compute[72820]:         </nova:port>
Aug 27 02:27:02 user nova-compute[72820]:       </nova:ports>
Aug 27 02:27:02 user nova-compute[72820]:     </nova:instance>
Aug 27 02:27:02 user nova-compute[72820]:   </metadata>
Aug 27 02:27:02 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:27:02 user nova-compute[72820]:     <system>
Aug 27 02:27:02 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:27:02 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:27:02 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:27:02 user nova-compute[72820]:       <entry name="serial">7c42c4ae-0f80-4295-a64e-b426225b94c5</entry>
Aug 27 02:27:02 user nova-compute[72820]:       <entry name="uuid">7c42c4ae-0f80-4295-a64e-b426225b94c5</entry>
Aug 27 02:27:02 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:27:02 user nova-compute[72820]:     </system>
Aug 27 02:27:02 user nova-compute[72820]:   </sysinfo>
Aug 27 02:27:02 user nova-compute[72820]:   <os>
Aug 27 02:27:02 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:27:02 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:27:02 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:27:02 user nova-compute[72820]:   </os>
Aug 27 02:27:02 user nova-compute[72820]:   <features>
Aug 27 02:27:02 user nova-compute[72820]:     <acpi/>
Aug 27 02:27:02 user nova-compute[72820]:     <apic/>
Aug 27 02:27:02 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:27:02 user nova-compute[72820]:   </features>
Aug 27 02:27:02 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:27:02 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:27:02 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:27:02 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:27:02 user nova-compute[72820]:   </clock>
Aug 27 02:27:02 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:27:02 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:27:02 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:27:02 user nova-compute[72820]:   </cpu>
Aug 27 02:27:02 user nova-compute[72820]:   <devices>
Aug 27 02:27:02 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:27:02 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:27:02 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk"/>
Aug 27 02:27:02 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:27:02 user nova-compute[72820]:     </disk>
Aug 27 02:27:02 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:27:02 user nova-compute[72820]:       <mac address="fa:16:3e:51:e5:4a"/>
Aug 27 02:27:02 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:27:02 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:27:02 user nova-compute[72820]:       <target dev="tapd901c17c-74"/>
Aug 27 02:27:02 user nova-compute[72820]:     </interface>
Aug 27 02:27:02 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:27:02 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/console.log" append="off"/>
Aug 27 02:27:02 user nova-compute[72820]:     </serial>
Aug 27 02:27:02 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:27:02 user nova-compute[72820]:     <video>
Aug 27 02:27:02 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:27:02 user nova-compute[72820]:     </video>
Aug 27 02:27:02 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:27:02 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:27:02 user nova-compute[72820]:     </rng>
Aug 27 02:27:02 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:27:02 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:27:02 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:27:02 user nova-compute[72820]:     </memballoon>
Aug 27 02:27:02 user nova-compute[72820]:   </devices>
Aug 27 02:27:02 user nova-compute[72820]: </domain>
Aug 27 02:27:02 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:26:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-468413800',display_name='tempest-VolumesAdminNegativeTest-server-468413800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-468413800',id=18,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8iM92FaA00mKy2De9QnWQRjd2n/WUAKku5o4xuj5gyiqETxjfoVzQfjhLqNf9EJzi+mx2g9bBlU6/XhebjHQBxb+GrQRtr+ScNA4C44LcxSwaYMihvVrbfUJsoyJDgrA==',key_name='tempest-keypair-301165627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ddd7d54478749cba3988913864379ed',ramdisk_id='',reservation_id='r-5607uo4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1861523875',owner_user_name='tempest-VolumesAdminNegativeTest-1861523875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76b3417256eb4ff7924db6912e97726c',uuid=7c42c4ae-0f80-4295-a64e-b426225b94c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "address": "fa:16:3e:51:e5:4a", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd901c17c-74", "ovs_interfaceid": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Converting VIF {"id": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "address": "fa:16:3e:51:e5:4a", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd901c17c-74", "ovs_interfaceid": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:e5:4a,bridge_name='br-int',has_traffic_filtering=True,id=d901c17c-746e-41ac-8066-cb1d4c4b0d69,network=Network(8741024c-a257-4a16-b983-d6ac4f6b5ad2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd901c17c-74') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG os_vif [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:e5:4a,bridge_name='br-int',has_traffic_filtering=True,id=d901c17c-746e-41ac-8066-cb1d4c4b0d69,network=Network(8741024c-a257-4a16-b983-d6ac4f6b5ad2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd901c17c-74') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd901c17c-74, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd901c17c-74, col_values=(('external_ids', {'iface-id': 'd901c17c-746e-41ac-8066-cb1d4c4b0d69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:e5:4a', 'vm-uuid': '7c42c4ae-0f80-4295-a64e-b426225b94c5'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:02 user nova-compute[72820]: INFO os_vif [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:e5:4a,bridge_name='br-int',has_traffic_filtering=True,id=d901c17c-746e-41ac-8066-cb1d4c4b0d69,network=Network(8741024c-a257-4a16-b983-d6ac4f6b5ad2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd901c17c-74')
Aug 27 02:27:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] No VIF found with MAC fa:16:3e:51:e5:4a, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.486s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] <== connect_volume: return (1488ms) {'type': 'block', 'scsi_wwn': '23733306332656366', 'path': '/dev/sdd'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733306332656366', 'path': '/dev/sdd'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJVgPTKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:27:02 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:27:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:27:02 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:27:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:27:02 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5448a68c-63b9-40cb-945d-86a4189534b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:27:02 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc31f70-691f-4ba5-933a-4441abc5e184]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591] added
Aug 27 02:27:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f82013-badc-4845-b158-a87b033b357a]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8122ca5-088c-4f68-af58-afca170b2e2f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJVgPTKf {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJVgPTKf" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf4e985-6de9-4b00-bc5e-8dd9753b881b]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZJVgPTKf'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdc3308-d223-4d6d-ad8c-732ee32e1e62]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a717ecb-a6c4-4fd5-8939-5d5ec722af9b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:27:02 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:27:02 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:27:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:27:02 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:27:02 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:27:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG nova.network.neutron [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Updated VIF entry in instance network info cache for port d901c17c-746e-41ac-8066-cb1d4c4b0d69. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG nova.network.neutron [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Updating instance_info_cache with network_info: [{"id": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "address": "fa:16:3e:51:e5:4a", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd901c17c-74", "ovs_interfaceid": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[282aa317-71c6-4781-9395-dbfef52bab39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591, portal: 172.16.0.220,3260]
Aug 27 02:27:02 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591, portal: 172.16.0.220,3260] successful.
Aug 27 02:27:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5f0d0910-9905-4463-9ae2-93f34c39ea3f req-e6f0ddf9-c5ad-4724-ab16-73693623a36d service nova] Releasing lock "refresh_cache-7c42c4ae-0f80-4295-a64e-b426225b94c5" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:27:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:03 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be590a9-5178-44eb-8b1c-84f012fe82a9]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:03 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cb1196-56d2-4b12-806e-327dad5327e7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:27:03 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:27:03 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:27:03 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:27:03 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:27:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:27:03 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:27:03 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:27:03 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:27:03 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:27:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:27:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:27:03 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:27:03 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:27:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.040s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:03 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e672f3e-e3c3-46cf-9cd4-32b3856c7589]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:03 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:27:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJVgPTKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:27:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] <== connect_volume: return (1463ms) {'type': 'block', 'scsi_wwn': '26337643235353735', 'path': '/dev/sde'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337643235353735', 'path': '/dev/sde'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82460091-aebf-4691-a20c-d7c0affbbba0", "address": "fa:16:3e:27:73:18", "network": {"id": "3c12368b-d5bc-4102-bff5-87b009efa11e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1403358780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82460091-ae", "ovs_interfaceid": "82460091-aebf-4691-a20c-d7c0affbbba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "82460091-aebf-4691-a20c-d7c0affbbba0", "address": "fa:16:3e:27:73:18", "network": {"id": "3c12368b-d5bc-4102-bff5-87b009efa11e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1403358780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82460091-ae", "ovs_interfaceid": "82460091-aebf-4691-a20c-d7c0affbbba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:73:18,bridge_name='br-int',has_traffic_filtering=True,id=82460091-aebf-4691-a20c-d7c0affbbba0,network=Network(3c12368b-d5bc-4102-bff5-87b009efa11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82460091-ae') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "address": "fa:16:3e:4b:0b:e4", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1647fafb-02", "ovs_interfaceid": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "address": "fa:16:3e:4b:0b:e4", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1647fafb-02", "ovs_interfaceid": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0b:e4,bridge_name='br-int',has_traffic_filtering=True,id=1647fafb-02da-4fa5-a62f-d43919dd49a6,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1647fafb-02') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "address": "fa:16:3e:ea:a2:5b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2ff677-b9", "ovs_interfaceid": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "address": "fa:16:3e:ea:a2:5b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2ff677-b9", "ovs_interfaceid": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a2:5b,bridge_name='br-int',has_traffic_filtering=True,id=4c2ff677-b994-41bc-94e5-e542ad18fb4e,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c2ff677-b9') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "address": "fa:16:3e:21:74:13", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9aa8aa-1d", "ovs_interfaceid": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "address": "fa:16:3e:21:74:13", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9aa8aa-1d", "ovs_interfaceid": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:74:13,bridge_name='br-int',has_traffic_filtering=True,id=4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9aa8aa-1d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "966580e7-4512-4064-aa4e-c78c12545f99", "address": "fa:16:3e:35:a4:3b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966580e7-45", "ovs_interfaceid": "966580e7-4512-4064-aa4e-c78c12545f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "966580e7-4512-4064-aa4e-c78c12545f99", "address": "fa:16:3e:35:a4:3b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966580e7-45", "ovs_interfaceid": "966580e7-4512-4064-aa4e-c78c12545f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:a4:3b,bridge_name='br-int',has_traffic_filtering=True,id=966580e7-4512-4064-aa4e-c78c12545f99,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap966580e7-45') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b13d4895-4841-4176-b770-88848fc8e5e2", "address": "fa:16:3e:0e:f0:9d", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13d4895-48", "ovs_interfaceid": "b13d4895-4841-4176-b770-88848fc8e5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "b13d4895-4841-4176-b770-88848fc8e5e2", "address": "fa:16:3e:0e:f0:9d", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13d4895-48", "ovs_interfaceid": "b13d4895-4841-4176-b770-88848fc8e5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:f0:9d,bridge_name='br-int',has_traffic_filtering=True,id=b13d4895-4841-4176-b770-88848fc8e5e2,network=Network(506f9029-7bbf-43f7-af98-765cea3d8473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13d4895-48') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "address": "fa:16:3e:6c:bd:3e", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ea855b-ce", "ovs_interfaceid": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "address": "fa:16:3e:6c:bd:3e", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ea855b-ce", "ovs_interfaceid": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:bd:3e,bridge_name='br-int',has_traffic_filtering=True,id=14ea855b-ce40-4fa2-ab19-ea385ca9c65c,network=Network(506f9029-7bbf-43f7-af98-765cea3d8473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ea855b-ce') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.objects.instance [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lazy-loading 'pci_devices' on Instance uuid edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:27:04 user nova-compute[72820]:   <uuid>edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd</uuid>
Aug 27 02:27:04 user nova-compute[72820]:   <name>instance-0000000f</name>
Aug 27 02:27:04 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:27:04 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:27:04 user nova-compute[72820]:   <metadata>
Aug 27 02:27:04 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:27:04 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:27:04 user nova-compute[72820]:       <nova:name>tempest-device-tagging-server-156732240</nova:name>
Aug 27 02:27:04 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:26:59</nova:creationTime>
Aug 27 02:27:04 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:27:04 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:27:04 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:27:04 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:27:04 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:27:04 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:27:04 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:27:04 user nova-compute[72820]:       <nova:owner>
Aug 27 02:27:04 user nova-compute[72820]:         <nova:user uuid="0acc5b76a48348b4b02aecee3a35e096">tempest-TaggedBootDevicesTest-1708560788-project-member</nova:user>
Aug 27 02:27:04 user nova-compute[72820]:         <nova:project uuid="c14062f1cf8e4244ae629536b131ac0c">tempest-TaggedBootDevicesTest-1708560788</nova:project>
Aug 27 02:27:04 user nova-compute[72820]:       </nova:owner>
Aug 27 02:27:04 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:27:04 user nova-compute[72820]:       <nova:ports>
Aug 27 02:27:04 user nova-compute[72820]:         <nova:port uuid="82460091-aebf-4691-a20c-d7c0affbbba0">
Aug 27 02:27:04 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 02:27:04 user nova-compute[72820]:         </nova:port>
Aug 27 02:27:04 user nova-compute[72820]:         <nova:port uuid="1647fafb-02da-4fa5-a62f-d43919dd49a6">
Aug 27 02:27:04 user nova-compute[72820]:           <nova:ip type="fixed" address="10.1.1.231" ipVersion="4"/>
Aug 27 02:27:04 user nova-compute[72820]:         </nova:port>
Aug 27 02:27:04 user nova-compute[72820]:         <nova:port uuid="4c2ff677-b994-41bc-94e5-e542ad18fb4e">
Aug 27 02:27:04 user nova-compute[72820]:           <nova:ip type="fixed" address="10.1.1.97" ipVersion="4"/>
Aug 27 02:27:04 user nova-compute[72820]:         </nova:port>
Aug 27 02:27:04 user nova-compute[72820]:         <nova:port uuid="4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6">
Aug 27 02:27:04 user nova-compute[72820]:           <nova:ip type="fixed" address="10.1.1.252" ipVersion="4"/>
Aug 27 02:27:04 user nova-compute[72820]:         </nova:port>
Aug 27 02:27:04 user nova-compute[72820]:         <nova:port uuid="966580e7-4512-4064-aa4e-c78c12545f99">
Aug 27 02:27:04 user nova-compute[72820]:           <nova:ip type="fixed" address="10.1.1.107" ipVersion="4"/>
Aug 27 02:27:04 user nova-compute[72820]:         </nova:port>
Aug 27 02:27:04 user nova-compute[72820]:         <nova:port uuid="b13d4895-4841-4176-b770-88848fc8e5e2">
Aug 27 02:27:04 user nova-compute[72820]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 27 02:27:04 user nova-compute[72820]:         </nova:port>
Aug 27 02:27:04 user nova-compute[72820]:         <nova:port uuid="14ea855b-ce40-4fa2-ab19-ea385ca9c65c">
Aug 27 02:27:04 user nova-compute[72820]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 27 02:27:04 user nova-compute[72820]:         </nova:port>
Aug 27 02:27:04 user nova-compute[72820]:       </nova:ports>
Aug 27 02:27:04 user nova-compute[72820]:     </nova:instance>
Aug 27 02:27:04 user nova-compute[72820]:   </metadata>
Aug 27 02:27:04 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:27:04 user nova-compute[72820]:     <system>
Aug 27 02:27:04 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:27:04 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:27:04 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:27:04 user nova-compute[72820]:       <entry name="serial">edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd</entry>
Aug 27 02:27:04 user nova-compute[72820]:       <entry name="uuid">edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd</entry>
Aug 27 02:27:04 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:27:04 user nova-compute[72820]:     </system>
Aug 27 02:27:04 user nova-compute[72820]:   </sysinfo>
Aug 27 02:27:04 user nova-compute[72820]:   <os>
Aug 27 02:27:04 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:27:04 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:27:04 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:27:04 user nova-compute[72820]:   </os>
Aug 27 02:27:04 user nova-compute[72820]:   <features>
Aug 27 02:27:04 user nova-compute[72820]:     <acpi/>
Aug 27 02:27:04 user nova-compute[72820]:     <apic/>
Aug 27 02:27:04 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:27:04 user nova-compute[72820]:   </features>
Aug 27 02:27:04 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:27:04 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:27:04 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:27:04 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:27:04 user nova-compute[72820]:   </clock>
Aug 27 02:27:04 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:27:04 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:27:04 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:27:04 user nova-compute[72820]:   </cpu>
Aug 27 02:27:04 user nova-compute[72820]:   <devices>
Aug 27 02:27:04 user nova-compute[72820]:     <disk type="file" device="cdrom">
Aug 27 02:27:04 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 02:27:04 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd/disk.config"/>
Aug 27 02:27:04 user nova-compute[72820]:       <target dev="hda" bus="ide"/>
Aug 27 02:27:04 user nova-compute[72820]:     </disk>
Aug 27 02:27:04 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:27:04 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:27:04 user nova-compute[72820]:       <source dev="/dev/sdc"/>
Aug 27 02:27:04 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:27:04 user nova-compute[72820]:       <serial>9232106a-0c47-4086-9e35-8d5f6d454ee5</serial>
Aug 27 02:27:04 user nova-compute[72820]:     </disk>
Aug 27 02:27:04 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:27:04 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:27:04 user nova-compute[72820]:       <source dev="/dev/sdd"/>
Aug 27 02:27:04 user nova-compute[72820]:       <target dev="vdb" bus="virtio"/>
Aug 27 02:27:04 user nova-compute[72820]:       <serial>eb336f72-5156-4865-b694-6f854b1b99eb</serial>
Aug 27 02:27:04 user nova-compute[72820]:     </disk>
Aug 27 02:27:04 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:27:04 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:27:04 user nova-compute[72820]:       <source dev="/dev/sde"/>
Aug 27 02:27:04 user nova-compute[72820]:       <target dev="vdc" bus="virtio"/>
Aug 27 02:27:04 user nova-compute[72820]:       <serial>62523bd5-843e-4f3a-95bc-3312cef1e591</serial>
Aug 27 02:27:04 user nova-compute[72820]:     </disk>
Aug 27 02:27:04 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:27:04 user nova-compute[72820]:       <mac address="fa:16:3e:27:73:18"/>
Aug 27 02:27:04 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:27:04 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:27:04 user nova-compute[72820]:       <target dev="tap82460091-ae"/>
Aug 27 02:27:04 user nova-compute[72820]:     </interface>
Aug 27 02:27:04 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:27:04 user nova-compute[72820]:       <mac address="fa:16:3e:4b:0b:e4"/>
Aug 27 02:27:04 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:27:04 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:27:04 user nova-compute[72820]:       <target dev="tap1647fafb-02"/>
Aug 27 02:27:04 user nova-compute[72820]:     </interface>
Aug 27 02:27:04 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:27:04 user nova-compute[72820]:       <mac address="fa:16:3e:ea:a2:5b"/>
Aug 27 02:27:04 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:27:04 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:27:04 user nova-compute[72820]:       <target dev="tap4c2ff677-b9"/>
Aug 27 02:27:04 user nova-compute[72820]:     </interface>
Aug 27 02:27:04 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:27:04 user nova-compute[72820]:       <mac address="fa:16:3e:21:74:13"/>
Aug 27 02:27:04 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:27:04 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:27:04 user nova-compute[72820]:       <target dev="tap4d9aa8aa-1d"/>
Aug 27 02:27:04 user nova-compute[72820]:     </interface>
Aug 27 02:27:04 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:27:04 user nova-compute[72820]:       <mac address="fa:16:3e:35:a4:3b"/>
Aug 27 02:27:04 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:27:04 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:27:04 user nova-compute[72820]:       <target dev="tap966580e7-45"/>
Aug 27 02:27:04 user nova-compute[72820]:     </interface>
Aug 27 02:27:04 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:27:04 user nova-compute[72820]:       <mac address="fa:16:3e:0e:f0:9d"/>
Aug 27 02:27:04 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:27:04 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:27:04 user nova-compute[72820]:       <target dev="tapb13d4895-48"/>
Aug 27 02:27:04 user nova-compute[72820]:     </interface>
Aug 27 02:27:04 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:27:04 user nova-compute[72820]:       <mac address="fa:16:3e:6c:bd:3e"/>
Aug 27 02:27:04 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:27:04 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:27:04 user nova-compute[72820]:       <target dev="tap14ea855b-ce"/>
Aug 27 02:27:04 user nova-compute[72820]:     </interface>
Aug 27 02:27:04 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:27:04 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd/console.log" append="off"/>
Aug 27 02:27:04 user nova-compute[72820]:     </serial>
Aug 27 02:27:04 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:27:04 user nova-compute[72820]:     <video>
Aug 27 02:27:04 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:27:04 user nova-compute[72820]:     </video>
Aug 27 02:27:04 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:27:04 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:27:04 user nova-compute[72820]:     </rng>
Aug 27 02:27:04 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:27:04 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:27:04 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:27:04 user nova-compute[72820]:     </memballoon>
Aug 27 02:27:04 user nova-compute[72820]:   </devices>
Aug 27 02:27:04 user nova-compute[72820]: </domain>
Aug 27 02:27:04 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82460091-aebf-4691-a20c-d7c0affbbba0", "address": "fa:16:3e:27:73:18", "network": {"id": "3c12368b-d5bc-4102-bff5-87b009efa11e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1403358780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82460091-ae", "ovs_interfaceid": "82460091-aebf-4691-a20c-d7c0affbbba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "82460091-aebf-4691-a20c-d7c0affbbba0", "address": "fa:16:3e:27:73:18", "network": {"id": "3c12368b-d5bc-4102-bff5-87b009efa11e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1403358780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82460091-ae", "ovs_interfaceid": "82460091-aebf-4691-a20c-d7c0affbbba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:73:18,bridge_name='br-int',has_traffic_filtering=True,id=82460091-aebf-4691-a20c-d7c0affbbba0,network=Network(3c12368b-d5bc-4102-bff5-87b009efa11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82460091-ae') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG os_vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:73:18,bridge_name='br-int',has_traffic_filtering=True,id=82460091-aebf-4691-a20c-d7c0affbbba0,network=Network(3c12368b-d5bc-4102-bff5-87b009efa11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82460091-ae') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82460091-ae, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap82460091-ae, col_values=(('external_ids', {'iface-id': '82460091-aebf-4691-a20c-d7c0affbbba0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:73:18', 'vm-uuid': 'edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: INFO os_vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:73:18,bridge_name='br-int',has_traffic_filtering=True,id=82460091-aebf-4691-a20c-d7c0affbbba0,network=Network(3c12368b-d5bc-4102-bff5-87b009efa11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82460091-ae')
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "address": "fa:16:3e:4b:0b:e4", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1647fafb-02", "ovs_interfaceid": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "address": "fa:16:3e:4b:0b:e4", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1647fafb-02", "ovs_interfaceid": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0b:e4,bridge_name='br-int',has_traffic_filtering=True,id=1647fafb-02da-4fa5-a62f-d43919dd49a6,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1647fafb-02') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG os_vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0b:e4,bridge_name='br-int',has_traffic_filtering=True,id=1647fafb-02da-4fa5-a62f-d43919dd49a6,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1647fafb-02') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1647fafb-02, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1647fafb-02, col_values=(('external_ids', {'iface-id': '1647fafb-02da-4fa5-a62f-d43919dd49a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:0b:e4', 'vm-uuid': 'edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: INFO os_vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0b:e4,bridge_name='br-int',has_traffic_filtering=True,id=1647fafb-02da-4fa5-a62f-d43919dd49a6,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1647fafb-02')
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "address": "fa:16:3e:ea:a2:5b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2ff677-b9", "ovs_interfaceid": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "address": "fa:16:3e:ea:a2:5b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2ff677-b9", "ovs_interfaceid": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a2:5b,bridge_name='br-int',has_traffic_filtering=True,id=4c2ff677-b994-41bc-94e5-e542ad18fb4e,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c2ff677-b9') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG os_vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a2:5b,bridge_name='br-int',has_traffic_filtering=True,id=4c2ff677-b994-41bc-94e5-e542ad18fb4e,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c2ff677-b9') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c2ff677-b9, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c2ff677-b9, col_values=(('external_ids', {'iface-id': '4c2ff677-b994-41bc-94e5-e542ad18fb4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:a2:5b', 'vm-uuid': 'edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: INFO os_vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a2:5b,bridge_name='br-int',has_traffic_filtering=True,id=4c2ff677-b994-41bc-94e5-e542ad18fb4e,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c2ff677-b9')
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "address": "fa:16:3e:21:74:13", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9aa8aa-1d", "ovs_interfaceid": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "address": "fa:16:3e:21:74:13", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9aa8aa-1d", "ovs_interfaceid": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:74:13,bridge_name='br-int',has_traffic_filtering=True,id=4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9aa8aa-1d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG os_vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:74:13,bridge_name='br-int',has_traffic_filtering=True,id=4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9aa8aa-1d') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d9aa8aa-1d, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d9aa8aa-1d, col_values=(('external_ids', {'iface-id': '4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:74:13', 'vm-uuid': 'edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.compute.manager [req-99cc088d-aa80-439a-ba1a-10630c72c25f req-027047b6-9639-4073-8396-8a9be18eceb5 service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Received event network-vif-plugged-d901c17c-746e-41ac-8066-cb1d4c4b0d69 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-99cc088d-aa80-439a-ba1a-10630c72c25f req-027047b6-9639-4073-8396-8a9be18eceb5 service nova] Acquiring lock "7c42c4ae-0f80-4295-a64e-b426225b94c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-99cc088d-aa80-439a-ba1a-10630c72c25f req-027047b6-9639-4073-8396-8a9be18eceb5 service nova] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-99cc088d-aa80-439a-ba1a-10630c72c25f req-027047b6-9639-4073-8396-8a9be18eceb5 service nova] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.compute.manager [req-99cc088d-aa80-439a-ba1a-10630c72c25f req-027047b6-9639-4073-8396-8a9be18eceb5 service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] No waiting events found dispatching network-vif-plugged-d901c17c-746e-41ac-8066-cb1d4c4b0d69 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:04 user nova-compute[72820]: WARNING nova.compute.manager [req-99cc088d-aa80-439a-ba1a-10630c72c25f req-027047b6-9639-4073-8396-8a9be18eceb5 service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Received unexpected event network-vif-plugged-d901c17c-746e-41ac-8066-cb1d4c4b0d69 for instance with vm_state building and task_state spawning.
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: INFO os_vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:74:13,bridge_name='br-int',has_traffic_filtering=True,id=4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9aa8aa-1d')
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "966580e7-4512-4064-aa4e-c78c12545f99", "address": "fa:16:3e:35:a4:3b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966580e7-45", "ovs_interfaceid": "966580e7-4512-4064-aa4e-c78c12545f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "966580e7-4512-4064-aa4e-c78c12545f99", "address": "fa:16:3e:35:a4:3b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966580e7-45", "ovs_interfaceid": "966580e7-4512-4064-aa4e-c78c12545f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:a4:3b,bridge_name='br-int',has_traffic_filtering=True,id=966580e7-4512-4064-aa4e-c78c12545f99,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap966580e7-45') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG os_vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:a4:3b,bridge_name='br-int',has_traffic_filtering=True,id=966580e7-4512-4064-aa4e-c78c12545f99,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap966580e7-45') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap966580e7-45, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap966580e7-45, col_values=(('external_ids', {'iface-id': '966580e7-4512-4064-aa4e-c78c12545f99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:a4:3b', 'vm-uuid': 'edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: INFO os_vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:a4:3b,bridge_name='br-int',has_traffic_filtering=True,id=966580e7-4512-4064-aa4e-c78c12545f99,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap966580e7-45')
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b13d4895-4841-4176-b770-88848fc8e5e2", "address": "fa:16:3e:0e:f0:9d", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13d4895-48", "ovs_interfaceid": "b13d4895-4841-4176-b770-88848fc8e5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "b13d4895-4841-4176-b770-88848fc8e5e2", "address": "fa:16:3e:0e:f0:9d", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13d4895-48", "ovs_interfaceid": "b13d4895-4841-4176-b770-88848fc8e5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:f0:9d,bridge_name='br-int',has_traffic_filtering=True,id=b13d4895-4841-4176-b770-88848fc8e5e2,network=Network(506f9029-7bbf-43f7-af98-765cea3d8473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13d4895-48') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG os_vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:f0:9d,bridge_name='br-int',has_traffic_filtering=True,id=b13d4895-4841-4176-b770-88848fc8e5e2,network=Network(506f9029-7bbf-43f7-af98-765cea3d8473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13d4895-48') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb13d4895-48, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb13d4895-48, col_values=(('external_ids', {'iface-id': 'b13d4895-4841-4176-b770-88848fc8e5e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:f0:9d', 'vm-uuid': 'edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: INFO os_vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:f0:9d,bridge_name='br-int',has_traffic_filtering=True,id=b13d4895-4841-4176-b770-88848fc8e5e2,network=Network(506f9029-7bbf-43f7-af98-765cea3d8473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13d4895-48')
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "address": "fa:16:3e:6c:bd:3e", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ea855b-ce", "ovs_interfaceid": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "address": "fa:16:3e:6c:bd:3e", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ea855b-ce", "ovs_interfaceid": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:bd:3e,bridge_name='br-int',has_traffic_filtering=True,id=14ea855b-ce40-4fa2-ab19-ea385ca9c65c,network=Network(506f9029-7bbf-43f7-af98-765cea3d8473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ea855b-ce') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG os_vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:bd:3e,bridge_name='br-int',has_traffic_filtering=True,id=14ea855b-ce40-4fa2-ab19-ea385ca9c65c,network=Network(506f9029-7bbf-43f7-af98-765cea3d8473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ea855b-ce') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14ea855b-ce, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap14ea855b-ce, col_values=(('external_ids', {'iface-id': '14ea855b-ce40-4fa2-ab19-ea385ca9c65c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:bd:3e', 'vm-uuid': 'edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:27:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:05 user nova-compute[72820]: INFO os_vif [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:bd:3e,bridge_name='br-int',has_traffic_filtering=True,id=14ea855b-ce40-4fa2-ab19-ea385ca9c65c,network=Network(506f9029-7bbf-43f7-af98-765cea3d8473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ea855b-ce')
Aug 27 02:27:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] No BDM found with device name hda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:27:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:27:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] No VIF found with MAC fa:16:3e:27:73:18, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:27:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] No VIF found with MAC fa:16:3e:35:a4:3b, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:27:05 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Using config drive
Aug 27 02:27:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:05 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:27:05 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:27:05 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:27:05 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:27:05 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Creating config drive at /opt/stack/data/nova/instances/edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd/disk.config
Aug 27 02:27:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpig_q8ue4 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpig_q8ue4" returned: 0 in 0.076s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:06 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:27:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:06 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:27:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-e302e779-139b-4068-aa14-478ff1e5e405 req-9e1ae074-b53f-4ca1-b0f2-6aa08bfdb763 service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Received event network-vif-plugged-d901c17c-746e-41ac-8066-cb1d4c4b0d69 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e302e779-139b-4068-aa14-478ff1e5e405 req-9e1ae074-b53f-4ca1-b0f2-6aa08bfdb763 service nova] Acquiring lock "7c42c4ae-0f80-4295-a64e-b426225b94c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e302e779-139b-4068-aa14-478ff1e5e405 req-9e1ae074-b53f-4ca1-b0f2-6aa08bfdb763 service nova] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e302e779-139b-4068-aa14-478ff1e5e405 req-9e1ae074-b53f-4ca1-b0f2-6aa08bfdb763 service nova] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-e302e779-139b-4068-aa14-478ff1e5e405 req-9e1ae074-b53f-4ca1-b0f2-6aa08bfdb763 service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] No waiting events found dispatching network-vif-plugged-d901c17c-746e-41ac-8066-cb1d4c4b0d69 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:06 user nova-compute[72820]: WARNING nova.compute.manager [req-e302e779-139b-4068-aa14-478ff1e5e405 req-9e1ae074-b53f-4ca1-b0f2-6aa08bfdb763 service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Received unexpected event network-vif-plugged-d901c17c-746e-41ac-8066-cb1d4c4b0d69 for instance with vm_state building and task_state spawning.
Aug 27 02:27:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:07 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103227.3279548, 7c42c4ae-0f80-4295-a64e-b426225b94c5 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:27:07 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] VM Resumed (Lifecycle Event)
Aug 27 02:27:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:27:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:27:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:27:07 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Instance spawned successfully.
Aug 27 02:27:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:27:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:27:07 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:27:07 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103227.335211, 7c42c4ae-0f80-4295-a64e-b426225b94c5 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:27:07 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] VM Started (Lifecycle Event)
Aug 27 02:27:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:27:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:27:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:07 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:27:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:07 user nova-compute[72820]: INFO nova.compute.manager [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Took 9.76 seconds to spawn the instance on the hypervisor.
Aug 27 02:27:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:27:07 user nova-compute[72820]: INFO nova.compute.manager [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Took 11.07 seconds to build instance.
Aug 27 02:27:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afb30814-d84d-43e0-965f-432cd5b9aed5 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.248s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-42ff443a-cd76-4d14-beff-c9c705b34696 req-80620830-1bd2-48b6-9ffd-add8bc404568 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-1647fafb-02da-4fa5-a62f-d43919dd49a6 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-42ff443a-cd76-4d14-beff-c9c705b34696 req-80620830-1bd2-48b6-9ffd-add8bc404568 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-42ff443a-cd76-4d14-beff-c9c705b34696 req-80620830-1bd2-48b6-9ffd-add8bc404568 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-42ff443a-cd76-4d14-beff-c9c705b34696 req-80620830-1bd2-48b6-9ffd-add8bc404568 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-42ff443a-cd76-4d14-beff-c9c705b34696 req-80620830-1bd2-48b6-9ffd-add8bc404568 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-1647fafb-02da-4fa5-a62f-d43919dd49a6 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:08 user nova-compute[72820]: WARNING nova.compute.manager [req-42ff443a-cd76-4d14-beff-c9c705b34696 req-80620830-1bd2-48b6-9ffd-add8bc404568 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-1647fafb-02da-4fa5-a62f-d43919dd49a6 for instance with vm_state building and task_state spawning.
Aug 27 02:27:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-76eda4cd-5e27-48a8-8d7d-22bb910a8d94 req-042e5b78-a530-49c9-a705-65a88d965465 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-82460091-aebf-4691-a20c-d7c0affbbba0 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-76eda4cd-5e27-48a8-8d7d-22bb910a8d94 req-042e5b78-a530-49c9-a705-65a88d965465 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-76eda4cd-5e27-48a8-8d7d-22bb910a8d94 req-042e5b78-a530-49c9-a705-65a88d965465 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-76eda4cd-5e27-48a8-8d7d-22bb910a8d94 req-042e5b78-a530-49c9-a705-65a88d965465 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-76eda4cd-5e27-48a8-8d7d-22bb910a8d94 req-042e5b78-a530-49c9-a705-65a88d965465 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-82460091-aebf-4691-a20c-d7c0affbbba0 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:08 user nova-compute[72820]: WARNING nova.compute.manager [req-76eda4cd-5e27-48a8-8d7d-22bb910a8d94 req-042e5b78-a530-49c9-a705-65a88d965465 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-82460091-aebf-4691-a20c-d7c0affbbba0 for instance with vm_state building and task_state spawning.
Aug 27 02:27:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-76eda4cd-5e27-48a8-8d7d-22bb910a8d94 req-042e5b78-a530-49c9-a705-65a88d965465 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-82460091-aebf-4691-a20c-d7c0affbbba0 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-76eda4cd-5e27-48a8-8d7d-22bb910a8d94 req-042e5b78-a530-49c9-a705-65a88d965465 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-76eda4cd-5e27-48a8-8d7d-22bb910a8d94 req-042e5b78-a530-49c9-a705-65a88d965465 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-76eda4cd-5e27-48a8-8d7d-22bb910a8d94 req-042e5b78-a530-49c9-a705-65a88d965465 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-76eda4cd-5e27-48a8-8d7d-22bb910a8d94 req-042e5b78-a530-49c9-a705-65a88d965465 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-82460091-aebf-4691-a20c-d7c0affbbba0 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:08 user nova-compute[72820]: WARNING nova.compute.manager [req-76eda4cd-5e27-48a8-8d7d-22bb910a8d94 req-042e5b78-a530-49c9-a705-65a88d965465 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-82460091-aebf-4691-a20c-d7c0affbbba0 for instance with vm_state building and task_state spawning.
Aug 27 02:27:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-1647fafb-02da-4fa5-a62f-d43919dd49a6 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-1647fafb-02da-4fa5-a62f-d43919dd49a6 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:10 user nova-compute[72820]: WARNING nova.compute.manager [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-1647fafb-02da-4fa5-a62f-d43919dd49a6 for instance with vm_state building and task_state spawning.
Aug 27 02:27:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-4c2ff677-b994-41bc-94e5-e542ad18fb4e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-4c2ff677-b994-41bc-94e5-e542ad18fb4e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:10 user nova-compute[72820]: WARNING nova.compute.manager [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-4c2ff677-b994-41bc-94e5-e542ad18fb4e for instance with vm_state building and task_state spawning.
Aug 27 02:27:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-4c2ff677-b994-41bc-94e5-e542ad18fb4e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-4c2ff677-b994-41bc-94e5-e542ad18fb4e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:10 user nova-compute[72820]: WARNING nova.compute.manager [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-4c2ff677-b994-41bc-94e5-e542ad18fb4e for instance with vm_state building and task_state spawning.
Aug 27 02:27:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-966580e7-4512-4064-aa4e-c78c12545f99 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-966580e7-4512-4064-aa4e-c78c12545f99 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:10 user nova-compute[72820]: WARNING nova.compute.manager [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-966580e7-4512-4064-aa4e-c78c12545f99 for instance with vm_state building and task_state spawning.
Aug 27 02:27:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-966580e7-4512-4064-aa4e-c78c12545f99 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-966580e7-4512-4064-aa4e-c78c12545f99 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:10 user nova-compute[72820]: WARNING nova.compute.manager [req-505f37b7-d18b-4db4-8270-d0902d5828db req-ed580b39-3a82-4e0e-a2db-466d612f6e43 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-966580e7-4512-4064-aa4e-c78c12545f99 for instance with vm_state building and task_state spawning.
Aug 27 02:27:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-9c933131-00fe-4e02-bf77-d18e461c0da3 req-39b5cd88-cab5-4d93-9c05-4a2a6f5a6fd8 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-b13d4895-4841-4176-b770-88848fc8e5e2 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9c933131-00fe-4e02-bf77-d18e461c0da3 req-39b5cd88-cab5-4d93-9c05-4a2a6f5a6fd8 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9c933131-00fe-4e02-bf77-d18e461c0da3 req-39b5cd88-cab5-4d93-9c05-4a2a6f5a6fd8 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9c933131-00fe-4e02-bf77-d18e461c0da3 req-39b5cd88-cab5-4d93-9c05-4a2a6f5a6fd8 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-9c933131-00fe-4e02-bf77-d18e461c0da3 req-39b5cd88-cab5-4d93-9c05-4a2a6f5a6fd8 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-b13d4895-4841-4176-b770-88848fc8e5e2 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:10 user nova-compute[72820]: WARNING nova.compute.manager [req-9c933131-00fe-4e02-bf77-d18e461c0da3 req-39b5cd88-cab5-4d93-9c05-4a2a6f5a6fd8 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-b13d4895-4841-4176-b770-88848fc8e5e2 for instance with vm_state building and task_state spawning.
Aug 27 02:27:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-9c933131-00fe-4e02-bf77-d18e461c0da3 req-39b5cd88-cab5-4d93-9c05-4a2a6f5a6fd8 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-b13d4895-4841-4176-b770-88848fc8e5e2 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9c933131-00fe-4e02-bf77-d18e461c0da3 req-39b5cd88-cab5-4d93-9c05-4a2a6f5a6fd8 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9c933131-00fe-4e02-bf77-d18e461c0da3 req-39b5cd88-cab5-4d93-9c05-4a2a6f5a6fd8 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9c933131-00fe-4e02-bf77-d18e461c0da3 req-39b5cd88-cab5-4d93-9c05-4a2a6f5a6fd8 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-9c933131-00fe-4e02-bf77-d18e461c0da3 req-39b5cd88-cab5-4d93-9c05-4a2a6f5a6fd8 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-b13d4895-4841-4176-b770-88848fc8e5e2 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:10 user nova-compute[72820]: WARNING nova.compute.manager [req-9c933131-00fe-4e02-bf77-d18e461c0da3 req-39b5cd88-cab5-4d93-9c05-4a2a6f5a6fd8 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-b13d4895-4841-4176-b770-88848fc8e5e2 for instance with vm_state building and task_state spawning.
Aug 27 02:27:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:27:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:27:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:27:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:12 user nova-compute[72820]: DEBUG nova.compute.manager [req-fa189ab2-2b06-45e3-9ed3-241302d2805d req-13e65652-dcb4-49d1-9a9a-9e11d5fef716 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fa189ab2-2b06-45e3-9ed3-241302d2805d req-13e65652-dcb4-49d1-9a9a-9e11d5fef716 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fa189ab2-2b06-45e3-9ed3-241302d2805d req-13e65652-dcb4-49d1-9a9a-9e11d5fef716 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fa189ab2-2b06-45e3-9ed3-241302d2805d req-13e65652-dcb4-49d1-9a9a-9e11d5fef716 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:12 user nova-compute[72820]: DEBUG nova.compute.manager [req-fa189ab2-2b06-45e3-9ed3-241302d2805d req-13e65652-dcb4-49d1-9a9a-9e11d5fef716 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:12 user nova-compute[72820]: WARNING nova.compute.manager [req-fa189ab2-2b06-45e3-9ed3-241302d2805d req-13e65652-dcb4-49d1-9a9a-9e11d5fef716 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6 for instance with vm_state building and task_state spawning.
Aug 27 02:27:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103232.9960327, edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:27:13 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] VM Resumed (Lifecycle Event)
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:13 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Instance spawned successfully.
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:27:13 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103232.9961765, edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:27:13 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] VM Started (Lifecycle Event)
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:27:13 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:27:13 user nova-compute[72820]: INFO nova.compute.manager [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Took 13.89 seconds to spawn the instance on the hypervisor.
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.387s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:13 user nova-compute[72820]: INFO nova.compute.manager [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Took 61.09 seconds to build instance.
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c188f4f0-2416-427a-8c09-c643cf289e38 tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 61.417s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 36.454s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:13 user nova-compute[72820]: INFO nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:27:13 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Creating image(s)
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Did not create local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Ensure instance console log exists: /opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Start _get_guest_xml network_info=[{"id": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "address": "fa:16:3e:05:00:70", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb04bdd2-29", "ovs_interfaceid": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '26690c69-6db5-48db-9c11-665f8fcddd4c', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozvteOKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1591319d-3d15-4c46-b823-4edddf018b5f', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa627586-2d95-40aa-b153-081b588b0851', 'serial': 'fa627586-2d95-40aa-b153-081b588b0851'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:27:13 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:27:13 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozvteOKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:27:13 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:27:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:27:13 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:27:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:27:13 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7325b2d2-2868-45cd-a904-dab1b937150c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:27:13 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bda8595-d5eb-4745-b0a0-9f0be00f8ca9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851] added
Aug 27 02:27:13 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c9d7a3-db49-44ae-ac77-b1d06dd3fb6d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f539842a-7cb7-4a56-80c9-52104a0bee5f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ozvteOKM {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ozvteOKM" returned: 0 in 0.032s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3779cd94-44a8-43b9-8465-0e948f615505]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ozvteOKM'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cef2e4-3709-4f6e-bbaf-afe60f6f3873]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6bac3c-623c-41da-b1bc-000cc0cf3cb1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:27:14 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:27:14 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:27:14 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:27:14 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:27:14 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:27:14 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:27:14 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:27:14 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19bea84-e098-4073-bb1e-ba1d499aa8f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851, portal: 172.16.0.220,3260]
Aug 27 02:27:14 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851, portal: 172.16.0.220,3260] successful.
Aug 27 02:27:14 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16d5ab3-a8fc-411b-81d0-a28743652b1d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa23e88-9b2b-4f0c-82a9-708cfd5724d3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:27:14 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:27:14 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:27:14 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:27:14 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:27:14 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:27:14 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:27:14 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:27:14 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:27:14 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:27:14 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.492s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[097a9ebf-c7df-4141-87dc-fd6259d799a2]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozvteOKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-ee8d82c2-1810-428b-b8c5-87cf876392f6 req-e1eec7f4-e529-4b62-8502-6d3cc6d0cae5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ee8d82c2-1810-428b-b8c5-87cf876392f6 req-e1eec7f4-e529-4b62-8502-6d3cc6d0cae5 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ee8d82c2-1810-428b-b8c5-87cf876392f6 req-e1eec7f4-e529-4b62-8502-6d3cc6d0cae5 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ee8d82c2-1810-428b-b8c5-87cf876392f6 req-e1eec7f4-e529-4b62-8502-6d3cc6d0cae5 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-ee8d82c2-1810-428b-b8c5-87cf876392f6 req-e1eec7f4-e529-4b62-8502-6d3cc6d0cae5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:14 user nova-compute[72820]: WARNING nova.compute.manager [req-ee8d82c2-1810-428b-b8c5-87cf876392f6 req-e1eec7f4-e529-4b62-8502-6d3cc6d0cae5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6 for instance with vm_state active and task_state None.
Aug 27 02:27:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-ee8d82c2-1810-428b-b8c5-87cf876392f6 req-e1eec7f4-e529-4b62-8502-6d3cc6d0cae5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-14ea855b-ce40-4fa2-ab19-ea385ca9c65c {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ee8d82c2-1810-428b-b8c5-87cf876392f6 req-e1eec7f4-e529-4b62-8502-6d3cc6d0cae5 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ee8d82c2-1810-428b-b8c5-87cf876392f6 req-e1eec7f4-e529-4b62-8502-6d3cc6d0cae5 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ee8d82c2-1810-428b-b8c5-87cf876392f6 req-e1eec7f4-e529-4b62-8502-6d3cc6d0cae5 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-ee8d82c2-1810-428b-b8c5-87cf876392f6 req-e1eec7f4-e529-4b62-8502-6d3cc6d0cae5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-14ea855b-ce40-4fa2-ab19-ea385ca9c65c {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:14 user nova-compute[72820]: WARNING nova.compute.manager [req-ee8d82c2-1810-428b-b8c5-87cf876392f6 req-e1eec7f4-e529-4b62-8502-6d3cc6d0cae5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-14ea855b-ce40-4fa2-ab19-ea385ca9c65c for instance with vm_state active and task_state None.
Aug 27 02:27:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-ee8d82c2-1810-428b-b8c5-87cf876392f6 req-e1eec7f4-e529-4b62-8502-6d3cc6d0cae5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-14ea855b-ce40-4fa2-ab19-ea385ca9c65c {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ee8d82c2-1810-428b-b8c5-87cf876392f6 req-e1eec7f4-e529-4b62-8502-6d3cc6d0cae5 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ee8d82c2-1810-428b-b8c5-87cf876392f6 req-e1eec7f4-e529-4b62-8502-6d3cc6d0cae5 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ee8d82c2-1810-428b-b8c5-87cf876392f6 req-e1eec7f4-e529-4b62-8502-6d3cc6d0cae5 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-ee8d82c2-1810-428b-b8c5-87cf876392f6 req-e1eec7f4-e529-4b62-8502-6d3cc6d0cae5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-14ea855b-ce40-4fa2-ab19-ea385ca9c65c {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:14 user nova-compute[72820]: WARNING nova.compute.manager [req-ee8d82c2-1810-428b-b8c5-87cf876392f6 req-e1eec7f4-e529-4b62-8502-6d3cc6d0cae5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-14ea855b-ce40-4fa2-ab19-ea385ca9c65c for instance with vm_state active and task_state None.
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.545s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] <== connect_volume: return (1547ms) {'type': 'block', 'scsi_wwn': '26661636461393865', 'path': '/dev/sdf'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661636461393865', 'path': '/dev/sdf'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:26:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-485924818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-485924818',id=17,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f023daf1767f4088bf0a23524587e662',ramdisk_id='',reservation_id='r-pt18thix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:50Z,user_data=None,user_id='bb67e11ecdd648a89dd58b4bf416060a',uuid=1591319d-3d15-4c46-b823-4edddf018b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "address": "fa:16:3e:05:00:70", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb04bdd2-29", "ovs_interfaceid": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converting VIF {"id": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "address": "fa:16:3e:05:00:70", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb04bdd2-29", "ovs_interfaceid": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:00:70,bridge_name='br-int',has_traffic_filtering=True,id=db04bdd2-29ba-41ba-a78f-ab10b81ae54e,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb04bdd2-29') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG nova.objects.instance [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'pci_devices' on Instance uuid 1591319d-3d15-4c46-b823-4edddf018b5f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:27:15 user nova-compute[72820]:   <uuid>1591319d-3d15-4c46-b823-4edddf018b5f</uuid>
Aug 27 02:27:15 user nova-compute[72820]:   <name>instance-00000011</name>
Aug 27 02:27:15 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:27:15 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:27:15 user nova-compute[72820]:   <metadata>
Aug 27 02:27:15 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:27:15 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:27:15 user nova-compute[72820]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-485924818</nova:name>
Aug 27 02:27:15 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:27:13</nova:creationTime>
Aug 27 02:27:15 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:27:15 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:27:15 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:27:15 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:27:15 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:27:15 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:27:15 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:27:15 user nova-compute[72820]:       <nova:owner>
Aug 27 02:27:15 user nova-compute[72820]:         <nova:user uuid="bb67e11ecdd648a89dd58b4bf416060a">tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member</nova:user>
Aug 27 02:27:15 user nova-compute[72820]:         <nova:project uuid="f023daf1767f4088bf0a23524587e662">tempest-ServerBootFromVolumeStableRescueTest-2088708325</nova:project>
Aug 27 02:27:15 user nova-compute[72820]:       </nova:owner>
Aug 27 02:27:15 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:27:15 user nova-compute[72820]:       <nova:ports>
Aug 27 02:27:15 user nova-compute[72820]:         <nova:port uuid="db04bdd2-29ba-41ba-a78f-ab10b81ae54e">
Aug 27 02:27:15 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 02:27:15 user nova-compute[72820]:         </nova:port>
Aug 27 02:27:15 user nova-compute[72820]:       </nova:ports>
Aug 27 02:27:15 user nova-compute[72820]:     </nova:instance>
Aug 27 02:27:15 user nova-compute[72820]:   </metadata>
Aug 27 02:27:15 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:27:15 user nova-compute[72820]:     <system>
Aug 27 02:27:15 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:27:15 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:27:15 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:27:15 user nova-compute[72820]:       <entry name="serial">1591319d-3d15-4c46-b823-4edddf018b5f</entry>
Aug 27 02:27:15 user nova-compute[72820]:       <entry name="uuid">1591319d-3d15-4c46-b823-4edddf018b5f</entry>
Aug 27 02:27:15 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:27:15 user nova-compute[72820]:     </system>
Aug 27 02:27:15 user nova-compute[72820]:   </sysinfo>
Aug 27 02:27:15 user nova-compute[72820]:   <os>
Aug 27 02:27:15 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:27:15 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:27:15 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:27:15 user nova-compute[72820]:   </os>
Aug 27 02:27:15 user nova-compute[72820]:   <features>
Aug 27 02:27:15 user nova-compute[72820]:     <acpi/>
Aug 27 02:27:15 user nova-compute[72820]:     <apic/>
Aug 27 02:27:15 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:27:15 user nova-compute[72820]:   </features>
Aug 27 02:27:15 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:27:15 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:27:15 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:27:15 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:27:15 user nova-compute[72820]:   </clock>
Aug 27 02:27:15 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:27:15 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:27:15 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:27:15 user nova-compute[72820]:   </cpu>
Aug 27 02:27:15 user nova-compute[72820]:   <devices>
Aug 27 02:27:15 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:27:15 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:27:15 user nova-compute[72820]:       <source dev="/dev/sdf"/>
Aug 27 02:27:15 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:27:15 user nova-compute[72820]:       <serial>fa627586-2d95-40aa-b153-081b588b0851</serial>
Aug 27 02:27:15 user nova-compute[72820]:     </disk>
Aug 27 02:27:15 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:27:15 user nova-compute[72820]:       <mac address="fa:16:3e:05:00:70"/>
Aug 27 02:27:15 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:27:15 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:27:15 user nova-compute[72820]:       <target dev="tapdb04bdd2-29"/>
Aug 27 02:27:15 user nova-compute[72820]:     </interface>
Aug 27 02:27:15 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:27:15 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f/console.log" append="off"/>
Aug 27 02:27:15 user nova-compute[72820]:     </serial>
Aug 27 02:27:15 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:27:15 user nova-compute[72820]:     <video>
Aug 27 02:27:15 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:27:15 user nova-compute[72820]:     </video>
Aug 27 02:27:15 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:27:15 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:27:15 user nova-compute[72820]:     </rng>
Aug 27 02:27:15 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:27:15 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:27:15 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:27:15 user nova-compute[72820]:     </memballoon>
Aug 27 02:27:15 user nova-compute[72820]:   </devices>
Aug 27 02:27:15 user nova-compute[72820]: </domain>
Aug 27 02:27:15 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:26:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-485924818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-485924818',id=17,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f023daf1767f4088bf0a23524587e662',ramdisk_id='',reservation_id='r-pt18thix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:26:50Z,user_data=None,user_id='bb67e11ecdd648a89dd58b4bf416060a',uuid=1591319d-3d15-4c46-b823-4edddf018b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "address": "fa:16:3e:05:00:70", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb04bdd2-29", "ovs_interfaceid": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converting VIF {"id": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "address": "fa:16:3e:05:00:70", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb04bdd2-29", "ovs_interfaceid": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:00:70,bridge_name='br-int',has_traffic_filtering=True,id=db04bdd2-29ba-41ba-a78f-ab10b81ae54e,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb04bdd2-29') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG os_vif [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:00:70,bridge_name='br-int',has_traffic_filtering=True,id=db04bdd2-29ba-41ba-a78f-ab10b81ae54e,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb04bdd2-29') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb04bdd2-29, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb04bdd2-29, col_values=(('external_ids', {'iface-id': 'db04bdd2-29ba-41ba-a78f-ab10b81ae54e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:00:70', 'vm-uuid': '1591319d-3d15-4c46-b823-4edddf018b5f'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:15 user nova-compute[72820]: INFO os_vif [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:00:70,bridge_name='br-int',has_traffic_filtering=True,id=db04bdd2-29ba-41ba-a78f-ab10b81ae54e,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb04bdd2-29')
Aug 27 02:27:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] No VIF found with MAC fa:16:3e:05:00:70, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103239.5579016, 1591319d-3d15-4c46-b823-4edddf018b5f => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:27:20 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] VM Resumed (Lifecycle Event)
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.manager [req-57c78e22-0296-4f22-9553-7dd812535665 req-91ccc306-c1de-4121-ab34-7e78310fbe18 service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-57c78e22-0296-4f22-9553-7dd812535665 req-91ccc306-c1de-4121-ab34-7e78310fbe18 service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-57c78e22-0296-4f22-9553-7dd812535665 req-91ccc306-c1de-4121-ab34-7e78310fbe18 service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-57c78e22-0296-4f22-9553-7dd812535665 req-91ccc306-c1de-4121-ab34-7e78310fbe18 service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.manager [req-57c78e22-0296-4f22-9553-7dd812535665 req-91ccc306-c1de-4121-ab34-7e78310fbe18 service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:20 user nova-compute[72820]: WARNING nova.compute.manager [req-57c78e22-0296-4f22-9553-7dd812535665 req-91ccc306-c1de-4121-ab34-7e78310fbe18 service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received unexpected event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with vm_state building and task_state spawning.
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.manager [req-7b159ff7-4119-45bb-b6d6-6f08f5c0cd20 req-d9cb0c13-548a-4723-b6e0-d7cbb3b883cf service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7b159ff7-4119-45bb-b6d6-6f08f5c0cd20 req-d9cb0c13-548a-4723-b6e0-d7cbb3b883cf service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7b159ff7-4119-45bb-b6d6-6f08f5c0cd20 req-d9cb0c13-548a-4723-b6e0-d7cbb3b883cf service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7b159ff7-4119-45bb-b6d6-6f08f5c0cd20 req-d9cb0c13-548a-4723-b6e0-d7cbb3b883cf service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.manager [req-7b159ff7-4119-45bb-b6d6-6f08f5c0cd20 req-d9cb0c13-548a-4723-b6e0-d7cbb3b883cf service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:20 user nova-compute[72820]: WARNING nova.compute.manager [req-7b159ff7-4119-45bb-b6d6-6f08f5c0cd20 req-d9cb0c13-548a-4723-b6e0-d7cbb3b883cf service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received unexpected event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with vm_state building and task_state spawning.
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.manager [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:27:20 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Instance spawned successfully.
Aug 27 02:27:20 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:27:20 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7342MB free_disk=25.293502807617188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:20 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103239.5584736, 1591319d-3d15-4c46-b823-4edddf018b5f => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:27:20 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] VM Started (Lifecycle Event)
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:27:20 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 26581695-c4b9-40b8-ab7a-34c99db0dadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f8f612f3-41c9-4dae-8d49-218d61720b15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6ed3c12e-96a8-4a32-8089-f04eba608663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f37dfe42-3b22-4111-b10d-9459c8c42b2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 050e0c2b-9244-4987-b07d-e4712e46f936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance ac2f6797-8b7c-47d3-836d-fc1c617e23dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1591319d-3d15-4c46-b823-4edddf018b5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 7c42c4ae-0f80-4295-a64e-b426225b94c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:27:20 user nova-compute[72820]: INFO nova.compute.manager [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Took 6.62 seconds to spawn the instance on the hypervisor.
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.manager [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:27:20 user nova-compute[72820]: INFO nova.compute.manager [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Took 31.59 seconds to build instance.
Aug 27 02:27:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-81415d9d-f8b7-4902-bda4-09a925d37367 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "1591319d-3d15-4c46-b823-4edddf018b5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.728s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:27:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:22 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:27:22 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:27:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:27:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 02:27:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:27:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:27:23 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:27:23 user nova-compute[72820]: DEBUG nova.objects.instance [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lazy-loading 'info_cache' on Instance uuid 26581695-c4b9-40b8-ab7a-34c99db0dadb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:27:23 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Updating instance_info_cache with network_info: [{"id": "4a579280-0dce-49fb-861a-4577ba1d70a3", "address": "fa:16:3e:37:4e:12", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a579280-0d", "ovs_interfaceid": "4a579280-0dce-49fb-861a-4577ba1d70a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:27:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:27:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:27:23 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:27:23 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:27:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "63c67f6e-849b-404a-bd38-524604cae3d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "63c67f6e-849b-404a-bd38-524604cae3d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:29 user nova-compute[72820]: DEBUG nova.compute.manager [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:27:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:29 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:27:29 user nova-compute[72820]: INFO nova.compute.claims [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Claim successful on node user
Aug 27 02:27:30 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:27:30 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:27:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.717s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:30 user nova-compute[72820]: DEBUG nova.compute.manager [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:27:30 user nova-compute[72820]: DEBUG nova.compute.manager [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:27:30 user nova-compute[72820]: DEBUG nova.network.neutron [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:27:30 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:27:30 user nova-compute[72820]: DEBUG nova.compute.manager [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:27:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:30 user nova-compute[72820]: DEBUG nova.compute.manager [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:27:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:27:30 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Creating image(s)
Aug 27 02:27:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "/opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "/opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "/opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:30 user nova-compute[72820]: DEBUG nova.policy [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e58dd305ae442ca84ae955894e7a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4abfae6cab24fef92f96422628dc7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:27:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.190s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.198s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk 1073741824" returned: 0 in 0.055s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.197s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Cannot resize image /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Ensure instance console log exists: /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG nova.network.neutron [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Successfully created port: e13b95dc-bcba-4615-954c-61bc3cb2451f {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-2b6d3c4c-0c35-47b6-9dc3-fae051f0d39b req-92c4ee45-a11c-4151-b957-e65340ce42d7 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received event network-changed-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-2b6d3c4c-0c35-47b6-9dc3-fae051f0d39b req-92c4ee45-a11c-4151-b957-e65340ce42d7 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Refreshing instance network info cache due to event network-changed-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2b6d3c4c-0c35-47b6-9dc3-fae051f0d39b req-92c4ee45-a11c-4151-b957-e65340ce42d7 service nova] Acquiring lock "refresh_cache-050e0c2b-9244-4987-b07d-e4712e46f936" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2b6d3c4c-0c35-47b6-9dc3-fae051f0d39b req-92c4ee45-a11c-4151-b957-e65340ce42d7 service nova] Acquired lock "refresh_cache-050e0c2b-9244-4987-b07d-e4712e46f936" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:27:31 user nova-compute[72820]: DEBUG nova.network.neutron [req-2b6d3c4c-0c35-47b6-9dc3-fae051f0d39b req-92c4ee45-a11c-4151-b957-e65340ce42d7 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Refreshing network info cache for port a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:27:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:32 user nova-compute[72820]: DEBUG nova.network.neutron [req-2b6d3c4c-0c35-47b6-9dc3-fae051f0d39b req-92c4ee45-a11c-4151-b957-e65340ce42d7 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Updated VIF entry in instance network info cache for port a6c019c8-6c53-44fd-a6f0-004d2f9b5a55. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:27:32 user nova-compute[72820]: DEBUG nova.network.neutron [req-2b6d3c4c-0c35-47b6-9dc3-fae051f0d39b req-92c4ee45-a11c-4151-b957-e65340ce42d7 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Updating instance_info_cache with network_info: [{"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:27:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2b6d3c4c-0c35-47b6-9dc3-fae051f0d39b req-92c4ee45-a11c-4151-b957-e65340ce42d7 service nova] Releasing lock "refresh_cache-050e0c2b-9244-4987-b07d-e4712e46f936" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:27:32 user nova-compute[72820]: DEBUG nova.network.neutron [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Successfully updated port: e13b95dc-bcba-4615-954c-61bc3cb2451f {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:27:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "refresh_cache-63c67f6e-849b-404a-bd38-524604cae3d8" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:27:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquired lock "refresh_cache-63c67f6e-849b-404a-bd38-524604cae3d8" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:27:32 user nova-compute[72820]: DEBUG nova.network.neutron [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:27:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0696ce21-b0db-4c75-be92-5a4aeb59bcd2 req-bc568c5a-336d-4f8b-abe8-140062e4631a service nova] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Received event network-changed-e13b95dc-bcba-4615-954c-61bc3cb2451f {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-0696ce21-b0db-4c75-be92-5a4aeb59bcd2 req-bc568c5a-336d-4f8b-abe8-140062e4631a service nova] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Refreshing instance network info cache due to event network-changed-e13b95dc-bcba-4615-954c-61bc3cb2451f. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:27:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0696ce21-b0db-4c75-be92-5a4aeb59bcd2 req-bc568c5a-336d-4f8b-abe8-140062e4631a service nova] Acquiring lock "refresh_cache-63c67f6e-849b-404a-bd38-524604cae3d8" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:27:32 user nova-compute[72820]: DEBUG nova.network.neutron [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:27:32 user nova-compute[72820]: DEBUG nova.network.neutron [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Updating instance_info_cache with network_info: [{"id": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "address": "fa:16:3e:cf:0e:bc", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13b95dc-bc", "ovs_interfaceid": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:27:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Releasing lock "refresh_cache-63c67f6e-849b-404a-bd38-524604cae3d8" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:27:32 user nova-compute[72820]: DEBUG nova.compute.manager [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Instance network_info: |[{"id": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "address": "fa:16:3e:cf:0e:bc", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13b95dc-bc", "ovs_interfaceid": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0696ce21-b0db-4c75-be92-5a4aeb59bcd2 req-bc568c5a-336d-4f8b-abe8-140062e4631a service nova] Acquired lock "refresh_cache-63c67f6e-849b-404a-bd38-524604cae3d8" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.network.neutron [req-0696ce21-b0db-4c75-be92-5a4aeb59bcd2 req-bc568c5a-336d-4f8b-abe8-140062e4631a service nova] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Refreshing network info cache for port e13b95dc-bcba-4615-954c-61bc3cb2451f {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Start _get_guest_xml network_info=[{"id": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "address": "fa:16:3e:cf:0e:bc", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13b95dc-bc", "ovs_interfaceid": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:27:33 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:27:33 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:27:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-986140919',display_name='tempest-VolumesSnapshotTestJSON-instance-986140919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-986140919',id=19,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDeztSs+8mHoKMzDC1PcBVCx86Hyijat/B3yLvX/ipmgaYBM7k8fIYCIOcwVsqHLyN+kMSfv/wysGBfZjNrEDxIkMKRd3rIha26t9IJu/srRzrMII64+onIbqucmzmjRQ==',key_name='tempest-keypair-918910425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4abfae6cab24fef92f96422628dc7e6',ramdisk_id='',reservation_id='r-35sif06o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-941703694',owner_user_name='tempest-VolumesSnapshotTestJSON-941703694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:27:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e58dd305ae442ca84ae955894e7a074',uuid=63c67f6e-849b-404a-bd38-524604cae3d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "address": "fa:16:3e:cf:0e:bc", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13b95dc-bc", "ovs_interfaceid": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Converting VIF {"id": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "address": "fa:16:3e:cf:0e:bc", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13b95dc-bc", "ovs_interfaceid": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:0e:bc,bridge_name='br-int',has_traffic_filtering=True,id=e13b95dc-bcba-4615-954c-61bc3cb2451f,network=Network(35f784f8-b045-4a19-a8e6-bbf5b06bdaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13b95dc-bc') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.objects.instance [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lazy-loading 'pci_devices' on Instance uuid 63c67f6e-849b-404a-bd38-524604cae3d8 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:27:33 user nova-compute[72820]:   <uuid>63c67f6e-849b-404a-bd38-524604cae3d8</uuid>
Aug 27 02:27:33 user nova-compute[72820]:   <name>instance-00000013</name>
Aug 27 02:27:33 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:27:33 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:27:33 user nova-compute[72820]:   <metadata>
Aug 27 02:27:33 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:27:33 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:27:33 user nova-compute[72820]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-986140919</nova:name>
Aug 27 02:27:33 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:27:33</nova:creationTime>
Aug 27 02:27:33 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:27:33 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:27:33 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:27:33 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:27:33 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:27:33 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:27:33 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:27:33 user nova-compute[72820]:       <nova:owner>
Aug 27 02:27:33 user nova-compute[72820]:         <nova:user uuid="3e58dd305ae442ca84ae955894e7a074">tempest-VolumesSnapshotTestJSON-941703694-project-member</nova:user>
Aug 27 02:27:33 user nova-compute[72820]:         <nova:project uuid="e4abfae6cab24fef92f96422628dc7e6">tempest-VolumesSnapshotTestJSON-941703694</nova:project>
Aug 27 02:27:33 user nova-compute[72820]:       </nova:owner>
Aug 27 02:27:33 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:27:33 user nova-compute[72820]:       <nova:ports>
Aug 27 02:27:33 user nova-compute[72820]:         <nova:port uuid="e13b95dc-bcba-4615-954c-61bc3cb2451f">
Aug 27 02:27:33 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 02:27:33 user nova-compute[72820]:         </nova:port>
Aug 27 02:27:33 user nova-compute[72820]:       </nova:ports>
Aug 27 02:27:33 user nova-compute[72820]:     </nova:instance>
Aug 27 02:27:33 user nova-compute[72820]:   </metadata>
Aug 27 02:27:33 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:27:33 user nova-compute[72820]:     <system>
Aug 27 02:27:33 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:27:33 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:27:33 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:27:33 user nova-compute[72820]:       <entry name="serial">63c67f6e-849b-404a-bd38-524604cae3d8</entry>
Aug 27 02:27:33 user nova-compute[72820]:       <entry name="uuid">63c67f6e-849b-404a-bd38-524604cae3d8</entry>
Aug 27 02:27:33 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:27:33 user nova-compute[72820]:     </system>
Aug 27 02:27:33 user nova-compute[72820]:   </sysinfo>
Aug 27 02:27:33 user nova-compute[72820]:   <os>
Aug 27 02:27:33 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:27:33 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:27:33 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:27:33 user nova-compute[72820]:   </os>
Aug 27 02:27:33 user nova-compute[72820]:   <features>
Aug 27 02:27:33 user nova-compute[72820]:     <acpi/>
Aug 27 02:27:33 user nova-compute[72820]:     <apic/>
Aug 27 02:27:33 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:27:33 user nova-compute[72820]:   </features>
Aug 27 02:27:33 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:27:33 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:27:33 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:27:33 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:27:33 user nova-compute[72820]:   </clock>
Aug 27 02:27:33 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:27:33 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:27:33 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:27:33 user nova-compute[72820]:   </cpu>
Aug 27 02:27:33 user nova-compute[72820]:   <devices>
Aug 27 02:27:33 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:27:33 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:27:33 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk"/>
Aug 27 02:27:33 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:27:33 user nova-compute[72820]:     </disk>
Aug 27 02:27:33 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:27:33 user nova-compute[72820]:       <mac address="fa:16:3e:cf:0e:bc"/>
Aug 27 02:27:33 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:27:33 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:27:33 user nova-compute[72820]:       <target dev="tape13b95dc-bc"/>
Aug 27 02:27:33 user nova-compute[72820]:     </interface>
Aug 27 02:27:33 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:27:33 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/console.log" append="off"/>
Aug 27 02:27:33 user nova-compute[72820]:     </serial>
Aug 27 02:27:33 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:27:33 user nova-compute[72820]:     <video>
Aug 27 02:27:33 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:27:33 user nova-compute[72820]:     </video>
Aug 27 02:27:33 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:27:33 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:27:33 user nova-compute[72820]:     </rng>
Aug 27 02:27:33 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:27:33 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:27:33 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:27:33 user nova-compute[72820]:     </memballoon>
Aug 27 02:27:33 user nova-compute[72820]:   </devices>
Aug 27 02:27:33 user nova-compute[72820]: </domain>
Aug 27 02:27:33 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:27:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-986140919',display_name='tempest-VolumesSnapshotTestJSON-instance-986140919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-986140919',id=19,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDeztSs+8mHoKMzDC1PcBVCx86Hyijat/B3yLvX/ipmgaYBM7k8fIYCIOcwVsqHLyN+kMSfv/wysGBfZjNrEDxIkMKRd3rIha26t9IJu/srRzrMII64+onIbqucmzmjRQ==',key_name='tempest-keypair-918910425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4abfae6cab24fef92f96422628dc7e6',ramdisk_id='',reservation_id='r-35sif06o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-941703694',owner_user_name='tempest-VolumesSnapshotTestJSON-941703694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:27:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e58dd305ae442ca84ae955894e7a074',uuid=63c67f6e-849b-404a-bd38-524604cae3d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "address": "fa:16:3e:cf:0e:bc", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13b95dc-bc", "ovs_interfaceid": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Converting VIF {"id": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "address": "fa:16:3e:cf:0e:bc", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13b95dc-bc", "ovs_interfaceid": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:0e:bc,bridge_name='br-int',has_traffic_filtering=True,id=e13b95dc-bcba-4615-954c-61bc3cb2451f,network=Network(35f784f8-b045-4a19-a8e6-bbf5b06bdaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13b95dc-bc') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG os_vif [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:0e:bc,bridge_name='br-int',has_traffic_filtering=True,id=e13b95dc-bcba-4615-954c-61bc3cb2451f,network=Network(35f784f8-b045-4a19-a8e6-bbf5b06bdaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13b95dc-bc') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape13b95dc-bc, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape13b95dc-bc, col_values=(('external_ids', {'iface-id': 'e13b95dc-bcba-4615-954c-61bc3cb2451f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:0e:bc', 'vm-uuid': '63c67f6e-849b-404a-bd38-524604cae3d8'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:33 user nova-compute[72820]: INFO os_vif [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:0e:bc,bridge_name='br-int',has_traffic_filtering=True,id=e13b95dc-bcba-4615-954c-61bc3cb2451f,network=Network(35f784f8-b045-4a19-a8e6-bbf5b06bdaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13b95dc-bc')
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] No VIF found with MAC fa:16:3e:cf:0e:bc, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.network.neutron [req-0696ce21-b0db-4c75-be92-5a4aeb59bcd2 req-bc568c5a-336d-4f8b-abe8-140062e4631a service nova] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Updated VIF entry in instance network info cache for port e13b95dc-bcba-4615-954c-61bc3cb2451f. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG nova.network.neutron [req-0696ce21-b0db-4c75-be92-5a4aeb59bcd2 req-bc568c5a-336d-4f8b-abe8-140062e4631a service nova] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Updating instance_info_cache with network_info: [{"id": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "address": "fa:16:3e:cf:0e:bc", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13b95dc-bc", "ovs_interfaceid": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:27:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0696ce21-b0db-4c75-be92-5a4aeb59bcd2 req-bc568c5a-336d-4f8b-abe8-140062e4631a service nova] Releasing lock "refresh_cache-63c67f6e-849b-404a-bd38-524604cae3d8" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:27:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-4b5a3f13-12f9-44d7-b387-e6da00a4bf08 req-0dfbfcfe-0788-427d-8635-4249abc084f7 service nova] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Received event network-vif-plugged-e13b95dc-bcba-4615-954c-61bc3cb2451f {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4b5a3f13-12f9-44d7-b387-e6da00a4bf08 req-0dfbfcfe-0788-427d-8635-4249abc084f7 service nova] Acquiring lock "63c67f6e-849b-404a-bd38-524604cae3d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4b5a3f13-12f9-44d7-b387-e6da00a4bf08 req-0dfbfcfe-0788-427d-8635-4249abc084f7 service nova] Lock "63c67f6e-849b-404a-bd38-524604cae3d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4b5a3f13-12f9-44d7-b387-e6da00a4bf08 req-0dfbfcfe-0788-427d-8635-4249abc084f7 service nova] Lock "63c67f6e-849b-404a-bd38-524604cae3d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-4b5a3f13-12f9-44d7-b387-e6da00a4bf08 req-0dfbfcfe-0788-427d-8635-4249abc084f7 service nova] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] No waiting events found dispatching network-vif-plugged-e13b95dc-bcba-4615-954c-61bc3cb2451f {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:34 user nova-compute[72820]: WARNING nova.compute.manager [req-4b5a3f13-12f9-44d7-b387-e6da00a4bf08 req-0dfbfcfe-0788-427d-8635-4249abc084f7 service nova] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Received unexpected event network-vif-plugged-e13b95dc-bcba-4615-954c-61bc3cb2451f for instance with vm_state building and task_state spawning.
Aug 27 02:27:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:35 user nova-compute[72820]: INFO nova.compute.manager [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Terminating instance
Aug 27 02:27:35 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:27:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:36 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Instance destroyed successfully.
Aug 27 02:27:36 user nova-compute[72820]: DEBUG nova.objects.instance [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lazy-loading 'resources' on Instance uuid 6ed3c12e-96a8-4a32-8089-f04eba608663 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1676535291',display_name='tempest-ServerStableDeviceRescueTest-server-1676535291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1676535291',id=4,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB04yomk5T62vZJSVvoxy9wjx2XDDI3YyI0pgcUSmDJzHCnRqd17erEpyE4qTQ4t3kM+pbWYbc4lokzsskTc9ooGBqn+1IPsE5tH8dB/xD77C2OIF0/l2pafnLZ4Fi0WQ==',key_name='tempest-keypair-2001966138',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:24:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2f0d3ebcd3c470c8927c690914135d9',ramdisk_id='',reservation_id='r-ku0xay81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-561556641',owner_user_name='tempest-ServerStableDeviceRescueTest-561556641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:26:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250575b5f1464f97b2e95bb1c8e46dbd',uuid=6ed3c12e-96a8-4a32-8089-f04eba608663,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Converting VIF {"id": "dc035bdf-5877-42fe-b1e2-fa882373f836", "address": "fa:16:3e:67:6b:e8", "network": {"id": "d4eb66d2-6165-4b86-b42b-f2f65c5e97ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1918058879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f0d3ebcd3c470c8927c690914135d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc035bdf-58", "ovs_interfaceid": "dc035bdf-5877-42fe-b1e2-fa882373f836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:6b:e8,bridge_name='br-int',has_traffic_filtering=True,id=dc035bdf-5877-42fe-b1e2-fa882373f836,network=Network(d4eb66d2-6165-4b86-b42b-f2f65c5e97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc035bdf-58') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG os_vif [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:6b:e8,bridge_name='br-int',has_traffic_filtering=True,id=dc035bdf-5877-42fe-b1e2-fa882373f836,network=Network(d4eb66d2-6165-4b86-b42b-f2f65c5e97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc035bdf-58') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc035bdf-58, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG nova.compute.manager [req-51a6a6d2-0d8b-4dc5-9c14-a5250bccd095 req-4b7e3def-9ec3-4f2d-9489-352d78cd7602 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-vif-unplugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-51a6a6d2-0d8b-4dc5-9c14-a5250bccd095 req-4b7e3def-9ec3-4f2d-9489-352d78cd7602 service nova] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-51a6a6d2-0d8b-4dc5-9c14-a5250bccd095 req-4b7e3def-9ec3-4f2d-9489-352d78cd7602 service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-51a6a6d2-0d8b-4dc5-9c14-a5250bccd095 req-4b7e3def-9ec3-4f2d-9489-352d78cd7602 service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG nova.compute.manager [req-51a6a6d2-0d8b-4dc5-9c14-a5250bccd095 req-4b7e3def-9ec3-4f2d-9489-352d78cd7602 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] No waiting events found dispatching network-vif-unplugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG nova.compute.manager [req-51a6a6d2-0d8b-4dc5-9c14-a5250bccd095 req-4b7e3def-9ec3-4f2d-9489-352d78cd7602 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-vif-unplugged-dc035bdf-5877-42fe-b1e2-fa882373f836 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:27:36 user nova-compute[72820]: INFO os_vif [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:6b:e8,bridge_name='br-int',has_traffic_filtering=True,id=dc035bdf-5877-42fe-b1e2-fa882373f836,network=Network(d4eb66d2-6165-4b86-b42b-f2f65c5e97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc035bdf-58')
Aug 27 02:27:36 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Deleting instance files /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663_del
Aug 27 02:27:36 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Deletion of /opt/stack/data/nova/instances/6ed3c12e-96a8-4a32-8089-f04eba608663_del complete
Aug 27 02:27:36 user nova-compute[72820]: INFO nova.compute.manager [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Took 1.07 seconds to destroy the instance on the hypervisor.
Aug 27 02:27:36 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG nova.compute.manager [req-08e36ebe-a11c-4aa5-9a1b-9d93a8dbb479 req-cc5a82d6-04ca-4e20-b837-2f889299d412 service nova] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Received event network-vif-plugged-e13b95dc-bcba-4615-954c-61bc3cb2451f {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-08e36ebe-a11c-4aa5-9a1b-9d93a8dbb479 req-cc5a82d6-04ca-4e20-b837-2f889299d412 service nova] Acquiring lock "63c67f6e-849b-404a-bd38-524604cae3d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-08e36ebe-a11c-4aa5-9a1b-9d93a8dbb479 req-cc5a82d6-04ca-4e20-b837-2f889299d412 service nova] Lock "63c67f6e-849b-404a-bd38-524604cae3d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-08e36ebe-a11c-4aa5-9a1b-9d93a8dbb479 req-cc5a82d6-04ca-4e20-b837-2f889299d412 service nova] Lock "63c67f6e-849b-404a-bd38-524604cae3d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:36 user nova-compute[72820]: DEBUG nova.compute.manager [req-08e36ebe-a11c-4aa5-9a1b-9d93a8dbb479 req-cc5a82d6-04ca-4e20-b837-2f889299d412 service nova] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] No waiting events found dispatching network-vif-plugged-e13b95dc-bcba-4615-954c-61bc3cb2451f {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:36 user nova-compute[72820]: WARNING nova.compute.manager [req-08e36ebe-a11c-4aa5-9a1b-9d93a8dbb479 req-cc5a82d6-04ca-4e20-b837-2f889299d412 service nova] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Received unexpected event network-vif-plugged-e13b95dc-bcba-4615-954c-61bc3cb2451f for instance with vm_state building and task_state spawning.
Aug 27 02:27:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103257.1642923, 63c67f6e-849b-404a-bd38-524604cae3d8 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:27:37 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] VM Resumed (Lifecycle Event)
Aug 27 02:27:37 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Instance spawned successfully.
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:37 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103257.1659024, 63c67f6e-849b-404a-bd38-524604cae3d8 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:27:37 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] VM Started (Lifecycle Event)
Aug 27 02:27:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:37 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:27:37 user nova-compute[72820]: INFO nova.compute.manager [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Took 6.70 seconds to spawn the instance on the hypervisor.
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:37 user nova-compute[72820]: INFO nova.compute.manager [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Took 7.82 seconds to build instance.
Aug 27 02:27:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-07239fd8-358e-4cd2-85a0-6e32dc21284a tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "63c67f6e-849b-404a-bd38-524604cae3d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.933s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:27:37 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Took 1.16 seconds to deallocate network for instance.
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-01f1e335-b033-4adc-a4a1-8a329abe7ef5 req-dc9fc88e-fae2-40f1-8be0-23438b2e5032 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-vif-deleted-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:37 user nova-compute[72820]: INFO nova.compute.manager [req-01f1e335-b033-4adc-a4a1-8a329abe7ef5 req-dc9fc88e-fae2-40f1-8be0-23438b2e5032 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Neutron deleted interface dc035bdf-5877-42fe-b1e2-fa882373f836; detaching it from the instance and deleting it from the info cache
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.network.neutron [req-01f1e335-b033-4adc-a4a1-8a329abe7ef5 req-dc9fc88e-fae2-40f1-8be0-23438b2e5032 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-01f1e335-b033-4adc-a4a1-8a329abe7ef5 req-dc9fc88e-fae2-40f1-8be0-23438b2e5032 service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Detach interface failed, port_id=dc035bdf-5877-42fe-b1e2-fa882373f836, reason: Instance 6ed3c12e-96a8-4a32-8089-f04eba608663 could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:38 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Deleted allocations for instance 6ed3c12e-96a8-4a32-8089-f04eba608663
Aug 27 02:27:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a894cbc2-d71f-415d-91f3-0d080fd24a88 tempest-ServerStableDeviceRescueTest-561556641 tempest-ServerStableDeviceRescueTest-561556641-project-member] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.915s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] No waiting events found dispatching network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:38 user nova-compute[72820]: WARNING nova.compute.manager [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received unexpected event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 for instance with vm_state deleted and task_state None.
Aug 27 02:27:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] No waiting events found dispatching network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:38 user nova-compute[72820]: WARNING nova.compute.manager [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received unexpected event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 for instance with vm_state deleted and task_state None.
Aug 27 02:27:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] No waiting events found dispatching network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:38 user nova-compute[72820]: WARNING nova.compute.manager [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received unexpected event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 for instance with vm_state deleted and task_state None.
Aug 27 02:27:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] Acquiring lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] Lock "6ed3c12e-96a8-4a32-8089-f04eba608663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] No waiting events found dispatching network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:27:38 user nova-compute[72820]: WARNING nova.compute.manager [req-bc821b56-dea3-48e3-8ad6-6be9d352326f req-8da8dcd3-146a-489c-b1a8-8a8dba14c68a service nova] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Received unexpected event network-vif-plugged-dc035bdf-5877-42fe-b1e2-fa882373f836 for instance with vm_state deleted and task_state None.
Aug 27 02:27:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "050e0c2b-9244-4987-b07d-e4712e46f936" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:44 user nova-compute[72820]: DEBUG nova.objects.instance [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'flavor' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:27:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "050e0c2b-9244-4987-b07d-e4712e46f936" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "050e0c2b-9244-4987-b07d-e4712e46f936" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:44 user nova-compute[72820]: INFO nova.compute.manager [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Attaching volume eef65157-3d3e-4206-a2a3-d72d56a55047 to /dev/vdb
Aug 27 02:27:44 user nova-compute[72820]: DEBUG os_brick.utils [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:27:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd7acca-54f9-4953-a6fd-bdfa3d6689b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a03018a-69ba-40bb-88a9-2d0bc4544e38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee02f1c3-f0ae-4ed4-a121-350f70994dc3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[75245648-de8c-425b-b100-ae806ff138c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:27:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:27:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:27:45 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:27:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[396ecf08-d332-46fd-a039-a7dbc3746e94]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:27:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:27:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:27:45 user nova-compute[72820]: DEBUG os_brick.utils [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:27:45 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Updating existing volume attachment record: c4ff6c23-4aaa-409e-aad2-6e788594d1b9 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:27:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "94323d83-f8fe-4814-82af-f860a20071bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "94323d83-f8fe-4814-82af-f860a20071bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:49 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:27:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:27:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:27:49 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:27:49 user nova-compute[72820]: INFO nova.compute.claims [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Claim successful on node user
Aug 27 02:27:50 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:27:50 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:27:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG nova.policy [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4863de7cf43b4c8599cfc292b3308f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf36cee8a5645d5950878c914bf1f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:27:50 user nova-compute[72820]: INFO nova.virt.block_device [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Booting with volume 497c2055-ee13-45f0-8652-3ac5ba9b8c37 at /dev/vda
Aug 27 02:27:50 user nova-compute[72820]: DEBUG os_brick.utils [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c29f53b-2389-440f-a2ac-92e7fdf339db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a12b4f-dddb-4c94-8b5d-00dc956b352f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dc3da9-1bac-4262-894c-8ecab9ae3059]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[145c9f8a-d2cb-42a2-9ed1-7e81d9426003]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:27:50 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:27:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa39be7a-5369-4a17-9a74-2e3db8fb0c23]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG os_brick.utils [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:27:50 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Updating existing volume attachment record: 00dc2a44-f6ab-4342-a85a-c2cd83968863 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:27:51 user nova-compute[72820]: DEBUG nova.network.neutron [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Successfully created port: 03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:27:51 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103256.382664, 6ed3c12e-96a8-4a32-8089-f04eba608663 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:27:51 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] VM Stopped (Lifecycle Event)
Aug 27 02:27:51 user nova-compute[72820]: DEBUG nova.compute.manager [None req-838a75bd-5256-4c67-9215-af7c3d17b7dc None None] [instance: 6ed3c12e-96a8-4a32-8089-f04eba608663] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:27:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:52 user nova-compute[72820]: DEBUG nova.network.neutron [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Successfully updated port: 03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:27:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:27:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquired lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:27:52 user nova-compute[72820]: DEBUG nova.network.neutron [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:27:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-56228fc2-87ae-4324-a9d9-08d6f7662ecd req-cca3b91c-0fcd-41ec-93ae-7cdb7dcfedfe service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received event network-changed-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:27:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-56228fc2-87ae-4324-a9d9-08d6f7662ecd req-cca3b91c-0fcd-41ec-93ae-7cdb7dcfedfe service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Refreshing instance network info cache due to event network-changed-03bf65d2-99ae-4eea-863b-3edc35e19dd4. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:27:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-56228fc2-87ae-4324-a9d9-08d6f7662ecd req-cca3b91c-0fcd-41ec-93ae-7cdb7dcfedfe service nova] Acquiring lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:27:52 user nova-compute[72820]: DEBUG nova.network.neutron [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:27:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:52 user nova-compute[72820]: DEBUG nova.network.neutron [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Updating instance_info_cache with network_info: [{"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:27:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Releasing lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:27:52 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Instance network_info: |[{"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:27:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-56228fc2-87ae-4324-a9d9-08d6f7662ecd req-cca3b91c-0fcd-41ec-93ae-7cdb7dcfedfe service nova] Acquired lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:27:52 user nova-compute[72820]: DEBUG nova.network.neutron [req-56228fc2-87ae-4324-a9d9-08d6f7662ecd req-cca3b91c-0fcd-41ec-93ae-7cdb7dcfedfe service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Refreshing network info cache for port 03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:27:53 user nova-compute[72820]: DEBUG nova.network.neutron [req-56228fc2-87ae-4324-a9d9-08d6f7662ecd req-cca3b91c-0fcd-41ec-93ae-7cdb7dcfedfe service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Updated VIF entry in instance network info cache for port 03bf65d2-99ae-4eea-863b-3edc35e19dd4. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:27:53 user nova-compute[72820]: DEBUG nova.network.neutron [req-56228fc2-87ae-4324-a9d9-08d6f7662ecd req-cca3b91c-0fcd-41ec-93ae-7cdb7dcfedfe service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Updating instance_info_cache with network_info: [{"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:27:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-56228fc2-87ae-4324-a9d9-08d6f7662ecd req-cca3b91c-0fcd-41ec-93ae-7cdb7dcfedfe service nova] Releasing lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:27:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlOEvWhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:27:58 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:27:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:27:58 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:27:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:27:58 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e25ecde-57d7-48f6-9b13-18a3e21b7825]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:27:58 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[268be4c1-67d7-4b84-a1b9-d12a088703c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047] added
Aug 27 02:27:58 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8339491c-400e-41ef-bfc2-d35650f4ba0d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4c634e-cda0-4936-92db-e12f0ad65e0b]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GlOEvWhi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GlOEvWhi" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d759b4-04c7-47d3-bb35-737bc9637bad]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GlOEvWhi'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7a9ac6-2b4d-4dac-8fd9-5eb261807f16]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b63c63a-c497-433c-b12d-43b9e3a5c8ec]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:27:58 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:27:58 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:27:58 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:27:58 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:27:58 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:27:59 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:27:59 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:27:59 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:27:59 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:27:59 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[18be88d8-66e8-4356-a885-2315da0e2234]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047, portal: 172.16.0.220,3260]
Aug 27 02:27:59 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047, portal: 172.16.0.220,3260] successful.
Aug 27 02:27:59 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e951e251-8562-4326-b93e-903c23d96f51]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc834ac-4d7b-41b4-a69f-ccd241ce7fb2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:27:59 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:27:59 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:27:59 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:27:59 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:27:59 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:27:59 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:27:59 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:27:59 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:27:59 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:27:59 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:27:59 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:27:59 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] HCTL ('38', '-', '-', 0) found on session 20 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd022d91-94c4-4e3d-9d53-1f504da9fbfa]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:27:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlOEvWhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:28:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:28:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23462383238653339', 'path': '/dev/sdg'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:28:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462383238653339', 'path': '/dev/sdg'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:28:00 user nova-compute[72820]: DEBUG nova.objects.instance [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'flavor' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:28:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:28:00 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:28:00 user nova-compute[72820]:   <source dev="/dev/sdg"/>
Aug 27 02:28:00 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:28:00 user nova-compute[72820]:   <serial>eef65157-3d3e-4206-a2a3-d72d56a55047</serial>
Aug 27 02:28:00 user nova-compute[72820]: </disk>
Aug 27 02:28:00 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:28:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:28:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:28:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] No VIF found with MAC fa:16:3e:a4:94:7e, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:28:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a3c5e31a-afbc-40d5-8b73-4a197129f0cd tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "050e0c2b-9244-4987-b07d-e4712e46f936" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.917s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7f04cb85-41b2-49a3-84c8-54cfb32f54b6 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7f04cb85-41b2-49a3-84c8-54cfb32f54b6 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "050e0c2b-9244-4987-b07d-e4712e46f936" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7f04cb85-41b2-49a3-84c8-54cfb32f54b6 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:28:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7f04cb85-41b2-49a3-84c8-54cfb32f54b6 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72820) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 27 02:28:01 user nova-compute[72820]: DEBUG nova.objects.instance [None req-7f04cb85-41b2-49a3-84c8-54cfb32f54b6 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'flavor' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:28:01 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:01 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:01 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:01 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-fe8803c2-5daa-4902-aeae-23eab866e57f req-b460e08a-63c6-4214-b98e-1243c42e7815 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received event network-vif-unplugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fe8803c2-5daa-4902-aeae-23eab866e57f req-b460e08a-63c6-4214-b98e-1243c42e7815 service nova] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fe8803c2-5daa-4902-aeae-23eab866e57f req-b460e08a-63c6-4214-b98e-1243c42e7815 service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fe8803c2-5daa-4902-aeae-23eab866e57f req-b460e08a-63c6-4214-b98e-1243c42e7815 service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-fe8803c2-5daa-4902-aeae-23eab866e57f req-b460e08a-63c6-4214-b98e-1243c42e7815 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] No waiting events found dispatching network-vif-unplugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:28:01 user nova-compute[72820]: WARNING nova.compute.manager [req-fe8803c2-5daa-4902-aeae-23eab866e57f req-b460e08a-63c6-4214-b98e-1243c42e7815 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received unexpected event network-vif-unplugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 for instance with vm_state active and task_state powering-off.
Aug 27 02:28:01 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:01 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Instance destroyed successfully.
Aug 27 02:28:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7f04cb85-41b2-49a3-84c8-54cfb32f54b6 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:28:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7f04cb85-41b2-49a3-84c8-54cfb32f54b6 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "050e0c2b-9244-4987-b07d-e4712e46f936" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.924s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:03 user nova-compute[72820]: DEBUG nova.compute.manager [req-53ae5594-47d6-4862-be46-1ac6f4a96d56 req-e7b0b8bb-23e6-4618-83d3-ac724776d90b service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received event network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-53ae5594-47d6-4862-be46-1ac6f4a96d56 req-e7b0b8bb-23e6-4618-83d3-ac724776d90b service nova] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-53ae5594-47d6-4862-be46-1ac6f4a96d56 req-e7b0b8bb-23e6-4618-83d3-ac724776d90b service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-53ae5594-47d6-4862-be46-1ac6f4a96d56 req-e7b0b8bb-23e6-4618-83d3-ac724776d90b service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:03 user nova-compute[72820]: DEBUG nova.compute.manager [req-53ae5594-47d6-4862-be46-1ac6f4a96d56 req-e7b0b8bb-23e6-4618-83d3-ac724776d90b service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] No waiting events found dispatching network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:28:03 user nova-compute[72820]: WARNING nova.compute.manager [req-53ae5594-47d6-4862-be46-1ac6f4a96d56 req-e7b0b8bb-23e6-4618-83d3-ac724776d90b service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received unexpected event network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 for instance with vm_state stopped and task_state None.
Aug 27 02:28:06 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:28:06 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:28:06 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:28:06 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:28:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:07 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:28:08 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:28:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:08 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:28:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:28:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:28:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:28:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:28:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:28:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:28:11 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Creating image(s)
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Did not create local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Ensure instance console log exists: /opt/stack/data/nova/instances/94323d83-f8fe-4814-82af-f860a20071bf/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Start _get_guest_xml network_info=[{"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '00dc2a44-f6ab-4342-a85a-c2cd83968863', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIGKvAka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94323d83-f8fe-4814-82af-f860a20071bf', 'attached_at': '', 'detached_at': '', 'volume_id': '497c2055-ee13-45f0-8652-3ac5ba9b8c37', 'serial': '497c2055-ee13-45f0-8652-3ac5ba9b8c37'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:11 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:28:11 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIGKvAka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:28:11 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:28:11 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:28:11 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e0e196-e3b9-441b-b182-da6007205436]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:28:11 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc07366e-4110-4dc6-ac6c-1ccc33e57680]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37] added
Aug 27 02:28:11 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[688c6ea4-0fbd-4965-a569-1c64227ae054]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1175b96-d174-41dd-84fd-702d084c489b]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EIGKvAka {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EIGKvAka" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c050c522-1fd0-40e9-ab34-104a187c98ba]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EIGKvAka'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b3cf08-c2d8-4678-8d27-59f133de03ca]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9616bfa-771a-4717-99d0-d91fa2a9da70]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:28:11 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:28:11 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9901b383-da01-435d-8106-b35397eea536]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37, portal: 172.16.0.220,3260]
Aug 27 02:28:11 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37, portal: 172.16.0.220,3260] successful.
Aug 27 02:28:11 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c829f56e-b46d-481f-9798-19b274f83e49]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d03fef-6bab-41fb-87bd-328d0aff5343]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:28:11 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:28:11 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:28:11 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] HCTL ('39', '-', '-', 0) found on session 21 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:28:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[73db43e7-ec44-4280-a83c-7e8882074872]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Searching for a device in session 21 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIGKvAka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:12 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:28:12 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:28:12 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7092MB free_disk=25.344249725341797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 26581695-c4b9-40b8-ab7a-34c99db0dadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f8f612f3-41c9-4dae-8d49-218d61720b15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f37dfe42-3b22-4111-b10d-9459c8c42b2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 050e0c2b-9244-4987-b07d-e4712e46f936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance ac2f6797-8b7c-47d3-836d-fc1c617e23dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1591319d-3d15-4c46-b823-4edddf018b5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 7c42c4ae-0f80-4295-a64e-b426225b94c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 63c67f6e-849b-404a-bd38-524604cae3d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 94323d83-f8fe-4814-82af-f860a20071bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:28:12 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23938663130633164', 'path': '/dev/sdh'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938663130633164', 'path': '/dev/sdh'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1937387142',display_name='tempest-TestShelveInstance-server-1937387142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1937387142',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTe/Ws++PTjVd38AijjMR1+3JeXnwOZ3a2pV/iawjQkNYhlRUt5WM3DtBBg+vTai/JuZmVSemEe8iX7whVOhmmkcL7ICmzX59GN2erKSMY/1YIdlhzg0vy84VQcjCbfyw==',key_name='tempest-TestShelveInstance-1669796109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbf36cee8a5645d5950878c914bf1f85',ramdisk_id='',reservation_id='r-u2u632ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1813275073',owner_user_name='tempest-TestShelveInstance-1813275073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:27:50Z,user_data=None,user_id='4863de7cf43b4c8599cfc292b3308f56',uuid=94323d83-f8fe-4814-82af-f860a20071bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Converting VIF {"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:59,bridge_name='br-int',has_traffic_filtering=True,id=03bf65d2-99ae-4eea-863b-3edc35e19dd4,network=Network(36de333f-9660-4657-89e8-fd4409b55471),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf65d2-99') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG nova.objects.instance [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lazy-loading 'pci_devices' on Instance uuid 94323d83-f8fe-4814-82af-f860a20071bf {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:28:13 user nova-compute[72820]:   <uuid>94323d83-f8fe-4814-82af-f860a20071bf</uuid>
Aug 27 02:28:13 user nova-compute[72820]:   <name>instance-00000014</name>
Aug 27 02:28:13 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:28:13 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:28:13 user nova-compute[72820]:   <metadata>
Aug 27 02:28:13 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:28:13 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:28:13 user nova-compute[72820]:       <nova:name>tempest-TestShelveInstance-server-1937387142</nova:name>
Aug 27 02:28:13 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:28:11</nova:creationTime>
Aug 27 02:28:13 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:28:13 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:28:13 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:28:13 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:28:13 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:28:13 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:28:13 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:28:13 user nova-compute[72820]:       <nova:owner>
Aug 27 02:28:13 user nova-compute[72820]:         <nova:user uuid="4863de7cf43b4c8599cfc292b3308f56">tempest-TestShelveInstance-1813275073-project-member</nova:user>
Aug 27 02:28:13 user nova-compute[72820]:         <nova:project uuid="bbf36cee8a5645d5950878c914bf1f85">tempest-TestShelveInstance-1813275073</nova:project>
Aug 27 02:28:13 user nova-compute[72820]:       </nova:owner>
Aug 27 02:28:13 user nova-compute[72820]:       <nova:ports>
Aug 27 02:28:13 user nova-compute[72820]:         <nova:port uuid="03bf65d2-99ae-4eea-863b-3edc35e19dd4">
Aug 27 02:28:13 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 02:28:13 user nova-compute[72820]:         </nova:port>
Aug 27 02:28:13 user nova-compute[72820]:       </nova:ports>
Aug 27 02:28:13 user nova-compute[72820]:     </nova:instance>
Aug 27 02:28:13 user nova-compute[72820]:   </metadata>
Aug 27 02:28:13 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:28:13 user nova-compute[72820]:     <system>
Aug 27 02:28:13 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:28:13 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:28:13 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:28:13 user nova-compute[72820]:       <entry name="serial">94323d83-f8fe-4814-82af-f860a20071bf</entry>
Aug 27 02:28:13 user nova-compute[72820]:       <entry name="uuid">94323d83-f8fe-4814-82af-f860a20071bf</entry>
Aug 27 02:28:13 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:28:13 user nova-compute[72820]:     </system>
Aug 27 02:28:13 user nova-compute[72820]:   </sysinfo>
Aug 27 02:28:13 user nova-compute[72820]:   <os>
Aug 27 02:28:13 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:28:13 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:28:13 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:28:13 user nova-compute[72820]:   </os>
Aug 27 02:28:13 user nova-compute[72820]:   <features>
Aug 27 02:28:13 user nova-compute[72820]:     <acpi/>
Aug 27 02:28:13 user nova-compute[72820]:     <apic/>
Aug 27 02:28:13 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:28:13 user nova-compute[72820]:   </features>
Aug 27 02:28:13 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:28:13 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:28:13 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:28:13 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:28:13 user nova-compute[72820]:   </clock>
Aug 27 02:28:13 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:28:13 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:28:13 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:28:13 user nova-compute[72820]:   </cpu>
Aug 27 02:28:13 user nova-compute[72820]:   <devices>
Aug 27 02:28:13 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:28:13 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:28:13 user nova-compute[72820]:       <source dev="/dev/sdh"/>
Aug 27 02:28:13 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:28:13 user nova-compute[72820]:       <serial>497c2055-ee13-45f0-8652-3ac5ba9b8c37</serial>
Aug 27 02:28:13 user nova-compute[72820]:     </disk>
Aug 27 02:28:13 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:28:13 user nova-compute[72820]:       <mac address="fa:16:3e:bb:1b:59"/>
Aug 27 02:28:13 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:28:13 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:28:13 user nova-compute[72820]:       <target dev="tap03bf65d2-99"/>
Aug 27 02:28:13 user nova-compute[72820]:     </interface>
Aug 27 02:28:13 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:28:13 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/94323d83-f8fe-4814-82af-f860a20071bf/console.log" append="off"/>
Aug 27 02:28:13 user nova-compute[72820]:     </serial>
Aug 27 02:28:13 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:28:13 user nova-compute[72820]:     <video>
Aug 27 02:28:13 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:28:13 user nova-compute[72820]:     </video>
Aug 27 02:28:13 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:28:13 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:28:13 user nova-compute[72820]:     </rng>
Aug 27 02:28:13 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:28:13 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:28:13 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:28:13 user nova-compute[72820]:     </memballoon>
Aug 27 02:28:13 user nova-compute[72820]:   </devices>
Aug 27 02:28:13 user nova-compute[72820]: </domain>
Aug 27 02:28:13 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1937387142',display_name='tempest-TestShelveInstance-server-1937387142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1937387142',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTe/Ws++PTjVd38AijjMR1+3JeXnwOZ3a2pV/iawjQkNYhlRUt5WM3DtBBg+vTai/JuZmVSemEe8iX7whVOhmmkcL7ICmzX59GN2erKSMY/1YIdlhzg0vy84VQcjCbfyw==',key_name='tempest-TestShelveInstance-1669796109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbf36cee8a5645d5950878c914bf1f85',ramdisk_id='',reservation_id='r-u2u632ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1813275073',owner_user_name='tempest-TestShelveInstance-1813275073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:27:50Z,user_data=None,user_id='4863de7cf43b4c8599cfc292b3308f56',uuid=94323d83-f8fe-4814-82af-f860a20071bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Converting VIF {"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:59,bridge_name='br-int',has_traffic_filtering=True,id=03bf65d2-99ae-4eea-863b-3edc35e19dd4,network=Network(36de333f-9660-4657-89e8-fd4409b55471),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf65d2-99') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG os_vif [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:59,bridge_name='br-int',has_traffic_filtering=True,id=03bf65d2-99ae-4eea-863b-3edc35e19dd4,network=Network(36de333f-9660-4657-89e8-fd4409b55471),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf65d2-99') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03bf65d2-99, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03bf65d2-99, col_values=(('external_ids', {'iface-id': '03bf65d2-99ae-4eea-863b-3edc35e19dd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:1b:59', 'vm-uuid': '94323d83-f8fe-4814-82af-f860a20071bf'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:13 user nova-compute[72820]: INFO os_vif [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:59,bridge_name='br-int',has_traffic_filtering=True,id=03bf65d2-99ae-4eea-863b-3edc35e19dd4,network=Network(36de333f-9660-4657-89e8-fd4409b55471),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf65d2-99')
Aug 27 02:28:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] No VIF found with MAC fa:16:3e:bb:1b:59, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:28:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-f8f612f3-41c9-4dae-8d49-218d61720b15" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-f8f612f3-41c9-4dae-8d49-218d61720b15" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-b09785a5-8e67-4116-bd9d-fd5662865b21 req-132b6a45-d590-4fcd-b688-8861e007351f service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received event network-vif-plugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b09785a5-8e67-4116-bd9d-fd5662865b21 req-132b6a45-d590-4fcd-b688-8861e007351f service nova] Acquiring lock "94323d83-f8fe-4814-82af-f860a20071bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b09785a5-8e67-4116-bd9d-fd5662865b21 req-132b6a45-d590-4fcd-b688-8861e007351f service nova] Lock "94323d83-f8fe-4814-82af-f860a20071bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b09785a5-8e67-4116-bd9d-fd5662865b21 req-132b6a45-d590-4fcd-b688-8861e007351f service nova] Lock "94323d83-f8fe-4814-82af-f860a20071bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-b09785a5-8e67-4116-bd9d-fd5662865b21 req-132b6a45-d590-4fcd-b688-8861e007351f service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] No waiting events found dispatching network-vif-plugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:28:14 user nova-compute[72820]: WARNING nova.compute.manager [req-b09785a5-8e67-4116-bd9d-fd5662865b21 req-132b6a45-d590-4fcd-b688-8861e007351f service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received unexpected event network-vif-plugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 for instance with vm_state building and task_state spawning.
Aug 27 02:28:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Updating instance_info_cache with network_info: [{"id": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "address": "fa:16:3e:64:42:e4", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c62328f-29", "ovs_interfaceid": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-f8f612f3-41c9-4dae-8d49-218d61720b15" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:28:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103296.46767, 94323d83-f8fe-4814-82af-f860a20071bf => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:28:16 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] VM Resumed (Lifecycle Event)
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:28:16 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Instance spawned successfully.
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:28:16 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103296.4710608, 94323d83-f8fe-4814-82af-f860a20071bf => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:28:16 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] VM Started (Lifecycle Event)
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:28:16 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:28:16 user nova-compute[72820]: INFO nova.compute.manager [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Took 5.10 seconds to spawn the instance on the hypervisor.
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:28:16 user nova-compute[72820]: INFO nova.compute.manager [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Took 27.06 seconds to build instance.
Aug 27 02:28:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-8494087d-8627-4398-82c9-06644e4dc48a tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "94323d83-f8fe-4814-82af-f860a20071bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.165s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.compute.manager [req-b0d9d10a-7c9d-4aaf-86ca-a0bd078e4492 req-d9dba9ec-fb40-47ed-a131-7b48257b3e7e service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received event network-vif-plugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b0d9d10a-7c9d-4aaf-86ca-a0bd078e4492 req-d9dba9ec-fb40-47ed-a131-7b48257b3e7e service nova] Acquiring lock "94323d83-f8fe-4814-82af-f860a20071bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b0d9d10a-7c9d-4aaf-86ca-a0bd078e4492 req-d9dba9ec-fb40-47ed-a131-7b48257b3e7e service nova] Lock "94323d83-f8fe-4814-82af-f860a20071bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b0d9d10a-7c9d-4aaf-86ca-a0bd078e4492 req-d9dba9ec-fb40-47ed-a131-7b48257b3e7e service nova] Lock "94323d83-f8fe-4814-82af-f860a20071bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.compute.manager [req-b0d9d10a-7c9d-4aaf-86ca-a0bd078e4492 req-d9dba9ec-fb40-47ed-a131-7b48257b3e7e service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] No waiting events found dispatching network-vif-plugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:28:16 user nova-compute[72820]: WARNING nova.compute.manager [req-b0d9d10a-7c9d-4aaf-86ca-a0bd078e4492 req-d9dba9ec-fb40-47ed-a131-7b48257b3e7e service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received unexpected event network-vif-plugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 for instance with vm_state active and task_state None.
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103281.8639338, 050e0c2b-9244-4987-b07d-e4712e46f936 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:28:16 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] VM Stopped (Lifecycle Event)
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5b9d4d5c-3e62-47ce-82f4-5b0ff8d6be53 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:28:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5b9d4d5c-3e62-47ce-82f4-5b0ff8d6be53 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:28:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:28:28 user nova-compute[72820]: DEBUG nova.compute.manager [req-4dbfb1b2-f7cf-453c-b8f0-476d657adb3c req-a93f0df8-4ff1-40cd-a3c3-b3a4c6af6c3b service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received event network-changed-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:28 user nova-compute[72820]: DEBUG nova.compute.manager [req-4dbfb1b2-f7cf-453c-b8f0-476d657adb3c req-a93f0df8-4ff1-40cd-a3c3-b3a4c6af6c3b service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Refreshing instance network info cache due to event network-changed-553b0551-3051-4ed5-9c80-27d77670620d. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:28:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4dbfb1b2-f7cf-453c-b8f0-476d657adb3c req-a93f0df8-4ff1-40cd-a3c3-b3a4c6af6c3b service nova] Acquiring lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:28:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4dbfb1b2-f7cf-453c-b8f0-476d657adb3c req-a93f0df8-4ff1-40cd-a3c3-b3a4c6af6c3b service nova] Acquired lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:28:28 user nova-compute[72820]: DEBUG nova.network.neutron [req-4dbfb1b2-f7cf-453c-b8f0-476d657adb3c req-a93f0df8-4ff1-40cd-a3c3-b3a4c6af6c3b service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Refreshing network info cache for port 553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:28:29 user nova-compute[72820]: DEBUG nova.network.neutron [req-4dbfb1b2-f7cf-453c-b8f0-476d657adb3c req-a93f0df8-4ff1-40cd-a3c3-b3a4c6af6c3b service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Updated VIF entry in instance network info cache for port 553b0551-3051-4ed5-9c80-27d77670620d. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:28:29 user nova-compute[72820]: DEBUG nova.network.neutron [req-4dbfb1b2-f7cf-453c-b8f0-476d657adb3c req-a93f0df8-4ff1-40cd-a3c3-b3a4c6af6c3b service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Updating instance_info_cache with network_info: [{"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:28:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4dbfb1b2-f7cf-453c-b8f0-476d657adb3c req-a93f0df8-4ff1-40cd-a3c3-b3a4c6af6c3b service nova] Releasing lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:28:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:39 user nova-compute[72820]: INFO nova.compute.manager [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Rescuing
Aug 27 02:28:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "refresh_cache-1591319d-3d15-4c46-b823-4edddf018b5f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:28:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquired lock "refresh_cache-1591319d-3d15-4c46-b823-4edddf018b5f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:28:39 user nova-compute[72820]: DEBUG nova.network.neutron [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:28:40 user nova-compute[72820]: DEBUG nova.network.neutron [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Updating instance_info_cache with network_info: [{"id": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "address": "fa:16:3e:05:00:70", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb04bdd2-29", "ovs_interfaceid": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:28:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Releasing lock "refresh_cache-1591319d-3d15-4c46-b823-4edddf018b5f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:28:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-0aba9df5-d302-4126-8ec5-0c52ffe1e086 req-00cd2eb7-56f1-49a4-a911-f9cd560c59ea service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-unplugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0aba9df5-d302-4126-8ec5-0c52ffe1e086 req-00cd2eb7-56f1-49a4-a911-f9cd560c59ea service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0aba9df5-d302-4126-8ec5-0c52ffe1e086 req-00cd2eb7-56f1-49a4-a911-f9cd560c59ea service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0aba9df5-d302-4126-8ec5-0c52ffe1e086 req-00cd2eb7-56f1-49a4-a911-f9cd560c59ea service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-0aba9df5-d302-4126-8ec5-0c52ffe1e086 req-00cd2eb7-56f1-49a4-a911-f9cd560c59ea service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-unplugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:28:40 user nova-compute[72820]: WARNING nova.compute.manager [req-0aba9df5-d302-4126-8ec5-0c52ffe1e086 req-00cd2eb7-56f1-49a4-a911-f9cd560c59ea service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received unexpected event network-vif-unplugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with vm_state active and task_state rescuing.
Aug 27 02:28:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:40 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Instance destroyed successfully.
Aug 27 02:28:40 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Attempting a stable device rescue
Aug 27 02:28:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72820) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 02:28:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Instance directory exists: not creating {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 02:28:41 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Creating image(s)
Aug 27 02:28:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "/opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "/opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "/opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:41 user nova-compute[72820]: DEBUG nova.objects.instance [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1591319d-3d15-4c46-b823-4edddf018b5f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:28:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "cae77ae7ad9e1826eca1825711becaa414202414" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "cae77ae7ad9e1826eca1825711becaa414202414" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cae77ae7ad9e1826eca1825711becaa414202414.part --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cae77ae7ad9e1826eca1825711becaa414202414.part --force-share --output=json" returned: 0 in 0.212s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG nova.virt.images [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] 4bfd9bf2-7eb0-48d9-9ee5-8dcef487c337 was qcow2, converting to raw {{(pid=72820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG nova.privsep.utils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cae77ae7ad9e1826eca1825711becaa414202414.part /opt/stack/data/nova/instances/_base/cae77ae7ad9e1826eca1825711becaa414202414.converted {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:28:42 user nova-compute[72820]: WARNING nova.compute.manager [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received unexpected event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with vm_state active and task_state rescuing.
Aug 27 02:28:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:28:42 user nova-compute[72820]: WARNING nova.compute.manager [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received unexpected event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with vm_state active and task_state rescuing.
Aug 27 02:28:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:28:42 user nova-compute[72820]: WARNING nova.compute.manager [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received unexpected event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with vm_state active and task_state rescuing.
Aug 27 02:28:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-unplugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-unplugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:28:42 user nova-compute[72820]: WARNING nova.compute.manager [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received unexpected event network-vif-unplugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with vm_state active and task_state rescuing.
Aug 27 02:28:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:28:42 user nova-compute[72820]: WARNING nova.compute.manager [req-3e087669-3ad9-4655-be9c-f8e53f8e909f req-5ecc5461-b058-41d0-ab32-f52ec67ddcee service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received unexpected event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with vm_state active and task_state rescuing.
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cae77ae7ad9e1826eca1825711becaa414202414.part /opt/stack/data/nova/instances/_base/cae77ae7ad9e1826eca1825711becaa414202414.converted" returned: 0 in 0.400s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cae77ae7ad9e1826eca1825711becaa414202414.converted --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cae77ae7ad9e1826eca1825711becaa414202414.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "cae77ae7ad9e1826eca1825711becaa414202414" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.004s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "cae77ae7ad9e1826eca1825711becaa414202414" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "cae77ae7ad9e1826eca1825711becaa414202414" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cae77ae7ad9e1826eca1825711becaa414202414 --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cae77ae7ad9e1826eca1825711becaa414202414 --force-share --output=json" returned: 0 in 0.181s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cae77ae7ad9e1826eca1825711becaa414202414,backing_fmt=raw /opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f/disk.rescue {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cae77ae7ad9e1826eca1825711becaa414202414,backing_fmt=raw /opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f/disk.rescue" returned: 0 in 0.066s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "cae77ae7ad9e1826eca1825711becaa414202414" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.objects.instance [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'migration_context' on Instance uuid 1591319d-3d15-4c46-b823-4edddf018b5f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.objects.base [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Object Instance<1591319d-3d15-4c46-b823-4edddf018b5f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Start _get_guest_xml network_info=[{"id": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "address": "fa:16:3e:05:00:70", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "vif_mac": "fa:16:3e:05:00:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb04bdd2-29", "ovs_interfaceid": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4bfd9bf2-7eb0-48d9-9ee5-8dcef487c337', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '26690c69-6db5-48db-9c11-665f8fcddd4c', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozvteOKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '1591319d-3d15-4c46-b823-4edddf018b5f', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa627586-2d95-40aa-b153-081b588b0851', 'serial': 'fa627586-2d95-40aa-b153-081b588b0851'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.objects.instance [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'resources' on Instance uuid 1591319d-3d15-4c46-b823-4edddf018b5f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.objects.base [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Object Instance<1591319d-3d15-4c46-b823-4edddf018b5f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.objects.instance [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'numa_topology' on Instance uuid 1591319d-3d15-4c46-b823-4edddf018b5f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.objects.base [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Object Instance<1591319d-3d15-4c46-b823-4edddf018b5f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:28:43 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:28:43 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.objects.instance [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1591319d-3d15-4c46-b823-4edddf018b5f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.objects.base [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Object Instance<1591319d-3d15-4c46-b823-4edddf018b5f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozvteOKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:28:43 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:28:43 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:28:43 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c70502-7f5c-41dd-9c8c-21ca038d332b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ozvteOKM\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 27 02:28:43 user nova-compute[72820]: node.name = iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:28:43 user nova-compute[72820]: node.tpgt = -1
Aug 27 02:28:43 user nova-compute[72820]: node.startup = automatic
Aug 27 02:28:43 user nova-compute[72820]: node.leading_login = No
Aug 27 02:28:43 user nova-compute[72820]: iface.iscsi_ifacename = default
Aug 27 02:28:43 user nova-compute[72820]: iface.net_ifacename = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.ipaddress = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.prefix_len = 0
Aug 27 02:28:43 user nova-compute[72820]: iface.hwaddress = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.transport_name = tcp
Aug 27 02:28:43 user nova-compute[72820]: iface.initiatorname = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.state = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.vlan_id = 0
Aug 27 02:28:43 user nova-compute[72820]: iface.vlan_priority = 0
Aug 27 02:28:43 user nova-compute[72820]: iface.vlan_state = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.iface_num = 0
Aug 27 02:28:43 user nova-compute[72820]: iface.mtu = 0
Aug 27 02:28:43 user nova-compute[72820]: iface.port = 0
Aug 27 02:28:43 user nova-compute[72820]: iface.bootproto = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.subnet_mask = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.gateway = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.dhcp_alt_client_id_state = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.dhcp_alt_client_id = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.dhcp_dns = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.dhcp_learn_iqn = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.dhcp_req_vendor_id_state = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.dhcp_vendor_id_state = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.dhcp_vendor_id = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.dhcp_slp_da = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.fragmentation = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.gratuitous_arp = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.incoming_forwarding = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.tos_state = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.tos = 0
Aug 27 02:28:43 user nova-compute[72820]: iface.ttl = 0
Aug 27 02:28:43 user nova-compute[72820]: iface.delayed_ack = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.tcp_nagle = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.tcp_wsf_state = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.tcp_wsf = 0
Aug 27 02:28:43 user nova-compute[72820]: iface.tcp_timer_scale = 0
Aug 27 02:28:43 user nova-compute[72820]: iface.tcp_timestamp = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.redirect = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.def_task_mgmt_timeout = 0
Aug 27 02:28:43 user nova-compute[72820]: iface.header_digest = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.data_digest = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.immediate_data = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.initial_r2t = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.data_seq_inorder = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.data_pdu_inorder = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.erl = 0
Aug 27 02:28:43 user nova-compute[72820]: iface.max_receive_data_len = 0
Aug 27 02:28:43 user nova-compute[72820]: iface.first_burst_len = 0
Aug 27 02:28:43 user nova-compute[72820]: iface.max_outstanding_r2t = 0
Aug 27 02:28:43 user nova-compute[72820]: iface.max_burst_len = 0
Aug 27 02:28:43 user nova-compute[72820]: iface.chap_auth = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.bidi_chap = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.strict_login_compliance = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.discovery_auth = <empty>
Aug 27 02:28:43 user nova-compute[72820]: iface.discovery_logout = <empty>
Aug 27 02:28:43 user nova-compute[72820]: node.discovery_address = <empty>
Aug 27 02:28:43 user nova-compute[72820]: node.discovery_port = 0
Aug 27 02:28:43 user nova-compute[72820]: node.discovery_type = static
Aug 27 02:28:43 user nova-compute[72820]: node.session.initial_cmdsn = 0
Aug 27 02:28:43 user nova-compute[72820]: node.session.initial_login_retry_max = 8
Aug 27 02:28:43 user nova-compute[72820]: node.session.xmit_thread_priority = -20
Aug 27 02:28:43 user nova-compute[72820]: node.session.cmds_max = 128
Aug 27 02:28:43 user nova-compute[72820]: node.session.queue_depth = 32
Aug 27 02:28:43 user nova-compute[72820]: node.session.nr_sessions = 1
Aug 27 02:28:43 user nova-compute[72820]: node.session.auth.authmethod = CHAP
Aug 27 02:28:43 user nova-compute[72820]: node.session.auth.username = ozvteOKM
Aug 27 02:28:43 user nova-compute[72820]: node.session.auth.password = ***
Aug 27 02:28:43 user nova-compute[72820]: node.session.auth.username_in = <empty>
Aug 27 02:28:43 user nova-compute[72820]: node.session.auth.password_in = <empty>
Aug 27 02:28:43 user nova-compute[72820]: node.session.auth.chap_algs = MD5
Aug 27 02:28:43 user nova-compute[72820]: node.session.timeo.replacement_timeout = 120
Aug 27 02:28:43 user nova-compute[72820]: node.session.err_timeo.abort_timeout = 15
Aug 27 02:28:43 user nova-compute[72820]: node.session.err_timeo.lu_reset_timeout = 30
Aug 27 02:28:43 user nova-compute[72820]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 27 02:28:43 user nova-compute[72820]: node.session.err_timeo.host_reset_timeout = 60
Aug 27 02:28:43 user nova-compute[72820]: node.session.iscsi.FastAbort = Yes
Aug 27 02:28:43 user nova-compute[72820]: node.session.iscsi.InitialR2T = No
Aug 27 02:28:43 user nova-compute[72820]: node.session.iscsi.ImmediateData = Yes
Aug 27 02:28:43 user nova-compute[72820]: node.session.iscsi.FirstBurstLength = 262144
Aug 27 02:28:43 user nova-compute[72820]: node.session.iscsi.MaxBurstLength = 16776192
Aug 27 02:28:43 user nova-compute[72820]: node.session.iscsi.DefaultTime2Retain = 0
Aug 27 02:28:43 user nova-compute[72820]: node.session.iscsi.DefaultTime2Wait = 2
Aug 27 02:28:43 user nova-compute[72820]: node.session.iscsi.MaxConnections = 1
Aug 27 02:28:43 user nova-compute[72820]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 27 02:28:43 user nova-compute[72820]: node.session.iscsi.ERL = 0
Aug 27 02:28:43 user nova-compute[72820]: node.session.scan = manual
Aug 27 02:28:43 user nova-compute[72820]: node.session.reopen_max = 0
Aug 27 02:28:43 user nova-compute[72820]: node.conn[0].address = 172.16.0.220
Aug 27 02:28:43 user nova-compute[72820]: node.conn[0].port = 3260
Aug 27 02:28:43 user nova-compute[72820]: node.conn[0].startup = manual
Aug 27 02:28:43 user nova-compute[72820]: node.conn[0].tcp.window_size = 524288
Aug 27 02:28:43 user nova-compute[72820]: node.conn[0].tcp.type_of_service = 0
Aug 27 02:28:43 user nova-compute[72820]: node.conn[0].timeo.logout_timeout = 15
Aug 27 02:28:43 user nova-compute[72820]: node.conn[0].timeo.login_timeout = 15
Aug 27 02:28:43 user nova-compute[72820]: node.conn[0].timeo.auth_timeout = 45
Aug 27 02:28:43 user nova-compute[72820]: node.conn[0].timeo.noop_out_interval = 5
Aug 27 02:28:43 user nova-compute[72820]: node.conn[0].timeo.noop_out_timeout = 5
Aug 27 02:28:43 user nova-compute[72820]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 27 02:28:43 user nova-compute[72820]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 27 02:28:43 user nova-compute[72820]: node.conn[0].iscsi.HeaderDigest = None
Aug 27 02:28:43 user nova-compute[72820]: node.conn[0].iscsi.DataDigest = None
Aug 27 02:28:43 user nova-compute[72820]: node.conn[0].iscsi.IFMarker = No
Aug 27 02:28:43 user nova-compute[72820]: node.conn[0].iscsi.OFMarker = No
Aug 27 02:28:43 user nova-compute[72820]: # END RECORD
Aug 27 02:28:43 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a74ab2e-7cb3-41dd-8cd2-619e1f2a2a08]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faa4b04-88f1-44dd-9cf2-79811117bf44]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ozvteOKM {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ozvteOKM" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36da709-3d8c-43ce-a18e-ca72ca3f0f80]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ozvteOKM'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6249ad99-2b7f-414d-9a92-a77f46ee7b0e]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e787d92-8203-463b-8935-c05c5810ac7e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:28:43 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:28:43 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:28:43 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:28:43 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:28:43 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:28:43 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:28:43 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:28:43 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:28:43 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:28:43 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:28:43 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:28:43 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:28:43 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:28:43 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.175s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] HCTL ('37', '0', '0', 0) found on session 19 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc8739c-342b-4355-954e-a7d195be23e3]: (4, ('0 0 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Searching for a device in session 19 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozvteOKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.201s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] <== connect_volume: return (202ms) {'type': 'block', 'scsi_wwn': '26661636461393865', 'path': '/dev/sdf'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661636461393865', 'path': '/dev/sdf'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:26:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-485924818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-485924818',id=17,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:27:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f023daf1767f4088bf0a23524587e662',ramdisk_id='',reservation_id='r-pt18thix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:27:20Z,user_data=None,user_id='bb67e11ecdd648a89dd58b4bf416060a',uuid=1591319d-3d15-4c46-b823-4edddf018b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "address": "fa:16:3e:05:00:70", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "vif_mac": "fa:16:3e:05:00:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb04bdd2-29", "ovs_interfaceid": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converting VIF {"id": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "address": "fa:16:3e:05:00:70", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "vif_mac": "fa:16:3e:05:00:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb04bdd2-29", "ovs_interfaceid": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:00:70,bridge_name='br-int',has_traffic_filtering=True,id=db04bdd2-29ba-41ba-a78f-ab10b81ae54e,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb04bdd2-29') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.objects.instance [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'pci_devices' on Instance uuid 1591319d-3d15-4c46-b823-4edddf018b5f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.objects.base [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Object Instance<1591319d-3d15-4c46-b823-4edddf018b5f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:28:43 user nova-compute[72820]:   <uuid>1591319d-3d15-4c46-b823-4edddf018b5f</uuid>
Aug 27 02:28:43 user nova-compute[72820]:   <name>instance-00000011</name>
Aug 27 02:28:43 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:28:43 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:28:43 user nova-compute[72820]:   <metadata>
Aug 27 02:28:43 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:28:43 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:28:43 user nova-compute[72820]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-485924818</nova:name>
Aug 27 02:28:43 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:28:43</nova:creationTime>
Aug 27 02:28:43 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:28:43 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:28:43 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:28:43 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:28:43 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:28:43 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:28:43 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:28:43 user nova-compute[72820]:       <nova:owner>
Aug 27 02:28:43 user nova-compute[72820]:         <nova:user uuid="bb67e11ecdd648a89dd58b4bf416060a">tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member</nova:user>
Aug 27 02:28:43 user nova-compute[72820]:         <nova:project uuid="f023daf1767f4088bf0a23524587e662">tempest-ServerBootFromVolumeStableRescueTest-2088708325</nova:project>
Aug 27 02:28:43 user nova-compute[72820]:       </nova:owner>
Aug 27 02:28:43 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:28:43 user nova-compute[72820]:       <nova:ports>
Aug 27 02:28:43 user nova-compute[72820]:         <nova:port uuid="db04bdd2-29ba-41ba-a78f-ab10b81ae54e">
Aug 27 02:28:43 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 02:28:43 user nova-compute[72820]:         </nova:port>
Aug 27 02:28:43 user nova-compute[72820]:       </nova:ports>
Aug 27 02:28:43 user nova-compute[72820]:     </nova:instance>
Aug 27 02:28:43 user nova-compute[72820]:   </metadata>
Aug 27 02:28:43 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:28:43 user nova-compute[72820]:     <system>
Aug 27 02:28:43 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:28:43 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:28:43 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:28:43 user nova-compute[72820]:       <entry name="serial">1591319d-3d15-4c46-b823-4edddf018b5f</entry>
Aug 27 02:28:43 user nova-compute[72820]:       <entry name="uuid">1591319d-3d15-4c46-b823-4edddf018b5f</entry>
Aug 27 02:28:43 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:28:43 user nova-compute[72820]:     </system>
Aug 27 02:28:43 user nova-compute[72820]:   </sysinfo>
Aug 27 02:28:43 user nova-compute[72820]:   <os>
Aug 27 02:28:43 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:28:43 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:28:43 user nova-compute[72820]:   </os>
Aug 27 02:28:43 user nova-compute[72820]:   <features>
Aug 27 02:28:43 user nova-compute[72820]:     <acpi/>
Aug 27 02:28:43 user nova-compute[72820]:     <apic/>
Aug 27 02:28:43 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:28:43 user nova-compute[72820]:   </features>
Aug 27 02:28:43 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:28:43 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:28:43 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:28:43 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:28:43 user nova-compute[72820]:   </clock>
Aug 27 02:28:43 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:28:43 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:28:43 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:28:43 user nova-compute[72820]:   </cpu>
Aug 27 02:28:43 user nova-compute[72820]:   <devices>
Aug 27 02:28:43 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:28:43 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:28:43 user nova-compute[72820]:       <source dev="/dev/sdf"/>
Aug 27 02:28:43 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:28:43 user nova-compute[72820]:       <serial>fa627586-2d95-40aa-b153-081b588b0851</serial>
Aug 27 02:28:43 user nova-compute[72820]:     </disk>
Aug 27 02:28:43 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:28:43 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:28:43 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f/disk.rescue"/>
Aug 27 02:28:43 user nova-compute[72820]:       <target dev="vdb" bus="virtio"/>
Aug 27 02:28:43 user nova-compute[72820]:       <boot order="1"/>
Aug 27 02:28:43 user nova-compute[72820]:     </disk>
Aug 27 02:28:43 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:28:43 user nova-compute[72820]:       <mac address="fa:16:3e:05:00:70"/>
Aug 27 02:28:43 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:28:43 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:28:43 user nova-compute[72820]:       <target dev="tapdb04bdd2-29"/>
Aug 27 02:28:43 user nova-compute[72820]:     </interface>
Aug 27 02:28:43 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:28:43 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f/console.log" append="off"/>
Aug 27 02:28:43 user nova-compute[72820]:     </serial>
Aug 27 02:28:43 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:28:43 user nova-compute[72820]:     <video>
Aug 27 02:28:43 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:28:43 user nova-compute[72820]:     </video>
Aug 27 02:28:43 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:28:43 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:28:43 user nova-compute[72820]:     </rng>
Aug 27 02:28:43 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:28:43 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:28:43 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:28:43 user nova-compute[72820]:     </memballoon>
Aug 27 02:28:43 user nova-compute[72820]:   </devices>
Aug 27 02:28:43 user nova-compute[72820]: </domain>
Aug 27 02:28:43 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:28:43 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Instance destroyed successfully.
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:28:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] No VIF found with MAC fa:16:3e:05:00:70, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:28:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-efcfefda-ac56-4b54-bcc2-4f1a0d14ce22 req-fbd30a8d-52ec-4657-be81-d0057da1caeb service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-efcfefda-ac56-4b54-bcc2-4f1a0d14ce22 req-fbd30a8d-52ec-4657-be81-d0057da1caeb service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-efcfefda-ac56-4b54-bcc2-4f1a0d14ce22 req-fbd30a8d-52ec-4657-be81-d0057da1caeb service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-efcfefda-ac56-4b54-bcc2-4f1a0d14ce22 req-fbd30a8d-52ec-4657-be81-d0057da1caeb service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-efcfefda-ac56-4b54-bcc2-4f1a0d14ce22 req-fbd30a8d-52ec-4657-be81-d0057da1caeb service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:28:45 user nova-compute[72820]: WARNING nova.compute.manager [req-efcfefda-ac56-4b54-bcc2-4f1a0d14ce22 req-fbd30a8d-52ec-4657-be81-d0057da1caeb service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received unexpected event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with vm_state active and task_state rescuing.
Aug 27 02:28:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Removed pending event for 1591319d-3d15-4c46-b823-4edddf018b5f due to event {{(pid=72820) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 02:28:47 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103327.632596, 1591319d-3d15-4c46-b823-4edddf018b5f => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:28:47 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] VM Resumed (Lifecycle Event)
Aug 27 02:28:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-52641d99-046d-4eb4-8f1a-1af431bfb8a9 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:28:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:28:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:28:47 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 02:28:47 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103327.6343184, 1591319d-3d15-4c46-b823-4edddf018b5f => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:28:47 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] VM Started (Lifecycle Event)
Aug 27 02:28:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:28:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:28:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-2f9dd2a5-e543-4cc4-bc41-b1cfae4f30cd req-a517488e-4729-45e7-968e-141d6d20b6b2 service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2f9dd2a5-e543-4cc4-bc41-b1cfae4f30cd req-a517488e-4729-45e7-968e-141d6d20b6b2 service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2f9dd2a5-e543-4cc4-bc41-b1cfae4f30cd req-a517488e-4729-45e7-968e-141d6d20b6b2 service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2f9dd2a5-e543-4cc4-bc41-b1cfae4f30cd req-a517488e-4729-45e7-968e-141d6d20b6b2 service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-2f9dd2a5-e543-4cc4-bc41-b1cfae4f30cd req-a517488e-4729-45e7-968e-141d6d20b6b2 service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:28:48 user nova-compute[72820]: WARNING nova.compute.manager [req-2f9dd2a5-e543-4cc4-bc41-b1cfae4f30cd req-a517488e-4729-45e7-968e-141d6d20b6b2 service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received unexpected event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with vm_state rescued and task_state None.
Aug 27 02:28:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-2f9dd2a5-e543-4cc4-bc41-b1cfae4f30cd req-a517488e-4729-45e7-968e-141d6d20b6b2 service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Received event network-changed-d901c17c-746e-41ac-8066-cb1d4c4b0d69 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-2f9dd2a5-e543-4cc4-bc41-b1cfae4f30cd req-a517488e-4729-45e7-968e-141d6d20b6b2 service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Refreshing instance network info cache due to event network-changed-d901c17c-746e-41ac-8066-cb1d4c4b0d69. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:28:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2f9dd2a5-e543-4cc4-bc41-b1cfae4f30cd req-a517488e-4729-45e7-968e-141d6d20b6b2 service nova] Acquiring lock "refresh_cache-7c42c4ae-0f80-4295-a64e-b426225b94c5" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:28:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2f9dd2a5-e543-4cc4-bc41-b1cfae4f30cd req-a517488e-4729-45e7-968e-141d6d20b6b2 service nova] Acquired lock "refresh_cache-7c42c4ae-0f80-4295-a64e-b426225b94c5" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:28:48 user nova-compute[72820]: DEBUG nova.network.neutron [req-2f9dd2a5-e543-4cc4-bc41-b1cfae4f30cd req-a517488e-4729-45e7-968e-141d6d20b6b2 service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Refreshing network info cache for port d901c17c-746e-41ac-8066-cb1d4c4b0d69 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:28:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:48 user nova-compute[72820]: DEBUG nova.network.neutron [req-2f9dd2a5-e543-4cc4-bc41-b1cfae4f30cd req-a517488e-4729-45e7-968e-141d6d20b6b2 service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Updated VIF entry in instance network info cache for port d901c17c-746e-41ac-8066-cb1d4c4b0d69. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:28:48 user nova-compute[72820]: DEBUG nova.network.neutron [req-2f9dd2a5-e543-4cc4-bc41-b1cfae4f30cd req-a517488e-4729-45e7-968e-141d6d20b6b2 service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Updating instance_info_cache with network_info: [{"id": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "address": "fa:16:3e:51:e5:4a", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd901c17c-74", "ovs_interfaceid": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:28:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2f9dd2a5-e543-4cc4-bc41-b1cfae4f30cd req-a517488e-4729-45e7-968e-141d6d20b6b2 service nova] Releasing lock "refresh_cache-7c42c4ae-0f80-4295-a64e-b426225b94c5" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:28:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "89b66e95-2333-403b-b338-6096717ca20d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:28:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:50 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:28:50 user nova-compute[72820]: INFO nova.compute.claims [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Claim successful on node user
Aug 27 02:28:50 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:28:50 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG nova.compute.manager [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG nova.compute.manager [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG nova.network.neutron [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:28:51 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:28:51 user nova-compute[72820]: DEBUG nova.compute.manager [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG nova.policy [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7f59dea3a6f4315828320a9ae6c721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca683dd78dbf41ec8fbe3d3f76011272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG nova.compute.manager [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:28:51 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Creating image(s)
Aug 27 02:28:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "/opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "/opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "/opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.199s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.197s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk 1073741824" returned: 0 in 0.072s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:51 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.212s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:52 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:28:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:52 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Cannot resize image /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:28:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:28:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Ensure instance console log exists: /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:28:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:52 user nova-compute[72820]: DEBUG nova.network.neutron [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Successfully created port: 91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:28:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "7c42c4ae-0f80-4295-a64e-b426225b94c5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:52 user nova-compute[72820]: DEBUG nova.objects.instance [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lazy-loading 'flavor' on Instance uuid 7c42c4ae-0f80-4295-a64e-b426225b94c5 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:28:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "7c42c4ae-0f80-4295-a64e-b426225b94c5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:53 user nova-compute[72820]: INFO nova.compute.manager [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Attaching volume 7f54d67e-9b9b-4140-ac63-de051a936db7 to /dev/vdb
Aug 27 02:28:53 user nova-compute[72820]: DEBUG os_brick.utils [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4645ea93-2163-4a2c-acca-a250fabeb525]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d42347-54b3-43d4-b307-2bc4a23b2df4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[103ab42e-3a55-409a-a173-45c8ee94222b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8f9237-ce92-4d64-b4bf-bfaa42360697]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:28:53 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e6e90e-f2ba-4484-87e7-1d54287968a1]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG os_brick.utils [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Updating existing volume attachment record: a9c6396c-a84a-4db9-99c7-558034a1758f {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG nova.network.neutron [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Successfully updated port: 91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquired lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG nova.network.neutron [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-33012474-81fc-456b-8d27-ab447c8ea650 req-5b7ee036-2f61-4fa5-bb94-ddfa636a6c88 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-changed-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-33012474-81fc-456b-8d27-ab447c8ea650 req-5b7ee036-2f61-4fa5-bb94-ddfa636a6c88 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Refreshing instance network info cache due to event network-changed-91356c13-2f8e-4c32-993c-98aa52345f86. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-33012474-81fc-456b-8d27-ab447c8ea650 req-5b7ee036-2f61-4fa5-bb94-ddfa636a6c88 service nova] Acquiring lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:28:53 user nova-compute[72820]: DEBUG nova.network.neutron [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-e21f08c4-ee6a-47fc-99ff-f6e5fe1d2411 req-505569b8-71cc-445e-8ff6-f8d09cbf8cc1 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-changed-82460091-aebf-4691-a20c-d7c0affbbba0 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-e21f08c4-ee6a-47fc-99ff-f6e5fe1d2411 req-505569b8-71cc-445e-8ff6-f8d09cbf8cc1 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Refreshing instance network info cache due to event network-changed-82460091-aebf-4691-a20c-d7c0affbbba0. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e21f08c4-ee6a-47fc-99ff-f6e5fe1d2411 req-505569b8-71cc-445e-8ff6-f8d09cbf8cc1 service nova] Acquiring lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e21f08c4-ee6a-47fc-99ff-f6e5fe1d2411 req-505569b8-71cc-445e-8ff6-f8d09cbf8cc1 service nova] Acquired lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.network.neutron [req-e21f08c4-ee6a-47fc-99ff-f6e5fe1d2411 req-505569b8-71cc-445e-8ff6-f8d09cbf8cc1 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Refreshing network info cache for port 82460091-aebf-4691-a20c-d7c0affbbba0 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.network.neutron [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Updating instance_info_cache with network_info: [{"id": "91356c13-2f8e-4c32-993c-98aa52345f86", "address": "fa:16:3e:d1:90:a2", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91356c13-2f", "ovs_interfaceid": "91356c13-2f8e-4c32-993c-98aa52345f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Releasing lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Instance network_info: |[{"id": "91356c13-2f8e-4c32-993c-98aa52345f86", "address": "fa:16:3e:d1:90:a2", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91356c13-2f", "ovs_interfaceid": "91356c13-2f8e-4c32-993c-98aa52345f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-33012474-81fc-456b-8d27-ab447c8ea650 req-5b7ee036-2f61-4fa5-bb94-ddfa636a6c88 service nova] Acquired lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.network.neutron [req-33012474-81fc-456b-8d27-ab447c8ea650 req-5b7ee036-2f61-4fa5-bb94-ddfa636a6c88 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Refreshing network info cache for port 91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Start _get_guest_xml network_info=[{"id": "91356c13-2f8e-4c32-993c-98aa52345f86", "address": "fa:16:3e:d1:90:a2", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91356c13-2f", "ovs_interfaceid": "91356c13-2f8e-4c32-993c-98aa52345f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:28:54 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:28:54 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-355823437',display_name='tempest-ServerRescueNegativeTestJSON-server-355823437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-355823437',id=21,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz2mFD6VeJVeEVU4bU7rJ7+CBdqVCOpfH1WB5wQSUW8kAHES+nnx5GM+Ktt607QK8GYcW4ial+97ZltS3YdvZfuAyIWSeVL4sJV6+ADDwbebun0Ev2EoMYbmwQuwXYxjQ==',key_name='tempest-keypair-1667560198',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca683dd78dbf41ec8fbe3d3f76011272',ramdisk_id='',reservation_id='r-7v09jyny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1600105144',owner_user_name='tempest-ServerRescueNegativeTestJSON-1600105144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:28:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7f59dea3a6f4315828320a9ae6c721d',uuid=89b66e95-2333-403b-b338-6096717ca20d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91356c13-2f8e-4c32-993c-98aa52345f86", "address": "fa:16:3e:d1:90:a2", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91356c13-2f", "ovs_interfaceid": "91356c13-2f8e-4c32-993c-98aa52345f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converting VIF {"id": "91356c13-2f8e-4c32-993c-98aa52345f86", "address": "fa:16:3e:d1:90:a2", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91356c13-2f", "ovs_interfaceid": "91356c13-2f8e-4c32-993c-98aa52345f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:90:a2,bridge_name='br-int',has_traffic_filtering=True,id=91356c13-2f8e-4c32-993c-98aa52345f86,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91356c13-2f') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.objects.instance [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'pci_devices' on Instance uuid 89b66e95-2333-403b-b338-6096717ca20d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:28:54 user nova-compute[72820]:   <uuid>89b66e95-2333-403b-b338-6096717ca20d</uuid>
Aug 27 02:28:54 user nova-compute[72820]:   <name>instance-00000015</name>
Aug 27 02:28:54 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:28:54 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:28:54 user nova-compute[72820]:   <metadata>
Aug 27 02:28:54 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:28:54 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:28:54 user nova-compute[72820]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-355823437</nova:name>
Aug 27 02:28:54 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:28:54</nova:creationTime>
Aug 27 02:28:54 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:28:54 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:28:54 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:28:54 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:28:54 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:28:54 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:28:54 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:28:54 user nova-compute[72820]:       <nova:owner>
Aug 27 02:28:54 user nova-compute[72820]:         <nova:user uuid="a7f59dea3a6f4315828320a9ae6c721d">tempest-ServerRescueNegativeTestJSON-1600105144-project-member</nova:user>
Aug 27 02:28:54 user nova-compute[72820]:         <nova:project uuid="ca683dd78dbf41ec8fbe3d3f76011272">tempest-ServerRescueNegativeTestJSON-1600105144</nova:project>
Aug 27 02:28:54 user nova-compute[72820]:       </nova:owner>
Aug 27 02:28:54 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:28:54 user nova-compute[72820]:       <nova:ports>
Aug 27 02:28:54 user nova-compute[72820]:         <nova:port uuid="91356c13-2f8e-4c32-993c-98aa52345f86">
Aug 27 02:28:54 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 02:28:54 user nova-compute[72820]:         </nova:port>
Aug 27 02:28:54 user nova-compute[72820]:       </nova:ports>
Aug 27 02:28:54 user nova-compute[72820]:     </nova:instance>
Aug 27 02:28:54 user nova-compute[72820]:   </metadata>
Aug 27 02:28:54 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:28:54 user nova-compute[72820]:     <system>
Aug 27 02:28:54 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:28:54 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:28:54 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:28:54 user nova-compute[72820]:       <entry name="serial">89b66e95-2333-403b-b338-6096717ca20d</entry>
Aug 27 02:28:54 user nova-compute[72820]:       <entry name="uuid">89b66e95-2333-403b-b338-6096717ca20d</entry>
Aug 27 02:28:54 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:28:54 user nova-compute[72820]:     </system>
Aug 27 02:28:54 user nova-compute[72820]:   </sysinfo>
Aug 27 02:28:54 user nova-compute[72820]:   <os>
Aug 27 02:28:54 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:28:54 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:28:54 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:28:54 user nova-compute[72820]:   </os>
Aug 27 02:28:54 user nova-compute[72820]:   <features>
Aug 27 02:28:54 user nova-compute[72820]:     <acpi/>
Aug 27 02:28:54 user nova-compute[72820]:     <apic/>
Aug 27 02:28:54 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:28:54 user nova-compute[72820]:   </features>
Aug 27 02:28:54 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:28:54 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:28:54 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:28:54 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:28:54 user nova-compute[72820]:   </clock>
Aug 27 02:28:54 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:28:54 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:28:54 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:28:54 user nova-compute[72820]:   </cpu>
Aug 27 02:28:54 user nova-compute[72820]:   <devices>
Aug 27 02:28:54 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:28:54 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:28:54 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk"/>
Aug 27 02:28:54 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:28:54 user nova-compute[72820]:     </disk>
Aug 27 02:28:54 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:28:54 user nova-compute[72820]:       <mac address="fa:16:3e:d1:90:a2"/>
Aug 27 02:28:54 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:28:54 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:28:54 user nova-compute[72820]:       <target dev="tap91356c13-2f"/>
Aug 27 02:28:54 user nova-compute[72820]:     </interface>
Aug 27 02:28:54 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:28:54 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/console.log" append="off"/>
Aug 27 02:28:54 user nova-compute[72820]:     </serial>
Aug 27 02:28:54 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:28:54 user nova-compute[72820]:     <video>
Aug 27 02:28:54 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:28:54 user nova-compute[72820]:     </video>
Aug 27 02:28:54 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:28:54 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:28:54 user nova-compute[72820]:     </rng>
Aug 27 02:28:54 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:28:54 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:28:54 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:28:54 user nova-compute[72820]:     </memballoon>
Aug 27 02:28:54 user nova-compute[72820]:   </devices>
Aug 27 02:28:54 user nova-compute[72820]: </domain>
Aug 27 02:28:54 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-355823437',display_name='tempest-ServerRescueNegativeTestJSON-server-355823437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-355823437',id=21,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz2mFD6VeJVeEVU4bU7rJ7+CBdqVCOpfH1WB5wQSUW8kAHES+nnx5GM+Ktt607QK8GYcW4ial+97ZltS3YdvZfuAyIWSeVL4sJV6+ADDwbebun0Ev2EoMYbmwQuwXYxjQ==',key_name='tempest-keypair-1667560198',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca683dd78dbf41ec8fbe3d3f76011272',ramdisk_id='',reservation_id='r-7v09jyny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1600105144',owner_user_name='tempest-ServerRescueNegativeTestJSON-1600105144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:28:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7f59dea3a6f4315828320a9ae6c721d',uuid=89b66e95-2333-403b-b338-6096717ca20d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91356c13-2f8e-4c32-993c-98aa52345f86", "address": "fa:16:3e:d1:90:a2", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91356c13-2f", "ovs_interfaceid": "91356c13-2f8e-4c32-993c-98aa52345f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converting VIF {"id": "91356c13-2f8e-4c32-993c-98aa52345f86", "address": "fa:16:3e:d1:90:a2", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91356c13-2f", "ovs_interfaceid": "91356c13-2f8e-4c32-993c-98aa52345f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:90:a2,bridge_name='br-int',has_traffic_filtering=True,id=91356c13-2f8e-4c32-993c-98aa52345f86,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91356c13-2f') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG os_vif [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:90:a2,bridge_name='br-int',has_traffic_filtering=True,id=91356c13-2f8e-4c32-993c-98aa52345f86,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91356c13-2f') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91356c13-2f, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91356c13-2f, col_values=(('external_ids', {'iface-id': '91356c13-2f8e-4c32-993c-98aa52345f86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:90:a2', 'vm-uuid': '89b66e95-2333-403b-b338-6096717ca20d'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:54 user nova-compute[72820]: INFO os_vif [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:90:a2,bridge_name='br-int',has_traffic_filtering=True,id=91356c13-2f8e-4c32-993c-98aa52345f86,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91356c13-2f')
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] No VIF found with MAC fa:16:3e:d1:90:a2, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.network.neutron [req-e21f08c4-ee6a-47fc-99ff-f6e5fe1d2411 req-505569b8-71cc-445e-8ff6-f8d09cbf8cc1 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Updated VIF entry in instance network info cache for port 82460091-aebf-4691-a20c-d7c0affbbba0. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG nova.network.neutron [req-e21f08c4-ee6a-47fc-99ff-f6e5fe1d2411 req-505569b8-71cc-445e-8ff6-f8d09cbf8cc1 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Updating instance_info_cache with network_info: [{"id": "82460091-aebf-4691-a20c-d7c0affbbba0", "address": "fa:16:3e:27:73:18", "network": {"id": "3c12368b-d5bc-4102-bff5-87b009efa11e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1403358780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82460091-ae", "ovs_interfaceid": "82460091-aebf-4691-a20c-d7c0affbbba0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "address": "fa:16:3e:4b:0b:e4", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1647fafb-02", "ovs_interfaceid": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "address": "fa:16:3e:ea:a2:5b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2ff677-b9", "ovs_interfaceid": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "address": "fa:16:3e:21:74:13", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9aa8aa-1d", "ovs_interfaceid": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "966580e7-4512-4064-aa4e-c78c12545f99", "address": "fa:16:3e:35:a4:3b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966580e7-45", "ovs_interfaceid": "966580e7-4512-4064-aa4e-c78c12545f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b13d4895-4841-4176-b770-88848fc8e5e2", "address": "fa:16:3e:0e:f0:9d", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13d4895-48", "ovs_interfaceid": "b13d4895-4841-4176-b770-88848fc8e5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "address": "fa:16:3e:6c:bd:3e", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ea855b-ce", "ovs_interfaceid": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:28:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e21f08c4-ee6a-47fc-99ff-f6e5fe1d2411 req-505569b8-71cc-445e-8ff6-f8d09cbf8cc1 service nova] Releasing lock "refresh_cache-edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:28:55 user nova-compute[72820]: DEBUG nova.network.neutron [req-33012474-81fc-456b-8d27-ab447c8ea650 req-5b7ee036-2f61-4fa5-bb94-ddfa636a6c88 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Updated VIF entry in instance network info cache for port 91356c13-2f8e-4c32-993c-98aa52345f86. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:28:55 user nova-compute[72820]: DEBUG nova.network.neutron [req-33012474-81fc-456b-8d27-ab447c8ea650 req-5b7ee036-2f61-4fa5-bb94-ddfa636a6c88 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Updating instance_info_cache with network_info: [{"id": "91356c13-2f8e-4c32-993c-98aa52345f86", "address": "fa:16:3e:d1:90:a2", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91356c13-2f", "ovs_interfaceid": "91356c13-2f8e-4c32-993c-98aa52345f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:28:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-33012474-81fc-456b-8d27-ab447c8ea650 req-5b7ee036-2f61-4fa5-bb94-ddfa636a6c88 service nova] Releasing lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:28:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:56 user nova-compute[72820]: DEBUG nova.compute.manager [req-5396c5f3-d117-4e64-ac24-eb7d73f8548a req-dccccb4c-0437-4f10-b1f2-1974561073fd service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5396c5f3-d117-4e64-ac24-eb7d73f8548a req-dccccb4c-0437-4f10-b1f2-1974561073fd service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5396c5f3-d117-4e64-ac24-eb7d73f8548a req-dccccb4c-0437-4f10-b1f2-1974561073fd service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5396c5f3-d117-4e64-ac24-eb7d73f8548a req-dccccb4c-0437-4f10-b1f2-1974561073fd service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:56 user nova-compute[72820]: DEBUG nova.compute.manager [req-5396c5f3-d117-4e64-ac24-eb7d73f8548a req-dccccb4c-0437-4f10-b1f2-1974561073fd service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:28:56 user nova-compute[72820]: WARNING nova.compute.manager [req-5396c5f3-d117-4e64-ac24-eb7d73f8548a req-dccccb4c-0437-4f10-b1f2-1974561073fd service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state building and task_state spawning.
Aug 27 02:28:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:57 user nova-compute[72820]: INFO nova.compute.manager [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Terminating instance
Aug 27 02:28:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:28:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-c53e5f8e-b3ea-47a5-bdb6-2805ff6f34f7 req-fcc65ce9-a06e-4e79-a981-c65e05b4dba5 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c53e5f8e-b3ea-47a5-bdb6-2805ff6f34f7 req-fcc65ce9-a06e-4e79-a981-c65e05b4dba5 service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c53e5f8e-b3ea-47a5-bdb6-2805ff6f34f7 req-fcc65ce9-a06e-4e79-a981-c65e05b4dba5 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c53e5f8e-b3ea-47a5-bdb6-2805ff6f34f7 req-fcc65ce9-a06e-4e79-a981-c65e05b4dba5 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-c53e5f8e-b3ea-47a5-bdb6-2805ff6f34f7 req-fcc65ce9-a06e-4e79-a981-c65e05b4dba5 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:28:58 user nova-compute[72820]: WARNING nova.compute.manager [req-c53e5f8e-b3ea-47a5-bdb6-2805ff6f34f7 req-fcc65ce9-a06e-4e79-a981-c65e05b4dba5 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state building and task_state spawning.
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-c53e5f8e-b3ea-47a5-bdb6-2805ff6f34f7 req-fcc65ce9-a06e-4e79-a981-c65e05b4dba5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-unplugged-82460091-aebf-4691-a20c-d7c0affbbba0 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c53e5f8e-b3ea-47a5-bdb6-2805ff6f34f7 req-fcc65ce9-a06e-4e79-a981-c65e05b4dba5 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c53e5f8e-b3ea-47a5-bdb6-2805ff6f34f7 req-fcc65ce9-a06e-4e79-a981-c65e05b4dba5 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c53e5f8e-b3ea-47a5-bdb6-2805ff6f34f7 req-fcc65ce9-a06e-4e79-a981-c65e05b4dba5 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-c53e5f8e-b3ea-47a5-bdb6-2805ff6f34f7 req-fcc65ce9-a06e-4e79-a981-c65e05b4dba5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-unplugged-82460091-aebf-4691-a20c-d7c0affbbba0 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-c53e5f8e-b3ea-47a5-bdb6-2805ff6f34f7 req-fcc65ce9-a06e-4e79-a981-c65e05b4dba5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-unplugged-82460091-aebf-4691-a20c-d7c0affbbba0 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-bcc18df1-5feb-458c-8112-c0867119fc08 req-d05d75fe-7fed-4d8b-9e49-be8ad78c4317 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-unplugged-1647fafb-02da-4fa5-a62f-d43919dd49a6 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bcc18df1-5feb-458c-8112-c0867119fc08 req-d05d75fe-7fed-4d8b-9e49-be8ad78c4317 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bcc18df1-5feb-458c-8112-c0867119fc08 req-d05d75fe-7fed-4d8b-9e49-be8ad78c4317 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bcc18df1-5feb-458c-8112-c0867119fc08 req-d05d75fe-7fed-4d8b-9e49-be8ad78c4317 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-bcc18df1-5feb-458c-8112-c0867119fc08 req-d05d75fe-7fed-4d8b-9e49-be8ad78c4317 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-unplugged-1647fafb-02da-4fa5-a62f-d43919dd49a6 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-bcc18df1-5feb-458c-8112-c0867119fc08 req-d05d75fe-7fed-4d8b-9e49-be8ad78c4317 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-unplugged-1647fafb-02da-4fa5-a62f-d43919dd49a6 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-691886a0-eae0-4229-b031-4af0aa320a55 req-977e1fdc-0f57-4c7c-9725-2bc49c83f4b3 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-unplugged-4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-691886a0-eae0-4229-b031-4af0aa320a55 req-977e1fdc-0f57-4c7c-9725-2bc49c83f4b3 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-691886a0-eae0-4229-b031-4af0aa320a55 req-977e1fdc-0f57-4c7c-9725-2bc49c83f4b3 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-691886a0-eae0-4229-b031-4af0aa320a55 req-977e1fdc-0f57-4c7c-9725-2bc49c83f4b3 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-691886a0-eae0-4229-b031-4af0aa320a55 req-977e1fdc-0f57-4c7c-9725-2bc49c83f4b3 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-unplugged-4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-691886a0-eae0-4229-b031-4af0aa320a55 req-977e1fdc-0f57-4c7c-9725-2bc49c83f4b3 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-unplugged-4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103338.8573058, 89b66e95-2333-403b-b338-6096717ca20d => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:28:58 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] VM Resumed (Lifecycle Event)
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:28:58 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Instance spawned successfully.
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:28:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:58 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:28:58 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103338.8586311, 89b66e95-2333-403b-b338-6096717ca20d => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:28:58 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] VM Started (Lifecycle Event)
Aug 27 02:28:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:28:59 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:28:59 user nova-compute[72820]: INFO nova.compute.manager [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Took 7.83 seconds to spawn the instance on the hypervisor.
Aug 27 02:28:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:59 user nova-compute[72820]: INFO nova.compute.manager [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Took 8.90 seconds to build instance.
Aug 27 02:28:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1060dfff-a35a-409c-a68c-2e875133d56a tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "89b66e95-2333-403b-b338-6096717ca20d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.130s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:59 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Instance destroyed successfully.
Aug 27 02:28:59 user nova-compute[72820]: DEBUG nova.objects.instance [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lazy-loading 'resources' on Instance uuid edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:27:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:27:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82460091-aebf-4691-a20c-d7c0affbbba0", "address": "fa:16:3e:27:73:18", "network": {"id": "3c12368b-d5bc-4102-bff5-87b009efa11e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1403358780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82460091-ae", "ovs_interfaceid": "82460091-aebf-4691-a20c-d7c0affbbba0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "82460091-aebf-4691-a20c-d7c0affbbba0", "address": "fa:16:3e:27:73:18", "network": {"id": "3c12368b-d5bc-4102-bff5-87b009efa11e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1403358780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82460091-ae", "ovs_interfaceid": "82460091-aebf-4691-a20c-d7c0affbbba0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:73:18,bridge_name='br-int',has_traffic_filtering=True,id=82460091-aebf-4691-a20c-d7c0affbbba0,network=Network(3c12368b-d5bc-4102-bff5-87b009efa11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82460091-ae') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG os_vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:73:18,bridge_name='br-int',has_traffic_filtering=True,id=82460091-aebf-4691-a20c-d7c0affbbba0,network=Network(3c12368b-d5bc-4102-bff5-87b009efa11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82460091-ae') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82460091-ae, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:59 user nova-compute[72820]: INFO os_vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:73:18,bridge_name='br-int',has_traffic_filtering=True,id=82460091-aebf-4691-a20c-d7c0affbbba0,network=Network(3c12368b-d5bc-4102-bff5-87b009efa11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82460091-ae')
Aug 27 02:28:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:27:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:27:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "address": "fa:16:3e:4b:0b:e4", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1647fafb-02", "ovs_interfaceid": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "address": "fa:16:3e:4b:0b:e4", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1647fafb-02", "ovs_interfaceid": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0b:e4,bridge_name='br-int',has_traffic_filtering=True,id=1647fafb-02da-4fa5-a62f-d43919dd49a6,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1647fafb-02') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG os_vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0b:e4,bridge_name='br-int',has_traffic_filtering=True,id=1647fafb-02da-4fa5-a62f-d43919dd49a6,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1647fafb-02') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1647fafb-02, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:59 user nova-compute[72820]: INFO os_vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0b:e4,bridge_name='br-int',has_traffic_filtering=True,id=1647fafb-02da-4fa5-a62f-d43919dd49a6,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1647fafb-02')
Aug 27 02:28:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:27:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:27:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "address": "fa:16:3e:ea:a2:5b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2ff677-b9", "ovs_interfaceid": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "address": "fa:16:3e:ea:a2:5b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2ff677-b9", "ovs_interfaceid": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a2:5b,bridge_name='br-int',has_traffic_filtering=True,id=4c2ff677-b994-41bc-94e5-e542ad18fb4e,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c2ff677-b9') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG os_vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a2:5b,bridge_name='br-int',has_traffic_filtering=True,id=4c2ff677-b994-41bc-94e5-e542ad18fb4e,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c2ff677-b9') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c2ff677-b9, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:28:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:00 user nova-compute[72820]: INFO os_vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a2:5b,bridge_name='br-int',has_traffic_filtering=True,id=4c2ff677-b994-41bc-94e5-e542ad18fb4e,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c2ff677-b9')
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:27:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:27:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "address": "fa:16:3e:21:74:13", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9aa8aa-1d", "ovs_interfaceid": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "address": "fa:16:3e:21:74:13", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9aa8aa-1d", "ovs_interfaceid": "4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:74:13,bridge_name='br-int',has_traffic_filtering=True,id=4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9aa8aa-1d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:74:13,bridge_name='br-int',has_traffic_filtering=True,id=4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9aa8aa-1d') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d9aa8aa-1d, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:00 user nova-compute[72820]: INFO os_vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:74:13,bridge_name='br-int',has_traffic_filtering=True,id=4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9aa8aa-1d')
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:27:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:27:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "966580e7-4512-4064-aa4e-c78c12545f99", "address": "fa:16:3e:35:a4:3b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966580e7-45", "ovs_interfaceid": "966580e7-4512-4064-aa4e-c78c12545f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "966580e7-4512-4064-aa4e-c78c12545f99", "address": "fa:16:3e:35:a4:3b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966580e7-45", "ovs_interfaceid": "966580e7-4512-4064-aa4e-c78c12545f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:a4:3b,bridge_name='br-int',has_traffic_filtering=True,id=966580e7-4512-4064-aa4e-c78c12545f99,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap966580e7-45') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:a4:3b,bridge_name='br-int',has_traffic_filtering=True,id=966580e7-4512-4064-aa4e-c78c12545f99,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap966580e7-45') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap966580e7-45, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:00 user nova-compute[72820]: INFO os_vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:a4:3b,bridge_name='br-int',has_traffic_filtering=True,id=966580e7-4512-4064-aa4e-c78c12545f99,network=Network(b023a40e-08f6-49e8-9fa9-7a0196482d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap966580e7-45')
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:27:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:27:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b13d4895-4841-4176-b770-88848fc8e5e2", "address": "fa:16:3e:0e:f0:9d", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13d4895-48", "ovs_interfaceid": "b13d4895-4841-4176-b770-88848fc8e5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "b13d4895-4841-4176-b770-88848fc8e5e2", "address": "fa:16:3e:0e:f0:9d", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13d4895-48", "ovs_interfaceid": "b13d4895-4841-4176-b770-88848fc8e5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:f0:9d,bridge_name='br-int',has_traffic_filtering=True,id=b13d4895-4841-4176-b770-88848fc8e5e2,network=Network(506f9029-7bbf-43f7-af98-765cea3d8473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13d4895-48') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:f0:9d,bridge_name='br-int',has_traffic_filtering=True,id=b13d4895-4841-4176-b770-88848fc8e5e2,network=Network(506f9029-7bbf-43f7-af98-765cea3d8473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13d4895-48') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb13d4895-48, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:00 user nova-compute[72820]: INFO os_vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:f0:9d,bridge_name='br-int',has_traffic_filtering=True,id=b13d4895-4841-4176-b770-88848fc8e5e2,network=Network(506f9029-7bbf-43f7-af98-765cea3d8473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13d4895-48')
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T02:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156732240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-156732240',id=15,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgj3Hml6G/kWjMlHwCGbUtq7n2B3tOo/5dj6a7vEDUtXNsN5KQ3eYOfOt+/gPMAIKZSPQqyQ526849qTzxVSRQEi9Fa8+j3gfJJ4uHawomsivCRj3WrrxemeawO1tLuag==',key_name='tempest-keypair-1061080205',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:27:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c14062f1cf8e4244ae629536b131ac0c',ramdisk_id='',reservation_id='r-q16xe4z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1708560788',owner_user_name='tempest-TaggedBootDevicesTest-1708560788-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:27:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0acc5b76a48348b4b02aecee3a35e096',uuid=edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "address": "fa:16:3e:6c:bd:3e", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ea855b-ce", "ovs_interfaceid": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converting VIF {"id": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "address": "fa:16:3e:6c:bd:3e", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ea855b-ce", "ovs_interfaceid": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:bd:3e,bridge_name='br-int',has_traffic_filtering=True,id=14ea855b-ce40-4fa2-ab19-ea385ca9c65c,network=Network(506f9029-7bbf-43f7-af98-765cea3d8473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ea855b-ce') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:bd:3e,bridge_name='br-int',has_traffic_filtering=True,id=14ea855b-ce40-4fa2-ab19-ea385ca9c65c,network=Network(506f9029-7bbf-43f7-af98-765cea3d8473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ea855b-ce') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14ea855b-ce, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:00 user nova-compute[72820]: INFO os_vif [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:bd:3e,bridge_name='br-int',has_traffic_filtering=True,id=14ea855b-ce40-4fa2-ab19-ea385ca9c65c,network=Network(506f9029-7bbf-43f7-af98-765cea3d8473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ea855b-ce')
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bNlZPgKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:29:00 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9133e54-1e7e-491d-91cb-05cc01d1de9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:29:00 user nova-compute[72820]: No targets found.
Aug 27 02:29:00 user nova-compute[72820]: iSNS:
Aug 27 02:29:00 user nova-compute[72820]: No targets found.
Aug 27 02:29:00 user nova-compute[72820]: STATIC:
Aug 27 02:29:00 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047
Aug 27 02:29:00 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:00 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:00 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37
Aug 27 02:29:00 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:00 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:00 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:29:00 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:00 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:00 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591
Aug 27 02:29:00 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:00 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:00 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb
Aug 27 02:29:00 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:00 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:00 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a
Aug 27 02:29:00 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:00 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:00 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5
Aug 27 02:29:00 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:00 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:00 user nova-compute[72820]: FIRMWARE:
Aug 27 02:29:00 user nova-compute[72820]: No targets found.
Aug 27 02:29:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:29:00 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:29:00 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8577688a-3b8a-479b-8d8d-7790f4ae8c82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cd1a6c-ba36-43b1-9404-5212dd614f8d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a0595ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5'): ({'sdc'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Removing single pathed devices sdc {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f84b91c-f421-4e2b-8182-171822d84ced]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[96974389-0345-45b8-a823-19c97e3cfb30]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Flushing IO for device /dev/sdc {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbff64ae-9d0c-4d3e-81ad-17319019eca9]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88e1a85-305b-44a1-943d-5d78f315a4ad]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbaeeac-0856-4287-ad49-df19794e5053]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47945af-0543-4aa9-ad02-5c4e3da4b846]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5, portal: 172.16.0.220,3260]
Aug 27 02:29:00 user nova-compute[72820]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5, portal: 172.16.0.220,3260] successful.
Aug 27 02:29:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9232106a-0c47-4086-9e35-8d5f6d454ee5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[de54ce9b-dca0-4434-bcbb-d37b23392aa4]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] <== disconnect_volume: return (409ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHuFwRjI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:29:00 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-1647fafb-02da-4fa5-a62f-d43919dd49a6 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-1647fafb-02da-4fa5-a62f-d43919dd49a6 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:29:00 user nova-compute[72820]: WARNING nova.compute.manager [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-1647fafb-02da-4fa5-a62f-d43919dd49a6 for instance with vm_state active and task_state deleting.
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-unplugged-4c2ff677-b994-41bc-94e5-e542ad18fb4e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-unplugged-4c2ff677-b994-41bc-94e5-e542ad18fb4e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-unplugged-4c2ff677-b994-41bc-94e5-e542ad18fb4e for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-4c2ff677-b994-41bc-94e5-e542ad18fb4e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-4c2ff677-b994-41bc-94e5-e542ad18fb4e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:29:00 user nova-compute[72820]: WARNING nova.compute.manager [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-4c2ff677-b994-41bc-94e5-e542ad18fb4e for instance with vm_state active and task_state deleting.
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-unplugged-966580e7-4512-4064-aa4e-c78c12545f99 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-unplugged-966580e7-4512-4064-aa4e-c78c12545f99 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-unplugged-966580e7-4512-4064-aa4e-c78c12545f99 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-966580e7-4512-4064-aa4e-c78c12545f99 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-966580e7-4512-4064-aa4e-c78c12545f99 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:29:00 user nova-compute[72820]: WARNING nova.compute.manager [req-4ce1fbca-2838-4546-ac1e-7fdc8e20f0e6 req-9901f147-6f1d-4c5f-a878-940e4a50dfb2 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-966580e7-4512-4064-aa4e-c78c12545f99 for instance with vm_state active and task_state deleting.
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dded201c-d297-4f9f-b4ad-1d2199866bf8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:29:00 user nova-compute[72820]: No targets found.
Aug 27 02:29:00 user nova-compute[72820]: iSNS:
Aug 27 02:29:00 user nova-compute[72820]: No targets found.
Aug 27 02:29:00 user nova-compute[72820]: STATIC:
Aug 27 02:29:00 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047
Aug 27 02:29:00 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:00 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:00 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37
Aug 27 02:29:00 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:00 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:00 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:29:00 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:00 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:00 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591
Aug 27 02:29:00 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:00 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:00 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb
Aug 27 02:29:00 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:00 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:00 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a
Aug 27 02:29:00 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:00 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:00 user nova-compute[72820]: FIRMWARE:
Aug 27 02:29:00 user nova-compute[72820]: No targets found.
Aug 27 02:29:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:29:00 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:29:00 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-be86e2b6-462f-41a5-9989-991780d203d1 req-4baddb70-a9af-45b2-839e-b0afe68c8175 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-82460091-aebf-4691-a20c-d7c0affbbba0 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-be86e2b6-462f-41a5-9989-991780d203d1 req-4baddb70-a9af-45b2-839e-b0afe68c8175 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-be86e2b6-462f-41a5-9989-991780d203d1 req-4baddb70-a9af-45b2-839e-b0afe68c8175 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-be86e2b6-462f-41a5-9989-991780d203d1 req-4baddb70-a9af-45b2-839e-b0afe68c8175 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-be86e2b6-462f-41a5-9989-991780d203d1 req-4baddb70-a9af-45b2-839e-b0afe68c8175 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-82460091-aebf-4691-a20c-d7c0affbbba0 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:29:00 user nova-compute[72820]: WARNING nova.compute.manager [req-be86e2b6-462f-41a5-9989-991780d203d1 req-4baddb70-a9af-45b2-839e-b0afe68c8175 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-82460091-aebf-4691-a20c-d7c0affbbba0 for instance with vm_state active and task_state deleting.
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-be86e2b6-462f-41a5-9989-991780d203d1 req-4baddb70-a9af-45b2-839e-b0afe68c8175 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-unplugged-b13d4895-4841-4176-b770-88848fc8e5e2 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-be86e2b6-462f-41a5-9989-991780d203d1 req-4baddb70-a9af-45b2-839e-b0afe68c8175 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-be86e2b6-462f-41a5-9989-991780d203d1 req-4baddb70-a9af-45b2-839e-b0afe68c8175 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-be86e2b6-462f-41a5-9989-991780d203d1 req-4baddb70-a9af-45b2-839e-b0afe68c8175 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-be86e2b6-462f-41a5-9989-991780d203d1 req-4baddb70-a9af-45b2-839e-b0afe68c8175 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-unplugged-b13d4895-4841-4176-b770-88848fc8e5e2 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-be86e2b6-462f-41a5-9989-991780d203d1 req-4baddb70-a9af-45b2-839e-b0afe68c8175 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-unplugged-b13d4895-4841-4176-b770-88848fc8e5e2 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-be86e2b6-462f-41a5-9989-991780d203d1 req-4baddb70-a9af-45b2-839e-b0afe68c8175 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-b13d4895-4841-4176-b770-88848fc8e5e2 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-be86e2b6-462f-41a5-9989-991780d203d1 req-4baddb70-a9af-45b2-839e-b0afe68c8175 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-be86e2b6-462f-41a5-9989-991780d203d1 req-4baddb70-a9af-45b2-839e-b0afe68c8175 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-be86e2b6-462f-41a5-9989-991780d203d1 req-4baddb70-a9af-45b2-839e-b0afe68c8175 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-be86e2b6-462f-41a5-9989-991780d203d1 req-4baddb70-a9af-45b2-839e-b0afe68c8175 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-b13d4895-4841-4176-b770-88848fc8e5e2 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:29:00 user nova-compute[72820]: WARNING nova.compute.manager [req-be86e2b6-462f-41a5-9989-991780d203d1 req-4baddb70-a9af-45b2-839e-b0afe68c8175 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-b13d4895-4841-4176-b770-88848fc8e5e2 for instance with vm_state active and task_state deleting.
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e150e98-d07b-4f18-b547-723da9490f79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-545a76f3-ad4a-4c64-937d-da457f78e3cc req-46fb5141-923e-4080-b0b4-168ae26881a5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-545a76f3-ad4a-4c64-937d-da457f78e3cc req-46fb5141-923e-4080-b0b4-168ae26881a5 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-545a76f3-ad4a-4c64-937d-da457f78e3cc req-46fb5141-923e-4080-b0b4-168ae26881a5 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-545a76f3-ad4a-4c64-937d-da457f78e3cc req-46fb5141-923e-4080-b0b4-168ae26881a5 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-545a76f3-ad4a-4c64-937d-da457f78e3cc req-46fb5141-923e-4080-b0b4-168ae26881a5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:29:00 user nova-compute[72820]: WARNING nova.compute.manager [req-545a76f3-ad4a-4c64-937d-da457f78e3cc req-46fb5141-923e-4080-b0b4-168ae26881a5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6 for instance with vm_state active and task_state deleting.
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-545a76f3-ad4a-4c64-937d-da457f78e3cc req-46fb5141-923e-4080-b0b4-168ae26881a5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-unplugged-14ea855b-ce40-4fa2-ab19-ea385ca9c65c {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-545a76f3-ad4a-4c64-937d-da457f78e3cc req-46fb5141-923e-4080-b0b4-168ae26881a5 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-545a76f3-ad4a-4c64-937d-da457f78e3cc req-46fb5141-923e-4080-b0b4-168ae26881a5 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-545a76f3-ad4a-4c64-937d-da457f78e3cc req-46fb5141-923e-4080-b0b4-168ae26881a5 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-545a76f3-ad4a-4c64-937d-da457f78e3cc req-46fb5141-923e-4080-b0b4-168ae26881a5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-unplugged-14ea855b-ce40-4fa2-ab19-ea385ca9c65c {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-545a76f3-ad4a-4c64-937d-da457f78e3cc req-46fb5141-923e-4080-b0b4-168ae26881a5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-unplugged-14ea855b-ce40-4fa2-ab19-ea385ca9c65c for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-545a76f3-ad4a-4c64-937d-da457f78e3cc req-46fb5141-923e-4080-b0b4-168ae26881a5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-plugged-14ea855b-ce40-4fa2-ab19-ea385ca9c65c {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-545a76f3-ad4a-4c64-937d-da457f78e3cc req-46fb5141-923e-4080-b0b4-168ae26881a5 service nova] Acquiring lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-545a76f3-ad4a-4c64-937d-da457f78e3cc req-46fb5141-923e-4080-b0b4-168ae26881a5 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-545a76f3-ad4a-4c64-937d-da457f78e3cc req-46fb5141-923e-4080-b0b4-168ae26881a5 service nova] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-545a76f3-ad4a-4c64-937d-da457f78e3cc req-46fb5141-923e-4080-b0b4-168ae26881a5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] No waiting events found dispatching network-vif-plugged-14ea855b-ce40-4fa2-ab19-ea385ca9c65c {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:29:00 user nova-compute[72820]: WARNING nova.compute.manager [req-545a76f3-ad4a-4c64-937d-da457f78e3cc req-46fb5141-923e-4080-b0b4-168ae26881a5 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received unexpected event network-vif-plugged-14ea855b-ce40-4fa2-ab19-ea385ca9c65c for instance with vm_state active and task_state deleting.
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7f085e-4e80-435e-83e2-13510d1bc297]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:00 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a05a03a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb'): ({'sdd'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Removing single pathed devices sdd {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b6089b-3230-4c22-b9c4-81e18573e23b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2e1f95-6aac-401e-8b1b-110f40c33920]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Flushing IO for device /dev/sdd {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.031s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[94425b80-bc2a-446a-b010-281090fbc9f7]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6263d8e-45b1-48d4-af1b-d408702d7245]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e5b0dd-93da-4973-adc7-c04839f46744]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef44f40e-816e-4f0e-9f75-d81a3b32de47]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb, portal: 172.16.0.220,3260]
Aug 27 02:29:00 user nova-compute[72820]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb, portal: 172.16.0.220,3260] successful.
Aug 27 02:29:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb336f72-5156-4865-b694-6f854b1b99eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdf4aaa-9cfd-4a9e-b44b-869b01fbaade]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] <== disconnect_volume: return (400ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJVgPTKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:29:01 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9c7b97-921e-4fe2-8130-b2c75c1edd3d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:29:01 user nova-compute[72820]: No targets found.
Aug 27 02:29:01 user nova-compute[72820]: iSNS:
Aug 27 02:29:01 user nova-compute[72820]: No targets found.
Aug 27 02:29:01 user nova-compute[72820]: STATIC:
Aug 27 02:29:01 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047
Aug 27 02:29:01 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:01 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:01 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37
Aug 27 02:29:01 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:01 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:01 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:29:01 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:01 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:01 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591
Aug 27 02:29:01 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:01 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:01 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a
Aug 27 02:29:01 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:01 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:01 user nova-compute[72820]: FIRMWARE:
Aug 27 02:29:01 user nova-compute[72820]: No targets found.
Aug 27 02:29:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:29:01 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:29:01 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[35178a90-2c4d-4249-9a26-66915c4a9501]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cad8ddb-b26f-455a-91af-b40dac6243fe]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:29:01 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:29:01 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:01 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:01 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:29:01 user nova-compute[72820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 (non-flash)
Aug 27 02:29:01 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:01 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:01 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a05a03a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591'): ({'sde'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Removing single pathed devices sde {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1d4d73-8093-46c2-8dc7-ea11faaa86a2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[72379a1d-09a6-49e4-b101-5ebe51793187]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Flushing IO for device /dev/sde {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bba449-bbbd-42a1-a6b6-ee0a6802a0a2]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a8fb0c-d5ef-4a5b-8871-ccf30d922cd4]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] SCSI volumes sde have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fb7717-700a-4c21-b261-41142db0fe4d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41a8948-467c-4a32-9e0b-82cb2c0a32b0]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591, portal: 172.16.0.220,3260]
Aug 27 02:29:01 user nova-compute[72820]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591, portal: 172.16.0.220,3260] successful.
Aug 27 02:29:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62523bd5-843e-4f3a-95bc-3312cef1e591 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeddc787-e785-4cf7-8e33-526082ae10da]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] <== disconnect_volume: return (395ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:29:01 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Deleting instance files /opt/stack/data/nova/instances/edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd_del
Aug 27 02:29:01 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Deletion of /opt/stack/data/nova/instances/edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd_del complete
Aug 27 02:29:01 user nova-compute[72820]: INFO nova.compute.manager [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Took 3.86 seconds to destroy the instance on the hypervisor.
Aug 27 02:29:01 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:29:01 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:29:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:03 user nova-compute[72820]: DEBUG nova.compute.manager [req-c3a72d15-9014-4b1e-b931-c7875e0589a8 req-2f30c613-0b29-49f4-9300-565f396f7725 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-deleted-4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:03 user nova-compute[72820]: INFO nova.compute.manager [req-c3a72d15-9014-4b1e-b931-c7875e0589a8 req-2f30c613-0b29-49f4-9300-565f396f7725 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Neutron deleted interface 4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6; detaching it from the instance and deleting it from the info cache
Aug 27 02:29:03 user nova-compute[72820]: DEBUG nova.network.neutron [req-c3a72d15-9014-4b1e-b931-c7875e0589a8 req-2f30c613-0b29-49f4-9300-565f396f7725 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Updating instance_info_cache with network_info: [{"id": "82460091-aebf-4691-a20c-d7c0affbbba0", "address": "fa:16:3e:27:73:18", "network": {"id": "3c12368b-d5bc-4102-bff5-87b009efa11e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1403358780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82460091-ae", "ovs_interfaceid": "82460091-aebf-4691-a20c-d7c0affbbba0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "address": "fa:16:3e:4b:0b:e4", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1647fafb-02", "ovs_interfaceid": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "address": "fa:16:3e:ea:a2:5b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2ff677-b9", "ovs_interfaceid": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "966580e7-4512-4064-aa4e-c78c12545f99", "address": "fa:16:3e:35:a4:3b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966580e7-45", "ovs_interfaceid": "966580e7-4512-4064-aa4e-c78c12545f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b13d4895-4841-4176-b770-88848fc8e5e2", "address": "fa:16:3e:0e:f0:9d", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13d4895-48", "ovs_interfaceid": "b13d4895-4841-4176-b770-88848fc8e5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "address": "fa:16:3e:6c:bd:3e", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ea855b-ce", "ovs_interfaceid": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:29:03 user nova-compute[72820]: DEBUG nova.compute.manager [req-c3a72d15-9014-4b1e-b931-c7875e0589a8 req-2f30c613-0b29-49f4-9300-565f396f7725 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Detach interface failed, port_id=4d9aa8aa-1ddb-4df7-90d6-dbf161b0e4f6, reason: Instance edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 02:29:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:05 user nova-compute[72820]: DEBUG nova.compute.manager [req-89b22b84-874e-431f-94c5-67925a79f8cf req-28ee7bb5-f7c9-4427-ac65-87642155e419 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-deleted-82460091-aebf-4691-a20c-d7c0affbbba0 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:05 user nova-compute[72820]: INFO nova.compute.manager [req-89b22b84-874e-431f-94c5-67925a79f8cf req-28ee7bb5-f7c9-4427-ac65-87642155e419 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Neutron deleted interface 82460091-aebf-4691-a20c-d7c0affbbba0; detaching it from the instance and deleting it from the info cache
Aug 27 02:29:05 user nova-compute[72820]: DEBUG nova.network.neutron [req-89b22b84-874e-431f-94c5-67925a79f8cf req-28ee7bb5-f7c9-4427-ac65-87642155e419 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Updating instance_info_cache with network_info: [{"id": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "address": "fa:16:3e:4b:0b:e4", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1647fafb-02", "ovs_interfaceid": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "address": "fa:16:3e:ea:a2:5b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2ff677-b9", "ovs_interfaceid": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "966580e7-4512-4064-aa4e-c78c12545f99", "address": "fa:16:3e:35:a4:3b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966580e7-45", "ovs_interfaceid": "966580e7-4512-4064-aa4e-c78c12545f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b13d4895-4841-4176-b770-88848fc8e5e2", "address": "fa:16:3e:0e:f0:9d", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13d4895-48", "ovs_interfaceid": "b13d4895-4841-4176-b770-88848fc8e5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "address": "fa:16:3e:6c:bd:3e", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ea855b-ce", "ovs_interfaceid": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:29:05 user nova-compute[72820]: DEBUG nova.compute.manager [req-89b22b84-874e-431f-94c5-67925a79f8cf req-28ee7bb5-f7c9-4427-ac65-87642155e419 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Detach interface failed, port_id=82460091-aebf-4691-a20c-d7c0affbbba0, reason: Instance edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 02:29:05 user nova-compute[72820]: DEBUG nova.compute.manager [req-89b22b84-874e-431f-94c5-67925a79f8cf req-28ee7bb5-f7c9-4427-ac65-87642155e419 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-deleted-b13d4895-4841-4176-b770-88848fc8e5e2 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:05 user nova-compute[72820]: INFO nova.compute.manager [req-89b22b84-874e-431f-94c5-67925a79f8cf req-28ee7bb5-f7c9-4427-ac65-87642155e419 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Neutron deleted interface b13d4895-4841-4176-b770-88848fc8e5e2; detaching it from the instance and deleting it from the info cache
Aug 27 02:29:05 user nova-compute[72820]: DEBUG nova.network.neutron [req-89b22b84-874e-431f-94c5-67925a79f8cf req-28ee7bb5-f7c9-4427-ac65-87642155e419 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Updating instance_info_cache with network_info: [{"id": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "address": "fa:16:3e:4b:0b:e4", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1647fafb-02", "ovs_interfaceid": "1647fafb-02da-4fa5-a62f-d43919dd49a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "address": "fa:16:3e:ea:a2:5b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2ff677-b9", "ovs_interfaceid": "4c2ff677-b994-41bc-94e5-e542ad18fb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "966580e7-4512-4064-aa4e-c78c12545f99", "address": "fa:16:3e:35:a4:3b", "network": {"id": "b023a40e-08f6-49e8-9fa9-7a0196482d3a", "bridge": "br-int", "label": "tempest-device-tagging-net1-742390538", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966580e7-45", "ovs_interfaceid": "966580e7-4512-4064-aa4e-c78c12545f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "address": "fa:16:3e:6c:bd:3e", "network": {"id": "506f9029-7bbf-43f7-af98-765cea3d8473", "bridge": "br-int", "label": "tempest-device-tagging-net2-533554242", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c14062f1cf8e4244ae629536b131ac0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ea855b-ce", "ovs_interfaceid": "14ea855b-ce40-4fa2-ab19-ea385ca9c65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:29:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-89b22b84-874e-431f-94c5-67925a79f8cf req-28ee7bb5-f7c9-4427-ac65-87642155e419 service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Detach interface failed, port_id=b13d4895-4841-4176-b770-88848fc8e5e2, reason: Instance edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 02:29:06 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:29:06 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Took 5.47 seconds to deallocate network for instance.
Aug 27 02:29:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:07 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:29:07 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:29:07 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:29:07 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:29:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:29:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-65e1b7e7-87e6-4709-b882-5b7c9ff90d41 req-faab172d-e9d8-40cd-8c12-5e01ef56fe4e service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-deleted-966580e7-4512-4064-aa4e-c78c12545f99 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-65e1b7e7-87e6-4709-b882-5b7c9ff90d41 req-faab172d-e9d8-40cd-8c12-5e01ef56fe4e service nova] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Received event network-vif-deleted-14ea855b-ce40-4fa2-ab19-ea385ca9c65c {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGezPYil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:29:08 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:29:08 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:29:08 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e911462-5813-4e13-94fa-f34f950a1e0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:29:08 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf749ab1-bdbc-42e1-8785-b0628dd0d616]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7] added
Aug 27 02:29:08 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[48719515-c031-4473-9637-7f233b3017b7]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd3bfd2-fa73-40bc-b0ad-9a0b910fc920]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MGezPYil {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MGezPYil" returned: 0 in 0.036s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0737ae74-fe66-4738-8aac-00c63fb4d4c8]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MGezPYil'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e8ef6a-2d5e-4490-bdd9-dee3fab112a4]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8f8394-9ba4-49e6-adc1-8698bec3846f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:29:08 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:08 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:08 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:08 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:29:08 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:08 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:08 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:08 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[298ca7ab-781b-49ae-a64d-a51dabc3e35e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7, portal: 172.16.0.220,3260]
Aug 27 02:29:08 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7, portal: 172.16.0.220,3260] successful.
Aug 27 02:29:08 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b469235-5801-4ec8-8264-cf27a1200ff8]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf7f3ca-a1f2-4516-b592-36112e14da7f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:29:08 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:08 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:08 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:08 user nova-compute[72820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 (non-flash)
Aug 27 02:29:08 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:29:08 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:08 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:08 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:08 user nova-compute[72820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 (non-flash)
Aug 27 02:29:08 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16249d8-3bd3-46a0-93a1-f76685efb8aa]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:29:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGezPYil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:29:09 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:29:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:29:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26262353061303261', 'path': '/dev/sdc'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:29:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262353061303261', 'path': '/dev/sdc'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:29:09 user nova-compute[72820]: DEBUG nova.objects.instance [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lazy-loading 'flavor' on Instance uuid 7c42c4ae-0f80-4295-a64e-b426225b94c5 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:29:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:29:09 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:29:09 user nova-compute[72820]:   <source dev="/dev/sdc"/>
Aug 27 02:29:09 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:29:09 user nova-compute[72820]:   <serial>7f54d67e-9b9b-4140-ac63-de051a936db7</serial>
Aug 27 02:29:09 user nova-compute[72820]: </disk>
Aug 27 02:29:09 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:29:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:29:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:29:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] No VIF found with MAC fa:16:3e:51:e5:4a, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:29:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:10 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:29:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:10 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:29:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-988066c7-72b9-4067-a234-963b4ff9463f tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.170s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "7c42c4ae-0f80-4295-a64e-b426225b94c5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:11 user nova-compute[72820]: INFO nova.compute.manager [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Detaching volume 7f54d67e-9b9b-4140-ac63-de051a936db7
Aug 27 02:29:11 user nova-compute[72820]: INFO nova.virt.block_device [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Attempting to driver detach volume 7f54d67e-9b9b-4140-ac63-de051a936db7 from mountpoint /dev/vdb
Aug 27 02:29:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Attempting to detach device vdb from instance 7c42c4ae-0f80-4295-a64e-b426225b94c5 from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:29:11 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:29:11 user nova-compute[72820]:   <source dev="/dev/sdc"/>
Aug 27 02:29:11 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:29:11 user nova-compute[72820]:   <serial>7f54d67e-9b9b-4140-ac63-de051a936db7</serial>
Aug 27 02:29:11 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:29:11 user nova-compute[72820]: </disk>
Aug 27 02:29:11 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:11 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Successfully detached device vdb from instance 7c42c4ae-0f80-4295-a64e-b426225b94c5 from the persistent domain config.
Aug 27 02:29:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7c42c4ae-0f80-4295-a64e-b426225b94c5 from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:29:11 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:29:11 user nova-compute[72820]:   <source dev="/dev/sdc"/>
Aug 27 02:29:11 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:29:11 user nova-compute[72820]:   <serial>7f54d67e-9b9b-4140-ac63-de051a936db7</serial>
Aug 27 02:29:11 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:29:11 user nova-compute[72820]: </disk>
Aug 27 02:29:11 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693103351.8746421, 7c42c4ae-0f80-4295-a64e-b426225b94c5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7c42c4ae-0f80-4295-a64e-b426225b94c5 {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:29:11 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Successfully detached device vdb from instance 7c42c4ae-0f80-4295-a64e-b426225b94c5 from the live domain config.
Aug 27 02:29:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGezPYil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:29:11 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:29:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21e9613-d2c6-441b-9679-9245105ecc75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:29:11 user nova-compute[72820]: No targets found.
Aug 27 02:29:11 user nova-compute[72820]: iSNS:
Aug 27 02:29:11 user nova-compute[72820]: No targets found.
Aug 27 02:29:11 user nova-compute[72820]: STATIC:
Aug 27 02:29:11 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047
Aug 27 02:29:11 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:11 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:11 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37
Aug 27 02:29:11 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:11 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:11 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:29:11 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:11 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:11 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a
Aug 27 02:29:11 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:11 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:11 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7
Aug 27 02:29:11 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:11 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:11 user nova-compute[72820]: FIRMWARE:
Aug 27 02:29:11 user nova-compute[72820]: No targets found.
Aug 27 02:29:11 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:29:11 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:29:11 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4555369-5396-448f-a2be-72067b526a4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4558094c-ffeb-44e9-b7f5-71657b7daec9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:29:11 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:11 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:11 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:11 user nova-compute[72820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 (non-flash)
Aug 27 02:29:11 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:29:12 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:12 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:12 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:12 user nova-compute[72820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 (non-flash)
Aug 27 02:29:12 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c0206d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7'): ({'sdc'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Removing single pathed devices sdc {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[babda9a9-7ac6-469d-9792-eb24a47f7077]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ac7fbf-2aa3-46b5-b12b-81b88422d4cb]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Flushing IO for device /dev/sdc {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84ba30f-9c3f-487e-8fa3-29f6a2af205f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94f3268-9603-4771-b45d-04281b66f99c]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae81bab3-ef6e-40d6-be50-fcbca6bf5086]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[09031234-f659-4b29-a293-1083c56fed72]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7, portal: 172.16.0.220,3260]
Aug 27 02:29:12 user nova-compute[72820]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7, portal: 172.16.0.220,3260] successful.
Aug 27 02:29:12 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f54d67e-9b9b-4140-ac63-de051a936db7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af01408-9516-4607-91e6-a0808b0aeef4]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] <== disconnect_volume: return (412ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:13 user nova-compute[72820]: INFO nova.compute.manager [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Detaching volume db346c69-45aa-475a-95bc-348731d6815a
Aug 27 02:29:13 user nova-compute[72820]: INFO nova.virt.block_device [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Attempting to driver detach volume db346c69-45aa-475a-95bc-348731d6815a from mountpoint /dev/vdb
Aug 27 02:29:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Attempting to detach device vdb from instance f37dfe42-3b22-4111-b10d-9459c8c42b2d from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:29:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:29:13 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:29:13 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:29:13 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:29:13 user nova-compute[72820]:   <serial>db346c69-45aa-475a-95bc-348731d6815a</serial>
Aug 27 02:29:13 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 02:29:13 user nova-compute[72820]: </disk>
Aug 27 02:29:13 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:29:13 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Successfully detached device vdb from instance f37dfe42-3b22-4111-b10d-9459c8c42b2d from the persistent domain config.
Aug 27 02:29:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f37dfe42-3b22-4111-b10d-9459c8c42b2d from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:29:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:29:13 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:29:13 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:29:13 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:29:13 user nova-compute[72820]:   <serial>db346c69-45aa-475a-95bc-348731d6815a</serial>
Aug 27 02:29:13 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 02:29:13 user nova-compute[72820]: </disk>
Aug 27 02:29:13 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:29:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:29:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:13 user nova-compute[72820]: DEBUG nova.objects.instance [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lazy-loading 'flavor' on Instance uuid 7c42c4ae-0f80-4295-a64e-b426225b94c5 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:29:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4edd66fb-d79b-47d5-8c15-4d3b70f0dfc9 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.697s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693103354.1591027, f37dfe42-3b22-4111-b10d-9459c8c42b2d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f37dfe42-3b22-4111-b10d-9459c8c42b2d {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:14 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Successfully detached device vdb from instance f37dfe42-3b22-4111-b10d-9459c8c42b2d from the live domain config.
Aug 27 02:29:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmHeTLfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:29:14 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccccf76-7c47-4ba3-aad6-778b26f2d47b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:29:14 user nova-compute[72820]: No targets found.
Aug 27 02:29:14 user nova-compute[72820]: iSNS:
Aug 27 02:29:14 user nova-compute[72820]: No targets found.
Aug 27 02:29:14 user nova-compute[72820]: STATIC:
Aug 27 02:29:14 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047
Aug 27 02:29:14 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:14 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:14 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37
Aug 27 02:29:14 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:14 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:14 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:29:14 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:14 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:14 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a
Aug 27 02:29:14 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:14 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:14 user nova-compute[72820]: FIRMWARE:
Aug 27 02:29:14 user nova-compute[72820]: No targets found.
Aug 27 02:29:14 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:29:14 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:29:14 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa8a58d-780c-4248-ac3e-e8e60f43096c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:14 user nova-compute[72820]: INFO nova.compute.manager [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Took 7.29 seconds to detach 3 volumes for instance.
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b88c60-c3c4-420a-b6ca-0ae67646844c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:29:14 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:14 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:14 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:14 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a (non-flash)
Aug 27 02:29:14 user nova-compute[72820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:14 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:14 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:14 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a05a24d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a'): ({'sdb'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Removing single pathed devices sdb {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c2e8a0-953d-420a-939c-50dbdf16e3b1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4d9540-8a45-42bd-be37-472dd84fb8b2]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Flushing IO for device /dev/sdb {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd7d59d-a1ce-498d-bad2-1b9d4670c3cd]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ca20b7-0eaf-473d-bb04-e1e1caeaf75b]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cd0228-40b5-434a-a4a9-3651f14913c3]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4abc8a-ba07-4de5-98db-0250850f5142]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a, portal: 172.16.0.220,3260]
Aug 27 02:29:14 user nova-compute[72820]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a, portal: 172.16.0.220,3260] successful.
Aug 27 02:29:14 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103339.6436744, edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:29:14 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] VM Stopped (Lifecycle Event)
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db346c69-45aa-475a-95bc-348731d6815a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[351c38cf-142b-417a-881e-f84bfca917b0]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.464s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] <== disconnect_volume: return (466ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG nova.compute.manager [None req-16e2c87f-d0f2-47f7-aa51-c9efea437ccd None None] [instance: edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.563s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:15 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Deleted allocations for instance edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd
Aug 27 02:29:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-75d65a36-aa37-416a-b7ee-063d58da5bad tempest-TaggedBootDevicesTest-1708560788 tempest-TaggedBootDevicesTest-1708560788-project-member] Lock "edd6f5a6-8a4c-47a0-a1f7-8e47300fc7bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.525s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:15 user nova-compute[72820]: DEBUG nova.objects.instance [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lazy-loading 'flavor' on Instance uuid f37dfe42-3b22-4111-b10d-9459c8c42b2d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:29:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d0eaf2f1-531a-4d76-9565-8ca00cd9fb7a tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.388s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:29:16 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:29:16 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:29:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7028MB free_disk=25.234394073486328GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 26581695-c4b9-40b8-ab7a-34c99db0dadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f8f612f3-41c9-4dae-8d49-218d61720b15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f37dfe42-3b22-4111-b10d-9459c8c42b2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 050e0c2b-9244-4987-b07d-e4712e46f936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance ac2f6797-8b7c-47d3-836d-fc1c617e23dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1591319d-3d15-4c46-b823-4edddf018b5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 7c42c4ae-0f80-4295-a64e-b426225b94c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 63c67f6e-849b-404a-bd38-524604cae3d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 94323d83-f8fe-4814-82af-f860a20071bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 89b66e95-2333-403b-b338-6096717ca20d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:29:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:17 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:29:17 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:29:17 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:29:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:29:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:29:18 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:29:18 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Updating instance_info_cache with network_info: [{"id": "a0280116-060c-4078-b415-7abd9005c221", "address": "fa:16:3e:dc:2f:1b", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0280116-06", "ovs_interfaceid": "a0280116-060c-4078-b415-7abd9005c221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:29:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:29:18 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:29:18 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:29:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-e2c6e542-0fac-4971-b7ec-e7cd2cef01a9 req-139cd7d4-eabf-4871-bf0b-f460a9c46014 service nova] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Received event network-changed-e13b95dc-bcba-4615-954c-61bc3cb2451f {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-e2c6e542-0fac-4971-b7ec-e7cd2cef01a9 req-139cd7d4-eabf-4871-bf0b-f460a9c46014 service nova] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Refreshing instance network info cache due to event network-changed-e13b95dc-bcba-4615-954c-61bc3cb2451f. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:29:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e2c6e542-0fac-4971-b7ec-e7cd2cef01a9 req-139cd7d4-eabf-4871-bf0b-f460a9c46014 service nova] Acquiring lock "refresh_cache-63c67f6e-849b-404a-bd38-524604cae3d8" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:29:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e2c6e542-0fac-4971-b7ec-e7cd2cef01a9 req-139cd7d4-eabf-4871-bf0b-f460a9c46014 service nova] Acquired lock "refresh_cache-63c67f6e-849b-404a-bd38-524604cae3d8" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:29:21 user nova-compute[72820]: DEBUG nova.network.neutron [req-e2c6e542-0fac-4971-b7ec-e7cd2cef01a9 req-139cd7d4-eabf-4871-bf0b-f460a9c46014 service nova] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Refreshing network info cache for port e13b95dc-bcba-4615-954c-61bc3cb2451f {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:29:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "63c67f6e-849b-404a-bd38-524604cae3d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "63c67f6e-849b-404a-bd38-524604cae3d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:21 user nova-compute[72820]: DEBUG nova.objects.instance [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lazy-loading 'flavor' on Instance uuid 63c67f6e-849b-404a-bd38-524604cae3d8 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:29:21 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Ignoring supplied device name: /dev/vdb
Aug 27 02:29:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "63c67f6e-849b-404a-bd38-524604cae3d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "63c67f6e-849b-404a-bd38-524604cae3d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "63c67f6e-849b-404a-bd38-524604cae3d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:21 user nova-compute[72820]: INFO nova.compute.manager [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Attaching volume 3ac09bd1-a440-4fa0-84d5-74556a3e9f94 to /dev/vdb
Aug 27 02:29:21 user nova-compute[72820]: DEBUG nova.network.neutron [req-e2c6e542-0fac-4971-b7ec-e7cd2cef01a9 req-139cd7d4-eabf-4871-bf0b-f460a9c46014 service nova] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Updated VIF entry in instance network info cache for port e13b95dc-bcba-4615-954c-61bc3cb2451f. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:29:21 user nova-compute[72820]: DEBUG nova.network.neutron [req-e2c6e542-0fac-4971-b7ec-e7cd2cef01a9 req-139cd7d4-eabf-4871-bf0b-f460a9c46014 service nova] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Updating instance_info_cache with network_info: [{"id": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "address": "fa:16:3e:cf:0e:bc", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13b95dc-bc", "ovs_interfaceid": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:29:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e2c6e542-0fac-4971-b7ec-e7cd2cef01a9 req-139cd7d4-eabf-4871-bf0b-f460a9c46014 service nova] Releasing lock "refresh_cache-63c67f6e-849b-404a-bd38-524604cae3d8" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG os_brick.utils [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[862ecbf6-2a77-4048-8b21-91f526f09f1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbee9bd-69f4-4675-8627-1384fcfdd6e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[465179fb-237f-47be-aa22-25d5f05033e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b0db2e-40fd-4cd9-8b21-02341e46c1cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:29:22 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:29:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc435f1-e51d-4926-a80a-ecc6456755de]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG os_brick.utils [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:29:22 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Updating existing volume attachment record: 423f22ed-e25c-4ab0-a4ee-cb9352d7955a {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:29:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwClZKIO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:29:33 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:29:33 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:29:33 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20612eb-db11-49ea-a228-3f5704cfb421]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:29:33 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae148b3-398e-4c1d-abe7-903853b14f99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94] added
Aug 27 02:29:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32933bd-5d8e-4589-bcfb-e0abf16fd3a0]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf25a473-03f4-4ec5-8938-7cd3418ce03b]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwClZKIO {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwClZKIO" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[220a4205-7c00-4763-80be-f34828902b03]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jwClZKIO'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e0c624-5b33-40a2-bcf3-7a883ede17d2]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7058845f-93bd-40e0-b19f-e1d49d830b78]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:33 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:33 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:33 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:33 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[44822606-1b88-4f19-bb27-2c5db2e9f089]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94, portal: 172.16.0.220,3260]
Aug 27 02:29:33 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94, portal: 172.16.0.220,3260] successful.
Aug 27 02:29:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c795b8-9b8c-47ac-ad49-0fd7c57a6f61]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb2a9ef-b593-499b-8b69-491e983ec19f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:33 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:33 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:33 user nova-compute[72820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)
Aug 27 02:29:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:33 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:33 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:33 user nova-compute[72820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)
Aug 27 02:29:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a2d741-3dd0-44a4-996f-c7b34689c541]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:29:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwClZKIO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:29:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:29:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26237386530383761', 'path': '/dev/sdb'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:29:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237386530383761', 'path': '/dev/sdb'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:29:34 user nova-compute[72820]: DEBUG nova.objects.instance [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lazy-loading 'flavor' on Instance uuid 63c67f6e-849b-404a-bd38-524604cae3d8 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:29:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:29:34 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:29:34 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:29:34 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:29:34 user nova-compute[72820]:   <serial>3ac09bd1-a440-4fa0-84d5-74556a3e9f94</serial>
Aug 27 02:29:34 user nova-compute[72820]: </disk>
Aug 27 02:29:34 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:29:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:35 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:29:35 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:29:35 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] No VIF found with MAC fa:16:3e:cf:0e:bc, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:29:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b6148019-006e-4ffb-9aca-83128807aea7 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "63c67f6e-849b-404a-bd38-524604cae3d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.774s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:29:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:37 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:29:37 user nova-compute[72820]: INFO nova.compute.claims [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Claim successful on node user
Aug 27 02:29:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:37 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:29:37 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:29:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:29:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:29:37 user nova-compute[72820]: DEBUG nova.network.neutron [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:29:37 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:29:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:29:37 user nova-compute[72820]: DEBUG nova.policy [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e735f5da8264ad3aff41701162c4d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf987dacdf44dc4807c74d4aa283357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:29:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:29:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:29:37 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Creating image(s)
Aug 27 02:29:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "/opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "/opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "/opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.198s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.209s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk 1073741824" returned: 0 in 0.048s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.171s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Cannot resize image /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Ensure instance console log exists: /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:38 user nova-compute[72820]: DEBUG nova.network.neutron [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Successfully created port: bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:29:39 user nova-compute[72820]: DEBUG nova.network.neutron [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Successfully updated port: bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:29:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "refresh_cache-4becc265-4f3d-4f83-a9ac-c99100a870ff" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:29:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquired lock "refresh_cache-4becc265-4f3d-4f83-a9ac-c99100a870ff" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:29:39 user nova-compute[72820]: DEBUG nova.network.neutron [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:29:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-039daa5f-d92c-4ab3-b70a-ccb36ccb2159 req-b5b31ff9-9802-4cb6-882b-4e43ee170fd8 service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Received event network-changed-bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-039daa5f-d92c-4ab3-b70a-ccb36ccb2159 req-b5b31ff9-9802-4cb6-882b-4e43ee170fd8 service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Refreshing instance network info cache due to event network-changed-bcc2e999-9d21-4d4c-84b8-b29ffddfedb9. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:29:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-039daa5f-d92c-4ab3-b70a-ccb36ccb2159 req-b5b31ff9-9802-4cb6-882b-4e43ee170fd8 service nova] Acquiring lock "refresh_cache-4becc265-4f3d-4f83-a9ac-c99100a870ff" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:29:39 user nova-compute[72820]: DEBUG nova.network.neutron [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.network.neutron [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Updating instance_info_cache with network_info: [{"id": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "address": "fa:16:3e:ec:8f:95", "network": {"id": "39de3116-51df-478a-bead-efb89526d4d2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-127107834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf987dacdf44dc4807c74d4aa283357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcc2e999-9d", "ovs_interfaceid": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Releasing lock "refresh_cache-4becc265-4f3d-4f83-a9ac-c99100a870ff" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.compute.manager [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Instance network_info: |[{"id": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "address": "fa:16:3e:ec:8f:95", "network": {"id": "39de3116-51df-478a-bead-efb89526d4d2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-127107834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf987dacdf44dc4807c74d4aa283357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcc2e999-9d", "ovs_interfaceid": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-039daa5f-d92c-4ab3-b70a-ccb36ccb2159 req-b5b31ff9-9802-4cb6-882b-4e43ee170fd8 service nova] Acquired lock "refresh_cache-4becc265-4f3d-4f83-a9ac-c99100a870ff" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.network.neutron [req-039daa5f-d92c-4ab3-b70a-ccb36ccb2159 req-b5b31ff9-9802-4cb6-882b-4e43ee170fd8 service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Refreshing network info cache for port bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Start _get_guest_xml network_info=[{"id": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "address": "fa:16:3e:ec:8f:95", "network": {"id": "39de3116-51df-478a-bead-efb89526d4d2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-127107834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf987dacdf44dc4807c74d4aa283357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcc2e999-9d", "ovs_interfaceid": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:29:40 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:29:40 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:29:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1898566739',display_name='tempest-TestServerVolumeAttachmentScenario-server-1898566739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1898566739',id=22,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFP+coPRpBylk52REDP+mkyumO81JyK+gqbVexAR60ZJzkXK961Oj38U8NDVNnz8Nuit1ORYLVX1+y2o06cai7IE0yKpBLBL/lVlto4q0eWPd7vHwECBdpQJ0dam/5dV9g==',key_name='tempest-keypair-1781491230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf987dacdf44dc4807c74d4aa283357',ramdisk_id='',reservation_id='r-xbt4xpy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1979275595',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1979275595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:29:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e735f5da8264ad3aff41701162c4d48',uuid=4becc265-4f3d-4f83-a9ac-c99100a870ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "address": "fa:16:3e:ec:8f:95", "network": {"id": "39de3116-51df-478a-bead-efb89526d4d2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-127107834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf987dacdf44dc4807c74d4aa283357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcc2e999-9d", "ovs_interfaceid": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Converting VIF {"id": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "address": "fa:16:3e:ec:8f:95", "network": {"id": "39de3116-51df-478a-bead-efb89526d4d2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-127107834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf987dacdf44dc4807c74d4aa283357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcc2e999-9d", "ovs_interfaceid": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:8f:95,bridge_name='br-int',has_traffic_filtering=True,id=bcc2e999-9d21-4d4c-84b8-b29ffddfedb9,network=Network(39de3116-51df-478a-bead-efb89526d4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcc2e999-9d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lazy-loading 'pci_devices' on Instance uuid 4becc265-4f3d-4f83-a9ac-c99100a870ff {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:29:40 user nova-compute[72820]:   <uuid>4becc265-4f3d-4f83-a9ac-c99100a870ff</uuid>
Aug 27 02:29:40 user nova-compute[72820]:   <name>instance-00000016</name>
Aug 27 02:29:40 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:29:40 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:29:40 user nova-compute[72820]:   <metadata>
Aug 27 02:29:40 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:29:40 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:29:40 user nova-compute[72820]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1898566739</nova:name>
Aug 27 02:29:40 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:29:40</nova:creationTime>
Aug 27 02:29:40 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:29:40 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:29:40 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:29:40 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:29:40 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:29:40 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:29:40 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:29:40 user nova-compute[72820]:       <nova:owner>
Aug 27 02:29:40 user nova-compute[72820]:         <nova:user uuid="3e735f5da8264ad3aff41701162c4d48">tempest-TestServerVolumeAttachmentScenario-1979275595-project-member</nova:user>
Aug 27 02:29:40 user nova-compute[72820]:         <nova:project uuid="7cf987dacdf44dc4807c74d4aa283357">tempest-TestServerVolumeAttachmentScenario-1979275595</nova:project>
Aug 27 02:29:40 user nova-compute[72820]:       </nova:owner>
Aug 27 02:29:40 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:29:40 user nova-compute[72820]:       <nova:ports>
Aug 27 02:29:40 user nova-compute[72820]:         <nova:port uuid="bcc2e999-9d21-4d4c-84b8-b29ffddfedb9">
Aug 27 02:29:40 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 02:29:40 user nova-compute[72820]:         </nova:port>
Aug 27 02:29:40 user nova-compute[72820]:       </nova:ports>
Aug 27 02:29:40 user nova-compute[72820]:     </nova:instance>
Aug 27 02:29:40 user nova-compute[72820]:   </metadata>
Aug 27 02:29:40 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:29:40 user nova-compute[72820]:     <system>
Aug 27 02:29:40 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:29:40 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:29:40 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:29:40 user nova-compute[72820]:       <entry name="serial">4becc265-4f3d-4f83-a9ac-c99100a870ff</entry>
Aug 27 02:29:40 user nova-compute[72820]:       <entry name="uuid">4becc265-4f3d-4f83-a9ac-c99100a870ff</entry>
Aug 27 02:29:40 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:29:40 user nova-compute[72820]:     </system>
Aug 27 02:29:40 user nova-compute[72820]:   </sysinfo>
Aug 27 02:29:40 user nova-compute[72820]:   <os>
Aug 27 02:29:40 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:29:40 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:29:40 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:29:40 user nova-compute[72820]:   </os>
Aug 27 02:29:40 user nova-compute[72820]:   <features>
Aug 27 02:29:40 user nova-compute[72820]:     <acpi/>
Aug 27 02:29:40 user nova-compute[72820]:     <apic/>
Aug 27 02:29:40 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:29:40 user nova-compute[72820]:   </features>
Aug 27 02:29:40 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:29:40 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:29:40 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:29:40 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:29:40 user nova-compute[72820]:   </clock>
Aug 27 02:29:40 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:29:40 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:29:40 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:29:40 user nova-compute[72820]:   </cpu>
Aug 27 02:29:40 user nova-compute[72820]:   <devices>
Aug 27 02:29:40 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:29:40 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:29:40 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk"/>
Aug 27 02:29:40 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:29:40 user nova-compute[72820]:     </disk>
Aug 27 02:29:40 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:29:40 user nova-compute[72820]:       <mac address="fa:16:3e:ec:8f:95"/>
Aug 27 02:29:40 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:29:40 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:29:40 user nova-compute[72820]:       <target dev="tapbcc2e999-9d"/>
Aug 27 02:29:40 user nova-compute[72820]:     </interface>
Aug 27 02:29:40 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:29:40 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/console.log" append="off"/>
Aug 27 02:29:40 user nova-compute[72820]:     </serial>
Aug 27 02:29:40 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:29:40 user nova-compute[72820]:     <video>
Aug 27 02:29:40 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:29:40 user nova-compute[72820]:     </video>
Aug 27 02:29:40 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:29:40 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:29:40 user nova-compute[72820]:     </rng>
Aug 27 02:29:40 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:29:40 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:29:40 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:29:40 user nova-compute[72820]:     </memballoon>
Aug 27 02:29:40 user nova-compute[72820]:   </devices>
Aug 27 02:29:40 user nova-compute[72820]: </domain>
Aug 27 02:29:40 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:29:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1898566739',display_name='tempest-TestServerVolumeAttachmentScenario-server-1898566739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1898566739',id=22,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFP+coPRpBylk52REDP+mkyumO81JyK+gqbVexAR60ZJzkXK961Oj38U8NDVNnz8Nuit1ORYLVX1+y2o06cai7IE0yKpBLBL/lVlto4q0eWPd7vHwECBdpQJ0dam/5dV9g==',key_name='tempest-keypair-1781491230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf987dacdf44dc4807c74d4aa283357',ramdisk_id='',reservation_id='r-xbt4xpy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1979275595',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1979275595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:29:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e735f5da8264ad3aff41701162c4d48',uuid=4becc265-4f3d-4f83-a9ac-c99100a870ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "address": "fa:16:3e:ec:8f:95", "network": {"id": "39de3116-51df-478a-bead-efb89526d4d2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-127107834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf987dacdf44dc4807c74d4aa283357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcc2e999-9d", "ovs_interfaceid": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Converting VIF {"id": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "address": "fa:16:3e:ec:8f:95", "network": {"id": "39de3116-51df-478a-bead-efb89526d4d2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-127107834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf987dacdf44dc4807c74d4aa283357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcc2e999-9d", "ovs_interfaceid": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:8f:95,bridge_name='br-int',has_traffic_filtering=True,id=bcc2e999-9d21-4d4c-84b8-b29ffddfedb9,network=Network(39de3116-51df-478a-bead-efb89526d4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcc2e999-9d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG os_vif [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:8f:95,bridge_name='br-int',has_traffic_filtering=True,id=bcc2e999-9d21-4d4c-84b8-b29ffddfedb9,network=Network(39de3116-51df-478a-bead-efb89526d4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcc2e999-9d') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcc2e999-9d, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbcc2e999-9d, col_values=(('external_ids', {'iface-id': 'bcc2e999-9d21-4d4c-84b8-b29ffddfedb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:8f:95', 'vm-uuid': '4becc265-4f3d-4f83-a9ac-c99100a870ff'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:40 user nova-compute[72820]: INFO os_vif [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:8f:95,bridge_name='br-int',has_traffic_filtering=True,id=bcc2e999-9d21-4d4c-84b8-b29ffddfedb9,network=Network(39de3116-51df-478a-bead-efb89526d4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcc2e999-9d')
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] No VIF found with MAC fa:16:3e:ec:8f:95, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.network.neutron [req-039daa5f-d92c-4ab3-b70a-ccb36ccb2159 req-b5b31ff9-9802-4cb6-882b-4e43ee170fd8 service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Updated VIF entry in instance network info cache for port bcc2e999-9d21-4d4c-84b8-b29ffddfedb9. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG nova.network.neutron [req-039daa5f-d92c-4ab3-b70a-ccb36ccb2159 req-b5b31ff9-9802-4cb6-882b-4e43ee170fd8 service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Updating instance_info_cache with network_info: [{"id": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "address": "fa:16:3e:ec:8f:95", "network": {"id": "39de3116-51df-478a-bead-efb89526d4d2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-127107834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf987dacdf44dc4807c74d4aa283357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcc2e999-9d", "ovs_interfaceid": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:29:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-039daa5f-d92c-4ab3-b70a-ccb36ccb2159 req-b5b31ff9-9802-4cb6-882b-4e43ee170fd8 service nova] Releasing lock "refresh_cache-4becc265-4f3d-4f83-a9ac-c99100a870ff" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:29:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-fa24a305-7b81-4d0f-bd26-e62b3a3ff25f req-b91101ae-cc13-4eb8-9cd0-87b5d657b96a service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received event network-changed-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-fa24a305-7b81-4d0f-bd26-e62b3a3ff25f req-b91101ae-cc13-4eb8-9cd0-87b5d657b96a service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Refreshing instance network info cache due to event network-changed-03bf65d2-99ae-4eea-863b-3edc35e19dd4. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:29:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fa24a305-7b81-4d0f-bd26-e62b3a3ff25f req-b91101ae-cc13-4eb8-9cd0-87b5d657b96a service nova] Acquiring lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:29:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fa24a305-7b81-4d0f-bd26-e62b3a3ff25f req-b91101ae-cc13-4eb8-9cd0-87b5d657b96a service nova] Acquired lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:29:42 user nova-compute[72820]: DEBUG nova.network.neutron [req-fa24a305-7b81-4d0f-bd26-e62b3a3ff25f req-b91101ae-cc13-4eb8-9cd0-87b5d657b96a service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Refreshing network info cache for port 03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:29:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:42 user nova-compute[72820]: DEBUG nova.network.neutron [req-fa24a305-7b81-4d0f-bd26-e62b3a3ff25f req-b91101ae-cc13-4eb8-9cd0-87b5d657b96a service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Updated VIF entry in instance network info cache for port 03bf65d2-99ae-4eea-863b-3edc35e19dd4. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:29:42 user nova-compute[72820]: DEBUG nova.network.neutron [req-fa24a305-7b81-4d0f-bd26-e62b3a3ff25f req-b91101ae-cc13-4eb8-9cd0-87b5d657b96a service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Updating instance_info_cache with network_info: [{"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:29:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fa24a305-7b81-4d0f-bd26-e62b3a3ff25f req-b91101ae-cc13-4eb8-9cd0-87b5d657b96a service nova] Releasing lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:29:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "94323d83-f8fe-4814-82af-f860a20071bf" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "94323d83-f8fe-4814-82af-f860a20071bf" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:43 user nova-compute[72820]: INFO nova.compute.manager [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Shelve offloading
Aug 27 02:29:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:43 user nova-compute[72820]: DEBUG nova.compute.manager [req-b6fa9575-a23c-4d04-923f-5e3706299e7f req-6760dcd0-7750-47af-a024-3f82e1580f79 service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received event network-vif-unplugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b6fa9575-a23c-4d04-923f-5e3706299e7f req-6760dcd0-7750-47af-a024-3f82e1580f79 service nova] Acquiring lock "94323d83-f8fe-4814-82af-f860a20071bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b6fa9575-a23c-4d04-923f-5e3706299e7f req-6760dcd0-7750-47af-a024-3f82e1580f79 service nova] Lock "94323d83-f8fe-4814-82af-f860a20071bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b6fa9575-a23c-4d04-923f-5e3706299e7f req-6760dcd0-7750-47af-a024-3f82e1580f79 service nova] Lock "94323d83-f8fe-4814-82af-f860a20071bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:43 user nova-compute[72820]: DEBUG nova.compute.manager [req-b6fa9575-a23c-4d04-923f-5e3706299e7f req-6760dcd0-7750-47af-a024-3f82e1580f79 service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] No waiting events found dispatching network-vif-unplugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:29:43 user nova-compute[72820]: WARNING nova.compute.manager [req-b6fa9575-a23c-4d04-923f-5e3706299e7f req-6760dcd0-7750-47af-a024-3f82e1580f79 service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received unexpected event network-vif-unplugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 for instance with vm_state active and task_state shelving.
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103384.010803, 4becc265-4f3d-4f83-a9ac-c99100a870ff => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:29:44 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] VM Resumed (Lifecycle Event)
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.compute.manager [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:29:44 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Instance spawned successfully.
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:29:44 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103384.012258, 4becc265-4f3d-4f83-a9ac-c99100a870ff => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:29:44 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] VM Started (Lifecycle Event)
Aug 27 02:29:44 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Instance destroyed successfully.
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.compute.manager [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquired lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.network.neutron [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:29:44 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:29:44 user nova-compute[72820]: INFO nova.compute.manager [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Took 6.25 seconds to spawn the instance on the hypervisor.
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.compute.manager [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:29:44 user nova-compute[72820]: INFO nova.compute.manager [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Took 7.17 seconds to build instance.
Aug 27 02:29:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bcb1f0a5-bd9e-4447-b044-2311d45a7061 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.277s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.compute.manager [req-a8d9f3c4-771c-4dbf-9846-39e4cbfe37a5 req-7b5d4d96-7e2c-4659-adcf-827535b11263 service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Received event network-vif-plugged-bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a8d9f3c4-771c-4dbf-9846-39e4cbfe37a5 req-7b5d4d96-7e2c-4659-adcf-827535b11263 service nova] Acquiring lock "4becc265-4f3d-4f83-a9ac-c99100a870ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a8d9f3c4-771c-4dbf-9846-39e4cbfe37a5 req-7b5d4d96-7e2c-4659-adcf-827535b11263 service nova] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a8d9f3c4-771c-4dbf-9846-39e4cbfe37a5 req-7b5d4d96-7e2c-4659-adcf-827535b11263 service nova] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.compute.manager [req-a8d9f3c4-771c-4dbf-9846-39e4cbfe37a5 req-7b5d4d96-7e2c-4659-adcf-827535b11263 service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] No waiting events found dispatching network-vif-plugged-bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:29:44 user nova-compute[72820]: WARNING nova.compute.manager [req-a8d9f3c4-771c-4dbf-9846-39e4cbfe37a5 req-7b5d4d96-7e2c-4659-adcf-827535b11263 service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Received unexpected event network-vif-plugged-bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 for instance with vm_state active and task_state None.
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.compute.manager [req-a8d9f3c4-771c-4dbf-9846-39e4cbfe37a5 req-7b5d4d96-7e2c-4659-adcf-827535b11263 service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Received event network-vif-plugged-bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a8d9f3c4-771c-4dbf-9846-39e4cbfe37a5 req-7b5d4d96-7e2c-4659-adcf-827535b11263 service nova] Acquiring lock "4becc265-4f3d-4f83-a9ac-c99100a870ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a8d9f3c4-771c-4dbf-9846-39e4cbfe37a5 req-7b5d4d96-7e2c-4659-adcf-827535b11263 service nova] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a8d9f3c4-771c-4dbf-9846-39e4cbfe37a5 req-7b5d4d96-7e2c-4659-adcf-827535b11263 service nova] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:44 user nova-compute[72820]: DEBUG nova.compute.manager [req-a8d9f3c4-771c-4dbf-9846-39e4cbfe37a5 req-7b5d4d96-7e2c-4659-adcf-827535b11263 service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] No waiting events found dispatching network-vif-plugged-bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:29:44 user nova-compute[72820]: WARNING nova.compute.manager [req-a8d9f3c4-771c-4dbf-9846-39e4cbfe37a5 req-7b5d4d96-7e2c-4659-adcf-827535b11263 service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Received unexpected event network-vif-plugged-bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 for instance with vm_state active and task_state None.
Aug 27 02:29:45 user nova-compute[72820]: DEBUG nova.network.neutron [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Updating instance_info_cache with network_info: [{"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Releasing lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-37f90cca-8127-4074-a9b8-33bb85cbe6fb req-ea678360-9933-465b-b4c0-5d21e36a3d34 service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received event network-vif-plugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-37f90cca-8127-4074-a9b8-33bb85cbe6fb req-ea678360-9933-465b-b4c0-5d21e36a3d34 service nova] Acquiring lock "94323d83-f8fe-4814-82af-f860a20071bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-37f90cca-8127-4074-a9b8-33bb85cbe6fb req-ea678360-9933-465b-b4c0-5d21e36a3d34 service nova] Lock "94323d83-f8fe-4814-82af-f860a20071bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-37f90cca-8127-4074-a9b8-33bb85cbe6fb req-ea678360-9933-465b-b4c0-5d21e36a3d34 service nova] Lock "94323d83-f8fe-4814-82af-f860a20071bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-37f90cca-8127-4074-a9b8-33bb85cbe6fb req-ea678360-9933-465b-b4c0-5d21e36a3d34 service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] No waiting events found dispatching network-vif-plugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:29:45 user nova-compute[72820]: WARNING nova.compute.manager [req-37f90cca-8127-4074-a9b8-33bb85cbe6fb req-ea678360-9933-465b-b4c0-5d21e36a3d34 service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received unexpected event network-vif-plugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 for instance with vm_state active and task_state shelving.
Aug 27 02:29:45 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Instance destroyed successfully.
Aug 27 02:29:45 user nova-compute[72820]: DEBUG nova.objects.instance [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lazy-loading 'resources' on Instance uuid 94323d83-f8fe-4814-82af-f860a20071bf {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1937387142',display_name='tempest-TestShelveInstance-server-1937387142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1937387142',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTe/Ws++PTjVd38AijjMR1+3JeXnwOZ3a2pV/iawjQkNYhlRUt5WM3DtBBg+vTai/JuZmVSemEe8iX7whVOhmmkcL7ICmzX59GN2erKSMY/1YIdlhzg0vy84VQcjCbfyw==',key_name='tempest-TestShelveInstance-1669796109',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:28:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbf36cee8a5645d5950878c914bf1f85',ramdisk_id='',reservation_id='r-u2u632ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1813275073',owner_user_name='tempest-TestShelveInstance-1813275073-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:28:17Z,user_data=None,user_id='4863de7cf43b4c8599cfc292b3308f56',uuid=94323d83-f8fe-4814-82af-f860a20071bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Converting VIF {"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:59,bridge_name='br-int',has_traffic_filtering=True,id=03bf65d2-99ae-4eea-863b-3edc35e19dd4,network=Network(36de333f-9660-4657-89e8-fd4409b55471),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf65d2-99') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG os_vif [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:59,bridge_name='br-int',has_traffic_filtering=True,id=03bf65d2-99ae-4eea-863b-3edc35e19dd4,network=Network(36de333f-9660-4657-89e8-fd4409b55471),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf65d2-99') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-7bdf7455-3178-499d-9dea-cb4ed103dc88 req-42355a00-aa0c-4d8d-9078-5d2835cf1f8d service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received event network-changed-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-7bdf7455-3178-499d-9dea-cb4ed103dc88 req-42355a00-aa0c-4d8d-9078-5d2835cf1f8d service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Refreshing instance network info cache due to event network-changed-03bf65d2-99ae-4eea-863b-3edc35e19dd4. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7bdf7455-3178-499d-9dea-cb4ed103dc88 req-42355a00-aa0c-4d8d-9078-5d2835cf1f8d service nova] Acquiring lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7bdf7455-3178-499d-9dea-cb4ed103dc88 req-42355a00-aa0c-4d8d-9078-5d2835cf1f8d service nova] Acquired lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG nova.network.neutron [req-7bdf7455-3178-499d-9dea-cb4ed103dc88 req-42355a00-aa0c-4d8d-9078-5d2835cf1f8d service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Refreshing network info cache for port 03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03bf65d2-99, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:45 user nova-compute[72820]: INFO os_vif [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:59,bridge_name='br-int',has_traffic_filtering=True,id=03bf65d2-99ae-4eea-863b-3edc35e19dd4,network=Network(36de333f-9660-4657-89e8-fd4409b55471),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf65d2-99')
Aug 27 02:29:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIGKvAka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:29:45 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:29:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[70de3538-535b-4455-868c-395d6107d4ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:29:45 user nova-compute[72820]: No targets found.
Aug 27 02:29:45 user nova-compute[72820]: iSNS:
Aug 27 02:29:45 user nova-compute[72820]: No targets found.
Aug 27 02:29:45 user nova-compute[72820]: STATIC:
Aug 27 02:29:45 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047
Aug 27 02:29:45 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:45 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:45 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37
Aug 27 02:29:45 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:45 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:45 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:29:45 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:45 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:45 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94
Aug 27 02:29:45 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:45 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:45 user nova-compute[72820]: FIRMWARE:
Aug 27 02:29:45 user nova-compute[72820]: No targets found.
Aug 27 02:29:45 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:29:45 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:29:45 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c296795-a365-47f7-b158-e00d9e958982]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[591eb5b1-6d93-4b71-b426-7fbb13a32f93]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:46 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:46 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:46 user nova-compute[72820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)
Aug 27 02:29:46 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:46 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:46 user nova-compute[72820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:29:46 user nova-compute[72820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)
Aug 27 02:29:46 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c02065f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37'): ({'sdh'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Removing single pathed devices sdh {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[208403b1-55cd-4984-b822-2723d88b55ed]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadc38f6-0498-4792-9f8c-042557342b99]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Flushing IO for device /dev/sdh {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbfb131-df0c-4a07-b91c-21077a6171e7]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.061s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42f4d52-f807-4879-bb66-de85b90202e9]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] SCSI volumes sdh have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.041s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22b106d-8cb9-4750-b756-8ce1e5b9d370]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b4ddd6-ff9f-4692-ace3-37935f11d203]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37, portal: 172.16.0.220,3260]
Aug 27 02:29:46 user nova-compute[72820]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37, portal: 172.16.0.220,3260] successful.
Aug 27 02:29:46 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e8ebea-33bc-42ac-9e10-7b63228bba17]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] <== disconnect_volume: return (361ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:29:46 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Deleting instance files /opt/stack/data/nova/instances/94323d83-f8fe-4814-82af-f860a20071bf_del
Aug 27 02:29:46 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Deletion of /opt/stack/data/nova/instances/94323d83-f8fe-4814-82af-f860a20071bf_del complete
Aug 27 02:29:46 user nova-compute[72820]: DEBUG nova.network.neutron [req-7bdf7455-3178-499d-9dea-cb4ed103dc88 req-42355a00-aa0c-4d8d-9078-5d2835cf1f8d service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Updated VIF entry in instance network info cache for port 03bf65d2-99ae-4eea-863b-3edc35e19dd4. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG nova.network.neutron [req-7bdf7455-3178-499d-9dea-cb4ed103dc88 req-42355a00-aa0c-4d8d-9078-5d2835cf1f8d service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Updating instance_info_cache with network_info: [{"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": null, "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap03bf65d2-99", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:29:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7bdf7455-3178-499d-9dea-cb4ed103dc88 req-42355a00-aa0c-4d8d-9078-5d2835cf1f8d service nova] Releasing lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:29:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:47 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Deleted allocations for instance 94323d83-f8fe-4814-82af-f860a20071bf
Aug 27 02:29:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:47 user nova-compute[72820]: DEBUG nova.objects.instance [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lazy-loading 'numa_topology' on Instance uuid 94323d83-f8fe-4814-82af-f860a20071bf {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:29:47 user nova-compute[72820]: DEBUG nova.objects.base [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Object Instance<94323d83-f8fe-4814-82af-f860a20071bf> lazy-loaded attributes: resources,numa_topology {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:29:48 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:29:48 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:29:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-abe3aa90-1022-4fb5-9bfc-e9c0bc6b8a8f tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "94323d83-f8fe-4814-82af-f860a20071bf" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.865s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'flavor' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "refresh_cache-050e0c2b-9244-4987-b07d-e4712e46f936" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquired lock "refresh_cache-050e0c2b-9244-4987-b07d-e4712e46f936" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG nova.network.neutron [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'info_cache' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG nova.objects.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Object Instance<050e0c2b-9244-4987-b07d-e4712e46f936> lazy-loaded attributes: flavor,info_cache {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG nova.network.neutron [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Updating instance_info_cache with network_info: [{"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Releasing lock "refresh_cache-050e0c2b-9244-4987-b07d-e4712e46f936" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:29:52 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Instance destroyed successfully.
Aug 27 02:29:52 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'resources' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG nova.objects.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Object Instance<050e0c2b-9244-4987-b07d-e4712e46f936> lazy-loaded attributes: flavor,info_cache,resources {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1528827756',display_name='tempest-AttachVolumeTestJSON-server-1528827756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1528827756',id=14,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnSgUcneqrQT+fSR64ZBXTU7w6gH3FRUC28AIjZT1OTuPJeA2iK/PRvmUdcnaeRQRx9F2cfuohCq3KKKqoUGjjYwRrOZbZ+RipxFTfAfbkjmPR9pHpU0nOexJ+36eDqvA==',key_name='tempest-keypair-290646663',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a70199cb55f74880a86a7f4d2342054e',ramdisk_id='',reservation_id='r-iy5ykdf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-316094052',owner_user_name='tempest-AttachVolumeTestJSON-316094052-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbbf87fbd76543bab71f44d664bec48c',uuid=050e0c2b-9244-4987-b07d-e4712e46f936,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converting VIF {"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG os_vif [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6c019c8-6c, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:52 user nova-compute[72820]: INFO os_vif [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c')
Aug 27 02:29:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlOEvWhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:29:52 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:29:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[75438a96-0090-47d7-9e74-7a74f7452940]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:29:52 user nova-compute[72820]: No targets found.
Aug 27 02:29:52 user nova-compute[72820]: iSNS:
Aug 27 02:29:52 user nova-compute[72820]: No targets found.
Aug 27 02:29:52 user nova-compute[72820]: STATIC:
Aug 27 02:29:52 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047
Aug 27 02:29:52 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:52 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:52 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:29:52 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:52 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:52 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94
Aug 27 02:29:52 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:29:52 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:29:52 user nova-compute[72820]: FIRMWARE:
Aug 27 02:29:52 user nova-compute[72820]: No targets found.
Aug 27 02:29:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:29:52 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:29:52 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4a1331-7189-4446-9c03-8a22aac1660c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a22704f-4502-41dd-923c-46d99f80f935]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:52 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:52 user nova-compute[72820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)
Aug 27 02:29:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:52 user nova-compute[72820]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:52 user nova-compute[72820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)
Aug 27 02:29:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a05970a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047'): ({'sdg'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Removing single pathed devices sdg {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cb86a1-9258-4845-8a76-423980b09cfd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[220d5aa2-ba99-4f30-8464-5d2188c44586]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Flushing IO for device /dev/sdg {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0cb503-d9f0-4171-8e7c-84bd15a053d4]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:29:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9e5cc0-0654-4888-bf2c-86541044f1fe]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] SCSI volumes sdg have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[afee7e56-1a22-4c69-9739-f604213d7dde]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69b0611-f214-4ce8-87d2-e9fc923d38e4]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047, portal: 172.16.0.220,3260]
Aug 27 02:29:53 user nova-compute[72820]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047, portal: 172.16.0.220,3260] successful.
Aug 27 02:29:53 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7b9029-3ae9-4c41-ae47-0200dbdaf7cb]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] <== disconnect_volume: return (311ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Start _get_guest_xml network_info=[{"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c4ff6c23-4aaa-409e-aad2-6e788594d1b9', 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlOEvWhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '050e0c2b-9244-4987-b07d-e4712e46f936', 'attached_at': '', 'detached_at': '', 'volume_id': 'eef65157-3d3e-4206-a2a3-d72d56a55047', 'serial': 'eef65157-3d3e-4206-a2a3-d72d56a55047'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'numa_topology' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.objects.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Object Instance<050e0c2b-9244-4987-b07d-e4712e46f936> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:29:53 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:29:53 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'vcpu_model' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.objects.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Object Instance<050e0c2b-9244-4987-b07d-e4712e46f936> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlOEvWhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:29:53 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:29:53 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:29:53 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0a848e-b365-474f-b536-c8666896041d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:29:53 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dbb9da-ea40-4369-a443-43272536a97a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047] added
Aug 27 02:29:53 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1017caab-d3eb-4244-a74c-2f7ae344ac85]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d0c85d-b162-4085-bc21-6549392becf9]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GlOEvWhi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GlOEvWhi" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b21fdd-9ab5-4329-a5c2-43a650953684]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GlOEvWhi'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1dfcb6-4429-4d48-a79a-27d12495e389]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b33dc2-6455-4b62-b378-152c7fd73c8f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:53 user nova-compute[72820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)
Aug 27 02:29:53 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:53 user nova-compute[72820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)
Aug 27 02:29:53 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc88f5c-7891-4992-9e88-80aaf7568e87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047, portal: 172.16.0.220,3260]
Aug 27 02:29:53 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047, portal: 172.16.0.220,3260] successful.
Aug 27 02:29:53 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d63c8f6-6c28-4669-8bf6-10c4811107ee]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[996a90b3-5f2e-4415-afc9-0da2a4bf0855]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:53 user nova-compute[72820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)
Aug 27 02:29:53 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:53 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:29:53 user nova-compute[72820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)
Aug 27 02:29:53 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:29:53 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92025cc-3512-4e57-9ec3-f3104fdf24c1]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:29:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlOEvWhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:29:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:29:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23462383238653339', 'path': '/dev/sdc'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:29:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462383238653339', 'path': '/dev/sdc'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:29:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1528827756',display_name='tempest-AttachVolumeTestJSON-server-1528827756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1528827756',id=14,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnSgUcneqrQT+fSR64ZBXTU7w6gH3FRUC28AIjZT1OTuPJeA2iK/PRvmUdcnaeRQRx9F2cfuohCq3KKKqoUGjjYwRrOZbZ+RipxFTfAfbkjmPR9pHpU0nOexJ+36eDqvA==',key_name='tempest-keypair-290646663',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a70199cb55f74880a86a7f4d2342054e',ramdisk_id='',reservation_id='r-iy5ykdf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-316094052',owner_user_name='tempest-AttachVolumeTestJSON-316094052-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbbf87fbd76543bab71f44d664bec48c',uuid=050e0c2b-9244-4987-b07d-e4712e46f936,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:29:54 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converting VIF {"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:29:54 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:29:54 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'pci_devices' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:29:54 user nova-compute[72820]: DEBUG nova.objects.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Object Instance<050e0c2b-9244-4987-b07d-e4712e46f936> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:29:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:29:54 user nova-compute[72820]:   <uuid>050e0c2b-9244-4987-b07d-e4712e46f936</uuid>
Aug 27 02:29:54 user nova-compute[72820]:   <name>instance-0000000e</name>
Aug 27 02:29:54 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:29:54 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:29:54 user nova-compute[72820]:   <metadata>
Aug 27 02:29:54 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:29:54 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:29:54 user nova-compute[72820]:       <nova:name>tempest-AttachVolumeTestJSON-server-1528827756</nova:name>
Aug 27 02:29:54 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:29:53</nova:creationTime>
Aug 27 02:29:54 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:29:54 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:29:54 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:29:54 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:29:54 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:29:54 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:29:54 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:29:54 user nova-compute[72820]:       <nova:owner>
Aug 27 02:29:54 user nova-compute[72820]:         <nova:user uuid="bbbf87fbd76543bab71f44d664bec48c">tempest-AttachVolumeTestJSON-316094052-project-member</nova:user>
Aug 27 02:29:54 user nova-compute[72820]:         <nova:project uuid="a70199cb55f74880a86a7f4d2342054e">tempest-AttachVolumeTestJSON-316094052</nova:project>
Aug 27 02:29:54 user nova-compute[72820]:       </nova:owner>
Aug 27 02:29:54 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:29:54 user nova-compute[72820]:       <nova:ports>
Aug 27 02:29:54 user nova-compute[72820]:         <nova:port uuid="a6c019c8-6c53-44fd-a6f0-004d2f9b5a55">
Aug 27 02:29:54 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 02:29:54 user nova-compute[72820]:         </nova:port>
Aug 27 02:29:54 user nova-compute[72820]:       </nova:ports>
Aug 27 02:29:54 user nova-compute[72820]:     </nova:instance>
Aug 27 02:29:54 user nova-compute[72820]:   </metadata>
Aug 27 02:29:54 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:29:54 user nova-compute[72820]:     <system>
Aug 27 02:29:54 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:29:54 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:29:54 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:29:54 user nova-compute[72820]:       <entry name="serial">050e0c2b-9244-4987-b07d-e4712e46f936</entry>
Aug 27 02:29:54 user nova-compute[72820]:       <entry name="uuid">050e0c2b-9244-4987-b07d-e4712e46f936</entry>
Aug 27 02:29:54 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:29:54 user nova-compute[72820]:     </system>
Aug 27 02:29:54 user nova-compute[72820]:   </sysinfo>
Aug 27 02:29:54 user nova-compute[72820]:   <os>
Aug 27 02:29:54 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:29:54 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:29:54 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:29:54 user nova-compute[72820]:   </os>
Aug 27 02:29:54 user nova-compute[72820]:   <features>
Aug 27 02:29:54 user nova-compute[72820]:     <acpi/>
Aug 27 02:29:54 user nova-compute[72820]:     <apic/>
Aug 27 02:29:54 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:29:54 user nova-compute[72820]:   </features>
Aug 27 02:29:54 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:29:54 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:29:54 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:29:54 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:29:54 user nova-compute[72820]:   </clock>
Aug 27 02:29:54 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:29:54 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:29:54 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:29:54 user nova-compute[72820]:   </cpu>
Aug 27 02:29:54 user nova-compute[72820]:   <devices>
Aug 27 02:29:54 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:29:54 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:29:54 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk"/>
Aug 27 02:29:54 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:29:54 user nova-compute[72820]:     </disk>
Aug 27 02:29:54 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:29:54 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:29:54 user nova-compute[72820]:       <source dev="/dev/sdc"/>
Aug 27 02:29:54 user nova-compute[72820]:       <target dev="vdb" bus="virtio"/>
Aug 27 02:29:54 user nova-compute[72820]:       <serial>eef65157-3d3e-4206-a2a3-d72d56a55047</serial>
Aug 27 02:29:54 user nova-compute[72820]:     </disk>
Aug 27 02:29:54 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:29:54 user nova-compute[72820]:       <mac address="fa:16:3e:a4:94:7e"/>
Aug 27 02:29:54 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:29:54 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:29:54 user nova-compute[72820]:       <target dev="tapa6c019c8-6c"/>
Aug 27 02:29:54 user nova-compute[72820]:     </interface>
Aug 27 02:29:54 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:29:54 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/console.log" append="off"/>
Aug 27 02:29:54 user nova-compute[72820]:     </serial>
Aug 27 02:29:54 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:29:54 user nova-compute[72820]:     <video>
Aug 27 02:29:54 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:29:54 user nova-compute[72820]:     </video>
Aug 27 02:29:54 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:29:54 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:29:54 user nova-compute[72820]:     </rng>
Aug 27 02:29:54 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:29:54 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:29:54 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:29:54 user nova-compute[72820]:     </memballoon>
Aug 27 02:29:54 user nova-compute[72820]:   </devices>
Aug 27 02:29:54 user nova-compute[72820]: </domain>
Aug 27 02:29:54 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:29:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'trusted_certs' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG nova.objects.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Object Instance<050e0c2b-9244-4987-b07d-e4712e46f936> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.230s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Checking if we can resize image /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Cannot resize image /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'migration_context' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG nova.objects.base [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Object Instance<050e0c2b-9244-4987-b07d-e4712e46f936> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1528827756',display_name='tempest-AttachVolumeTestJSON-server-1528827756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1528827756',id=14,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnSgUcneqrQT+fSR64ZBXTU7w6gH3FRUC28AIjZT1OTuPJeA2iK/PRvmUdcnaeRQRx9F2cfuohCq3KKKqoUGjjYwRrOZbZ+RipxFTfAfbkjmPR9pHpU0nOexJ+36eDqvA==',key_name='tempest-keypair-290646663',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a70199cb55f74880a86a7f4d2342054e',ramdisk_id='',reservation_id='r-iy5ykdf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-316094052',owner_user_name='tempest-AttachVolumeTestJSON-316094052-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbbf87fbd76543bab71f44d664bec48c',uuid=050e0c2b-9244-4987-b07d-e4712e46f936,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converting VIF {"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG os_vif [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6c019c8-6c, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa6c019c8-6c, col_values=(('external_ids', {'iface-id': 'a6c019c8-6c53-44fd-a6f0-004d2f9b5a55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:94:7e', 'vm-uuid': '050e0c2b-9244-4987-b07d-e4712e46f936'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:29:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:55 user nova-compute[72820]: INFO os_vif [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c')
Aug 27 02:29:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-cc7ea0e2-3764-4ca9-b33f-8f9554520b61 req-56d92be7-b4ec-4206-825d-e38f874bc849 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received event network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-cc7ea0e2-3764-4ca9-b33f-8f9554520b61 req-56d92be7-b4ec-4206-825d-e38f874bc849 service nova] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-cc7ea0e2-3764-4ca9-b33f-8f9554520b61 req-56d92be7-b4ec-4206-825d-e38f874bc849 service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-cc7ea0e2-3764-4ca9-b33f-8f9554520b61 req-56d92be7-b4ec-4206-825d-e38f874bc849 service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-cc7ea0e2-3764-4ca9-b33f-8f9554520b61 req-56d92be7-b4ec-4206-825d-e38f874bc849 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] No waiting events found dispatching network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:29:57 user nova-compute[72820]: WARNING nova.compute.manager [req-cc7ea0e2-3764-4ca9-b33f-8f9554520b61 req-56d92be7-b4ec-4206-825d-e38f874bc849 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received unexpected event network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 for instance with vm_state stopped and task_state powering-on.
Aug 27 02:29:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:29:59 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103384.0572348, 94323d83-f8fe-4814-82af-f860a20071bf => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:29:59 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] VM Stopped (Lifecycle Event)
Aug 27 02:29:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-78c335ba-4388-4e27-901a-7cadca89c92a None None] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:29:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-94a1c8a0-cd96-4417-8d72-323ea825c68f req-1e7c6900-810f-44fe-8d3b-4a046e4e8647 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received event network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:29:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-94a1c8a0-cd96-4417-8d72-323ea825c68f req-1e7c6900-810f-44fe-8d3b-4a046e4e8647 service nova] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:29:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-94a1c8a0-cd96-4417-8d72-323ea825c68f req-1e7c6900-810f-44fe-8d3b-4a046e4e8647 service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:29:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-94a1c8a0-cd96-4417-8d72-323ea825c68f req-1e7c6900-810f-44fe-8d3b-4a046e4e8647 service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:29:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-94a1c8a0-cd96-4417-8d72-323ea825c68f req-1e7c6900-810f-44fe-8d3b-4a046e4e8647 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] No waiting events found dispatching network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:29:59 user nova-compute[72820]: WARNING nova.compute.manager [req-94a1c8a0-cd96-4417-8d72-323ea825c68f req-1e7c6900-810f-44fe-8d3b-4a046e4e8647 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received unexpected event network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 for instance with vm_state stopped and task_state powering-on.
Aug 27 02:29:59 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103399.71297, 050e0c2b-9244-4987-b07d-e4712e46f936 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:29:59 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] VM Resumed (Lifecycle Event)
Aug 27 02:29:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:29:59 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Instance rebooted successfully.
Aug 27 02:29:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-bd0b3190-6e1c-4e05-8e69-a2398b03cc43 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:29:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:29:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:29:59 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 27 02:29:59 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103399.7154002, 050e0c2b-9244-4987-b07d-e4712e46f936 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:29:59 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] VM Started (Lifecycle Event)
Aug 27 02:29:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:29:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:30:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:02 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:30:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:03 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:30:03 user nova-compute[72820]: INFO nova.compute.claims [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Claim successful on node user
Aug 27 02:30:03 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:30:03 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:30:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.753s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:03 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:30:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:03 user nova-compute[72820]: INFO nova.compute.manager [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Terminating instance
Aug 27 02:30:03 user nova-compute[72820]: DEBUG nova.compute.manager [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:30:03 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:30:03 user nova-compute[72820]: DEBUG nova.network.neutron [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:30:03 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:30:03 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:30:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:30:04 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Creating image(s)
Aug 27 02:30:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "/opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "/opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "/opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG nova.compute.manager [req-d3685b7a-b3dc-42f8-9688-63b1377fd48a req-10e4e823-c0e8-474c-98ab-88fafb38fdd9 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received event network-vif-unplugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d3685b7a-b3dc-42f8-9688-63b1377fd48a req-10e4e823-c0e8-474c-98ab-88fafb38fdd9 service nova] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d3685b7a-b3dc-42f8-9688-63b1377fd48a req-10e4e823-c0e8-474c-98ab-88fafb38fdd9 service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d3685b7a-b3dc-42f8-9688-63b1377fd48a req-10e4e823-c0e8-474c-98ab-88fafb38fdd9 service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG nova.compute.manager [req-d3685b7a-b3dc-42f8-9688-63b1377fd48a req-10e4e823-c0e8-474c-98ab-88fafb38fdd9 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] No waiting events found dispatching network-vif-unplugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG nova.compute.manager [req-d3685b7a-b3dc-42f8-9688-63b1377fd48a req-10e4e823-c0e8-474c-98ab-88fafb38fdd9 service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received event network-vif-unplugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG nova.policy [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76b3417256eb4ff7924db6912e97726c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddd7d54478749cba3988913864379ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.265s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.236s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/disk 1073741824" returned: 0 in 0.083s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:04 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Instance destroyed successfully.
Aug 27 02:30:04 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lazy-loading 'resources' on Instance uuid f37dfe42-3b22-4111-b10d-9459c8c42b2d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T02:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-421019104',display_name='tempest-ServerActionsTestOtherA-server-879680922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-421019104',id=13,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMw/Y2giaEd949A8TrcWBPdl2Eikv6Xenmfv4cllzQw8aisIhzqkeUdBQYtbr+OYny0m8MqNxEwe+yjAuXRnQEEmz90bzQRRLT4my2+BuCn44VZPZT8Z8gGsdaV35h+jg==',key_name='tempest-keypair-1823346990',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:26:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7797569db44f40f193483e6e6933a0d0',ramdisk_id='',reservation_id='r-251z002r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-892102693',owner_user_name='tempest-ServerActionsTestOtherA-892102693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:26:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='275f713edfd042d4b4fa32620956484a',uuid=f37dfe42-3b22-4111-b10d-9459c8c42b2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "address": "fa:16:3e:8f:f1:36", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd1df-17", "ovs_interfaceid": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converting VIF {"id": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "address": "fa:16:3e:8f:f1:36", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd1df-17", "ovs_interfaceid": "525fd1df-177d-44ee-a88d-e6dcde84e9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=525fd1df-177d-44ee-a88d-e6dcde84e9d4,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd1df-17') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG os_vif [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=525fd1df-177d-44ee-a88d-e6dcde84e9d4,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd1df-17') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap525fd1df-17, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:30:04 user nova-compute[72820]: INFO os_vif [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=525fd1df-177d-44ee-a88d-e6dcde84e9d4,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd1df-17')
Aug 27 02:30:04 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Deleting instance files /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d_del
Aug 27 02:30:04 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Deletion of /opt/stack/data/nova/instances/f37dfe42-3b22-4111-b10d-9459c8c42b2d_del complete
Aug 27 02:30:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.271s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:30:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:05 user nova-compute[72820]: INFO nova.compute.manager [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 27 02:30:05 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:30:05 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:30:05 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:30:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:05 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Cannot resize image /opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:30:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:30:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Ensure instance console log exists: /opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:30:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:05 user nova-compute[72820]: DEBUG nova.network.neutron [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Successfully created port: 95c4ddc9-d1c5-434a-b733-f59fdc71e748 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-21811937-1c96-4ed3-b56d-0844bca2f6b7 req-5c67cb6f-7dee-492d-b013-826930752f5f service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received event network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-21811937-1c96-4ed3-b56d-0844bca2f6b7 req-5c67cb6f-7dee-492d-b013-826930752f5f service nova] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-21811937-1c96-4ed3-b56d-0844bca2f6b7 req-5c67cb6f-7dee-492d-b013-826930752f5f service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-21811937-1c96-4ed3-b56d-0844bca2f6b7 req-5c67cb6f-7dee-492d-b013-826930752f5f service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-21811937-1c96-4ed3-b56d-0844bca2f6b7 req-5c67cb6f-7dee-492d-b013-826930752f5f service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] No waiting events found dispatching network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:30:06 user nova-compute[72820]: WARNING nova.compute.manager [req-21811937-1c96-4ed3-b56d-0844bca2f6b7 req-5c67cb6f-7dee-492d-b013-826930752f5f service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received unexpected event network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 for instance with vm_state active and task_state deleting.
Aug 27 02:30:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-21811937-1c96-4ed3-b56d-0844bca2f6b7 req-5c67cb6f-7dee-492d-b013-826930752f5f service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received event network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-21811937-1c96-4ed3-b56d-0844bca2f6b7 req-5c67cb6f-7dee-492d-b013-826930752f5f service nova] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-21811937-1c96-4ed3-b56d-0844bca2f6b7 req-5c67cb6f-7dee-492d-b013-826930752f5f service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-21811937-1c96-4ed3-b56d-0844bca2f6b7 req-5c67cb6f-7dee-492d-b013-826930752f5f service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-21811937-1c96-4ed3-b56d-0844bca2f6b7 req-5c67cb6f-7dee-492d-b013-826930752f5f service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] No waiting events found dispatching network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:30:06 user nova-compute[72820]: WARNING nova.compute.manager [req-21811937-1c96-4ed3-b56d-0844bca2f6b7 req-5c67cb6f-7dee-492d-b013-826930752f5f service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received unexpected event network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 for instance with vm_state active and task_state deleting.
Aug 27 02:30:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-21811937-1c96-4ed3-b56d-0844bca2f6b7 req-5c67cb6f-7dee-492d-b013-826930752f5f service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received event network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-21811937-1c96-4ed3-b56d-0844bca2f6b7 req-5c67cb6f-7dee-492d-b013-826930752f5f service nova] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-21811937-1c96-4ed3-b56d-0844bca2f6b7 req-5c67cb6f-7dee-492d-b013-826930752f5f service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-21811937-1c96-4ed3-b56d-0844bca2f6b7 req-5c67cb6f-7dee-492d-b013-826930752f5f service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-21811937-1c96-4ed3-b56d-0844bca2f6b7 req-5c67cb6f-7dee-492d-b013-826930752f5f service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] No waiting events found dispatching network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:30:06 user nova-compute[72820]: WARNING nova.compute.manager [req-21811937-1c96-4ed3-b56d-0844bca2f6b7 req-5c67cb6f-7dee-492d-b013-826930752f5f service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received unexpected event network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 for instance with vm_state active and task_state deleting.
Aug 27 02:30:06 user nova-compute[72820]: DEBUG nova.network.neutron [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Successfully updated port: 95c4ddc9-d1c5-434a-b733-f59fdc71e748 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "refresh_cache-3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquired lock "refresh_cache-3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG nova.network.neutron [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-d6fcef1a-dbb1-492e-b001-0aa3089cea15 req-21ac52b0-a584-4b89-9023-370bc4d616cd service nova] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Received event network-changed-95c4ddc9-d1c5-434a-b733-f59fdc71e748 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-d6fcef1a-dbb1-492e-b001-0aa3089cea15 req-21ac52b0-a584-4b89-9023-370bc4d616cd service nova] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Refreshing instance network info cache due to event network-changed-95c4ddc9-d1c5-434a-b733-f59fdc71e748. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d6fcef1a-dbb1-492e-b001-0aa3089cea15 req-21ac52b0-a584-4b89-9023-370bc4d616cd service nova] Acquiring lock "refresh_cache-3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:30:06 user nova-compute[72820]: DEBUG nova.network.neutron [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:30:07 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Took 2.37 seconds to deallocate network for instance.
Aug 27 02:30:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.network.neutron [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Updating instance_info_cache with network_info: [{"id": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "address": "fa:16:3e:e1:25:37", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c4ddc9-d1", "ovs_interfaceid": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Releasing lock "refresh_cache-3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Instance network_info: |[{"id": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "address": "fa:16:3e:e1:25:37", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c4ddc9-d1", "ovs_interfaceid": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d6fcef1a-dbb1-492e-b001-0aa3089cea15 req-21ac52b0-a584-4b89-9023-370bc4d616cd service nova] Acquired lock "refresh_cache-3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.network.neutron [req-d6fcef1a-dbb1-492e-b001-0aa3089cea15 req-21ac52b0-a584-4b89-9023-370bc4d616cd service nova] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Refreshing network info cache for port 95c4ddc9-d1c5-434a-b733-f59fdc71e748 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Start _get_guest_xml network_info=[{"id": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "address": "fa:16:3e:e1:25:37", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c4ddc9-d1", "ovs_interfaceid": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:30:07 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:30:07 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1279829371',display_name='tempest-VolumesAdminNegativeTest-server-1279829371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1279829371',id=23,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ddd7d54478749cba3988913864379ed',ramdisk_id='',reservation_id='r-yvllix1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1861523875',owner_user_name='tempest-VolumesAdminNegativeTest-1861523875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:30:04Z,user_data=None,user_id='76b3417256eb4ff7924db6912e97726c',uuid=3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "address": "fa:16:3e:e1:25:37", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c4ddc9-d1", "ovs_interfaceid": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Converting VIF {"id": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "address": "fa:16:3e:e1:25:37", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c4ddc9-d1", "ovs_interfaceid": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:37,bridge_name='br-int',has_traffic_filtering=True,id=95c4ddc9-d1c5-434a-b733-f59fdc71e748,network=Network(8741024c-a257-4a16-b983-d6ac4f6b5ad2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c4ddc9-d1') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.objects.instance [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lazy-loading 'pci_devices' on Instance uuid 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:30:07 user nova-compute[72820]:   <uuid>3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d</uuid>
Aug 27 02:30:07 user nova-compute[72820]:   <name>instance-00000017</name>
Aug 27 02:30:07 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:30:07 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:30:07 user nova-compute[72820]:   <metadata>
Aug 27 02:30:07 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:30:07 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:30:07 user nova-compute[72820]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1279829371</nova:name>
Aug 27 02:30:07 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:30:07</nova:creationTime>
Aug 27 02:30:07 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:30:07 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:30:07 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:30:07 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:30:07 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:30:07 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:30:07 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:30:07 user nova-compute[72820]:       <nova:owner>
Aug 27 02:30:07 user nova-compute[72820]:         <nova:user uuid="76b3417256eb4ff7924db6912e97726c">tempest-VolumesAdminNegativeTest-1861523875-project-member</nova:user>
Aug 27 02:30:07 user nova-compute[72820]:         <nova:project uuid="6ddd7d54478749cba3988913864379ed">tempest-VolumesAdminNegativeTest-1861523875</nova:project>
Aug 27 02:30:07 user nova-compute[72820]:       </nova:owner>
Aug 27 02:30:07 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:30:07 user nova-compute[72820]:       <nova:ports>
Aug 27 02:30:07 user nova-compute[72820]:         <nova:port uuid="95c4ddc9-d1c5-434a-b733-f59fdc71e748">
Aug 27 02:30:07 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 02:30:07 user nova-compute[72820]:         </nova:port>
Aug 27 02:30:07 user nova-compute[72820]:       </nova:ports>
Aug 27 02:30:07 user nova-compute[72820]:     </nova:instance>
Aug 27 02:30:07 user nova-compute[72820]:   </metadata>
Aug 27 02:30:07 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:30:07 user nova-compute[72820]:     <system>
Aug 27 02:30:07 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:30:07 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:30:07 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:30:07 user nova-compute[72820]:       <entry name="serial">3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d</entry>
Aug 27 02:30:07 user nova-compute[72820]:       <entry name="uuid">3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d</entry>
Aug 27 02:30:07 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:30:07 user nova-compute[72820]:     </system>
Aug 27 02:30:07 user nova-compute[72820]:   </sysinfo>
Aug 27 02:30:07 user nova-compute[72820]:   <os>
Aug 27 02:30:07 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:30:07 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:30:07 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:30:07 user nova-compute[72820]:   </os>
Aug 27 02:30:07 user nova-compute[72820]:   <features>
Aug 27 02:30:07 user nova-compute[72820]:     <acpi/>
Aug 27 02:30:07 user nova-compute[72820]:     <apic/>
Aug 27 02:30:07 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:30:07 user nova-compute[72820]:   </features>
Aug 27 02:30:07 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:30:07 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:30:07 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:30:07 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:30:07 user nova-compute[72820]:   </clock>
Aug 27 02:30:07 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:30:07 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:30:07 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:30:07 user nova-compute[72820]:   </cpu>
Aug 27 02:30:07 user nova-compute[72820]:   <devices>
Aug 27 02:30:07 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:30:07 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:30:07 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/disk"/>
Aug 27 02:30:07 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:30:07 user nova-compute[72820]:     </disk>
Aug 27 02:30:07 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:30:07 user nova-compute[72820]:       <mac address="fa:16:3e:e1:25:37"/>
Aug 27 02:30:07 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:30:07 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:30:07 user nova-compute[72820]:       <target dev="tap95c4ddc9-d1"/>
Aug 27 02:30:07 user nova-compute[72820]:     </interface>
Aug 27 02:30:07 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:30:07 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/console.log" append="off"/>
Aug 27 02:30:07 user nova-compute[72820]:     </serial>
Aug 27 02:30:07 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:30:07 user nova-compute[72820]:     <video>
Aug 27 02:30:07 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:30:07 user nova-compute[72820]:     </video>
Aug 27 02:30:07 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:30:07 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:30:07 user nova-compute[72820]:     </rng>
Aug 27 02:30:07 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:30:07 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:30:07 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:30:07 user nova-compute[72820]:     </memballoon>
Aug 27 02:30:07 user nova-compute[72820]:   </devices>
Aug 27 02:30:07 user nova-compute[72820]: </domain>
Aug 27 02:30:07 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1279829371',display_name='tempest-VolumesAdminNegativeTest-server-1279829371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1279829371',id=23,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ddd7d54478749cba3988913864379ed',ramdisk_id='',reservation_id='r-yvllix1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1861523875',owner_user_name='tempest-VolumesAdminNegativeTest-1861523875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:30:04Z,user_data=None,user_id='76b3417256eb4ff7924db6912e97726c',uuid=3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "address": "fa:16:3e:e1:25:37", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c4ddc9-d1", "ovs_interfaceid": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Converting VIF {"id": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "address": "fa:16:3e:e1:25:37", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c4ddc9-d1", "ovs_interfaceid": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:37,bridge_name='br-int',has_traffic_filtering=True,id=95c4ddc9-d1c5-434a-b733-f59fdc71e748,network=Network(8741024c-a257-4a16-b983-d6ac4f6b5ad2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c4ddc9-d1') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG os_vif [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:37,bridge_name='br-int',has_traffic_filtering=True,id=95c4ddc9-d1c5-434a-b733-f59fdc71e748,network=Network(8741024c-a257-4a16-b983-d6ac4f6b5ad2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c4ddc9-d1') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95c4ddc9-d1, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95c4ddc9-d1, col_values=(('external_ids', {'iface-id': '95c4ddc9-d1c5-434a-b733-f59fdc71e748', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:25:37', 'vm-uuid': '3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:07 user nova-compute[72820]: INFO os_vif [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:37,bridge_name='br-int',has_traffic_filtering=True,id=95c4ddc9-d1c5-434a-b733-f59fdc71e748,network=Network(8741024c-a257-4a16-b983-d6ac4f6b5ad2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c4ddc9-d1')
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:30:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] No VIF found with MAC fa:16:3e:e1:25:37, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:30:08 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:30:08 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:30:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.590s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:08 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Deleted allocations for instance f37dfe42-3b22-4111-b10d-9459c8c42b2d
Aug 27 02:30:08 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:30:08 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:30:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bb051598-59de-4336-b1cf-2205ef97e7bc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.544s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:08 user nova-compute[72820]: DEBUG nova.network.neutron [req-d6fcef1a-dbb1-492e-b001-0aa3089cea15 req-21ac52b0-a584-4b89-9023-370bc4d616cd service nova] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Updated VIF entry in instance network info cache for port 95c4ddc9-d1c5-434a-b733-f59fdc71e748. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:30:08 user nova-compute[72820]: DEBUG nova.network.neutron [req-d6fcef1a-dbb1-492e-b001-0aa3089cea15 req-21ac52b0-a584-4b89-9023-370bc4d616cd service nova] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Updating instance_info_cache with network_info: [{"id": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "address": "fa:16:3e:e1:25:37", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c4ddc9-d1", "ovs_interfaceid": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:30:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d6fcef1a-dbb1-492e-b001-0aa3089cea15 req-21ac52b0-a584-4b89-9023-370bc4d616cd service nova] Releasing lock "refresh_cache-3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:30:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-b182e300-736f-4a76-b2e2-99f073f86585 req-5fb12430-af1f-47ba-b7e8-15dd8eb7e83e service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received event network-vif-unplugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b182e300-736f-4a76-b2e2-99f073f86585 req-5fb12430-af1f-47ba-b7e8-15dd8eb7e83e service nova] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b182e300-736f-4a76-b2e2-99f073f86585 req-5fb12430-af1f-47ba-b7e8-15dd8eb7e83e service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b182e300-736f-4a76-b2e2-99f073f86585 req-5fb12430-af1f-47ba-b7e8-15dd8eb7e83e service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-b182e300-736f-4a76-b2e2-99f073f86585 req-5fb12430-af1f-47ba-b7e8-15dd8eb7e83e service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] No waiting events found dispatching network-vif-unplugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:30:08 user nova-compute[72820]: WARNING nova.compute.manager [req-b182e300-736f-4a76-b2e2-99f073f86585 req-5fb12430-af1f-47ba-b7e8-15dd8eb7e83e service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received unexpected event network-vif-unplugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 for instance with vm_state deleted and task_state None.
Aug 27 02:30:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-b182e300-736f-4a76-b2e2-99f073f86585 req-5fb12430-af1f-47ba-b7e8-15dd8eb7e83e service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received event network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b182e300-736f-4a76-b2e2-99f073f86585 req-5fb12430-af1f-47ba-b7e8-15dd8eb7e83e service nova] Acquiring lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b182e300-736f-4a76-b2e2-99f073f86585 req-5fb12430-af1f-47ba-b7e8-15dd8eb7e83e service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b182e300-736f-4a76-b2e2-99f073f86585 req-5fb12430-af1f-47ba-b7e8-15dd8eb7e83e service nova] Lock "f37dfe42-3b22-4111-b10d-9459c8c42b2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-b182e300-736f-4a76-b2e2-99f073f86585 req-5fb12430-af1f-47ba-b7e8-15dd8eb7e83e service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] No waiting events found dispatching network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:30:08 user nova-compute[72820]: WARNING nova.compute.manager [req-b182e300-736f-4a76-b2e2-99f073f86585 req-5fb12430-af1f-47ba-b7e8-15dd8eb7e83e service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received unexpected event network-vif-plugged-525fd1df-177d-44ee-a88d-e6dcde84e9d4 for instance with vm_state deleted and task_state None.
Aug 27 02:30:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-b182e300-736f-4a76-b2e2-99f073f86585 req-5fb12430-af1f-47ba-b7e8-15dd8eb7e83e service nova] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Received event network-vif-deleted-525fd1df-177d-44ee-a88d-e6dcde84e9d4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:09 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:30:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:30:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:10 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:30:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:10 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:30:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-ca182e21-0e19-4528-a3e6-20473f8ccc92 req-21dd9f2f-a7bf-445a-baf1-b38f71737a7b service nova] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Received event network-vif-plugged-95c4ddc9-d1c5-434a-b733-f59fdc71e748 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ca182e21-0e19-4528-a3e6-20473f8ccc92 req-21dd9f2f-a7bf-445a-baf1-b38f71737a7b service nova] Acquiring lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ca182e21-0e19-4528-a3e6-20473f8ccc92 req-21dd9f2f-a7bf-445a-baf1-b38f71737a7b service nova] Lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ca182e21-0e19-4528-a3e6-20473f8ccc92 req-21dd9f2f-a7bf-445a-baf1-b38f71737a7b service nova] Lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-ca182e21-0e19-4528-a3e6-20473f8ccc92 req-21dd9f2f-a7bf-445a-baf1-b38f71737a7b service nova] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] No waiting events found dispatching network-vif-plugged-95c4ddc9-d1c5-434a-b733-f59fdc71e748 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:30:10 user nova-compute[72820]: WARNING nova.compute.manager [req-ca182e21-0e19-4528-a3e6-20473f8ccc92 req-21dd9f2f-a7bf-445a-baf1-b38f71737a7b service nova] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Received unexpected event network-vif-plugged-95c4ddc9-d1c5-434a-b733-f59fdc71e748 for instance with vm_state building and task_state spawning.
Aug 27 02:30:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-ca182e21-0e19-4528-a3e6-20473f8ccc92 req-21dd9f2f-a7bf-445a-baf1-b38f71737a7b service nova] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Received event network-vif-plugged-95c4ddc9-d1c5-434a-b733-f59fdc71e748 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ca182e21-0e19-4528-a3e6-20473f8ccc92 req-21dd9f2f-a7bf-445a-baf1-b38f71737a7b service nova] Acquiring lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ca182e21-0e19-4528-a3e6-20473f8ccc92 req-21dd9f2f-a7bf-445a-baf1-b38f71737a7b service nova] Lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ca182e21-0e19-4528-a3e6-20473f8ccc92 req-21dd9f2f-a7bf-445a-baf1-b38f71737a7b service nova] Lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-ca182e21-0e19-4528-a3e6-20473f8ccc92 req-21dd9f2f-a7bf-445a-baf1-b38f71737a7b service nova] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] No waiting events found dispatching network-vif-plugged-95c4ddc9-d1c5-434a-b733-f59fdc71e748 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:30:10 user nova-compute[72820]: WARNING nova.compute.manager [req-ca182e21-0e19-4528-a3e6-20473f8ccc92 req-21dd9f2f-a7bf-445a-baf1-b38f71737a7b service nova] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Received unexpected event network-vif-plugged-95c4ddc9-d1c5-434a-b733-f59fdc71e748 for instance with vm_state building and task_state spawning.
Aug 27 02:30:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103411.6408627, 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:30:11 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] VM Resumed (Lifecycle Event)
Aug 27 02:30:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:30:11 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Instance spawned successfully.
Aug 27 02:30:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:11 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:30:11 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103411.6415079, 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:30:11 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] VM Started (Lifecycle Event)
Aug 27 02:30:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:30:11 user nova-compute[72820]: INFO nova.compute.manager [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Took 7.80 seconds to spawn the instance on the hypervisor.
Aug 27 02:30:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:30:11 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:30:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:12 user nova-compute[72820]: INFO nova.compute.manager [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Took 9.06 seconds to build instance.
Aug 27 02:30:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dda63e57-8c08-4dd8-96f3-c37ccec6939c tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.170s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:30:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:30:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:30:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:16 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:30:16 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:30:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7041MB free_disk=25.191150665283203GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:30:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 26581695-c4b9-40b8-ab7a-34c99db0dadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f8f612f3-41c9-4dae-8d49-218d61720b15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 050e0c2b-9244-4987-b07d-e4712e46f936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance ac2f6797-8b7c-47d3-836d-fc1c617e23dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1591319d-3d15-4c46-b823-4edddf018b5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 7c42c4ae-0f80-4295-a64e-b426225b94c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 63c67f6e-849b-404a-bd38-524604cae3d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 89b66e95-2333-403b-b338-6096717ca20d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 4becc265-4f3d-4f83-a9ac-c99100a870ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.731s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:18 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:30:18 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:30:18 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:30:18 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:30:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:30:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:30:18 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:30:19 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Updating instance_info_cache with network_info: [{"id": "b330a8f4-0812-4964-bd70-10d41689406a", "address": "fa:16:3e:a4:9d:95", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb330a8f4-08", "ovs_interfaceid": "b330a8f4-0812-4964-bd70-10d41689406a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:30:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:30:19 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:30:19 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:30:19 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:30:19 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103404.7130358, f37dfe42-3b22-4111-b10d-9459c8c42b2d => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:30:19 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] VM Stopped (Lifecycle Event)
Aug 27 02:30:19 user nova-compute[72820]: DEBUG nova.compute.manager [None req-726ef487-c3dd-40b4-8b2a-0422213c643f None None] [instance: f37dfe42-3b22-4111-b10d-9459c8c42b2d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:30:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG nova.objects.instance [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lazy-loading 'flavor' on Instance uuid ac2f6797-8b7c-47d3-836d-fc1c617e23dd {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:25 user nova-compute[72820]: INFO nova.compute.manager [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Attaching volume 27cad7eb-b82b-4588-b153-48d86f4da1a1 to /dev/vdb
Aug 27 02:30:25 user nova-compute[72820]: DEBUG os_brick.utils [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ed1d93-2697-46d1-bb68-d81f81b1a0b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dce5672-5c71-4828-962a-cfd11ae0348d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd844ef-6711-4f71-8b11-62b41302a596]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1725d4fe-0e42-4a6e-b20a-57922939172b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:30:25 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:30:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7436c8b-e376-4adf-8687-27ae9682c95f]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG os_brick.utils [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:30:25 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Updating existing volume attachment record: 5052563a-bf30-492a-8085-9827125e1900 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:30:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:30 user nova-compute[72820]: INFO nova.compute.manager [None req-f563d7e0-b32e-4b37-8a6f-cd8da4eb423a tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Unrescuing
Aug 27 02:30:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f563d7e0-b32e-4b37-8a6f-cd8da4eb423a tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "refresh_cache-1591319d-3d15-4c46-b823-4edddf018b5f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:30:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f563d7e0-b32e-4b37-8a6f-cd8da4eb423a tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquired lock "refresh_cache-1591319d-3d15-4c46-b823-4edddf018b5f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:30:30 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f563d7e0-b32e-4b37-8a6f-cd8da4eb423a tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:30:32 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f563d7e0-b32e-4b37-8a6f-cd8da4eb423a tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Updating instance_info_cache with network_info: [{"id": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "address": "fa:16:3e:05:00:70", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb04bdd2-29", "ovs_interfaceid": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:30:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f563d7e0-b32e-4b37-8a6f-cd8da4eb423a tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Releasing lock "refresh_cache-1591319d-3d15-4c46-b823-4edddf018b5f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:30:32 user nova-compute[72820]: DEBUG nova.objects.instance [None req-f563d7e0-b32e-4b37-8a6f-cd8da4eb423a tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'flavor' on Instance uuid 1591319d-3d15-4c46-b823-4edddf018b5f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:30:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-37be51c1-eada-471e-adb1-e4b4ca9b9c18 req-3a31e88e-2fd0-4cc9-b873-700162172b4a service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-unplugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-37be51c1-eada-471e-adb1-e4b4ca9b9c18 req-3a31e88e-2fd0-4cc9-b873-700162172b4a service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-37be51c1-eada-471e-adb1-e4b4ca9b9c18 req-3a31e88e-2fd0-4cc9-b873-700162172b4a service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-37be51c1-eada-471e-adb1-e4b4ca9b9c18 req-3a31e88e-2fd0-4cc9-b873-700162172b4a service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-37be51c1-eada-471e-adb1-e4b4ca9b9c18 req-3a31e88e-2fd0-4cc9-b873-700162172b4a service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-unplugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:30:32 user nova-compute[72820]: WARNING nova.compute.manager [req-37be51c1-eada-471e-adb1-e4b4ca9b9c18 req-3a31e88e-2fd0-4cc9-b873-700162172b4a service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received unexpected event network-vif-unplugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:30:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:33 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Instance destroyed successfully.
Aug 27 02:30:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-27c6d959-5e0d-4739-b229-6d4590b09ff8 req-1e7ca278-b30b-47db-91e5-a5d484e5428e service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-27c6d959-5e0d-4739-b229-6d4590b09ff8 req-1e7ca278-b30b-47db-91e5-a5d484e5428e service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-27c6d959-5e0d-4739-b229-6d4590b09ff8 req-1e7ca278-b30b-47db-91e5-a5d484e5428e service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-27c6d959-5e0d-4739-b229-6d4590b09ff8 req-1e7ca278-b30b-47db-91e5-a5d484e5428e service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-27c6d959-5e0d-4739-b229-6d4590b09ff8 req-1e7ca278-b30b-47db-91e5-a5d484e5428e service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:30:34 user nova-compute[72820]: WARNING nova.compute.manager [req-27c6d959-5e0d-4739-b229-6d4590b09ff8 req-1e7ca278-b30b-47db-91e5-a5d484e5428e service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received unexpected event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:30:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:36 user nova-compute[72820]: DEBUG nova.compute.manager [req-fa3453b6-d6f1-4b25-9f47-3facf677ade0 req-7508e697-13f2-4447-9d1a-f11d89a1e7ef service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fa3453b6-d6f1-4b25-9f47-3facf677ade0 req-7508e697-13f2-4447-9d1a-f11d89a1e7ef service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fa3453b6-d6f1-4b25-9f47-3facf677ade0 req-7508e697-13f2-4447-9d1a-f11d89a1e7ef service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fa3453b6-d6f1-4b25-9f47-3facf677ade0 req-7508e697-13f2-4447-9d1a-f11d89a1e7ef service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:36 user nova-compute[72820]: DEBUG nova.compute.manager [req-fa3453b6-d6f1-4b25-9f47-3facf677ade0 req-7508e697-13f2-4447-9d1a-f11d89a1e7ef service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:30:36 user nova-compute[72820]: WARNING nova.compute.manager [req-fa3453b6-d6f1-4b25-9f47-3facf677ade0 req-7508e697-13f2-4447-9d1a-f11d89a1e7ef service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received unexpected event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:30:36 user nova-compute[72820]: DEBUG nova.compute.manager [req-fa3453b6-d6f1-4b25-9f47-3facf677ade0 req-7508e697-13f2-4447-9d1a-f11d89a1e7ef service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fa3453b6-d6f1-4b25-9f47-3facf677ade0 req-7508e697-13f2-4447-9d1a-f11d89a1e7ef service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fa3453b6-d6f1-4b25-9f47-3facf677ade0 req-7508e697-13f2-4447-9d1a-f11d89a1e7ef service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fa3453b6-d6f1-4b25-9f47-3facf677ade0 req-7508e697-13f2-4447-9d1a-f11d89a1e7ef service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:36 user nova-compute[72820]: DEBUG nova.compute.manager [req-fa3453b6-d6f1-4b25-9f47-3facf677ade0 req-7508e697-13f2-4447-9d1a-f11d89a1e7ef service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:30:36 user nova-compute[72820]: WARNING nova.compute.manager [req-fa3453b6-d6f1-4b25-9f47-3facf677ade0 req-7508e697-13f2-4447-9d1a-f11d89a1e7ef service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received unexpected event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:30:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Removed pending event for 1591319d-3d15-4c46-b823-4edddf018b5f due to event {{(pid=72820) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 02:30:36 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103436.77847, 1591319d-3d15-4c46-b823-4edddf018b5f => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:30:36 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] VM Resumed (Lifecycle Event)
Aug 27 02:30:36 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f563d7e0-b32e-4b37-8a6f-cd8da4eb423a tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:30:36 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:30:36 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:30:36 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 02:30:36 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103436.781296, 1591319d-3d15-4c46-b823-4edddf018b5f => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:30:36 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] VM Started (Lifecycle Event)
Aug 27 02:30:36 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:30:36 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hATvUwtH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:30:37 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:30:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:30:37 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:30:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:30:37 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:30:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d8750a-2fc1-422d-b197-9d4531cbabee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:30:37 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2515bb-d0fb-4a0a-a78e-88feff6089bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1] added
Aug 27 02:30:37 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[838e9c3f-1215-4528-a742-3c30a0d5d0f5]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2107aa87-d067-45fd-8bb2-77a27028aae7]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hATvUwtH {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hATvUwtH" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a54e81-69d3-42c0-8d0c-b0b6990d2204]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hATvUwtH'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e85fa82-1d27-47d5-a962-7809a371ba03]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8940b161-ab92-461b-ac25-13fafc4e4c7f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:30:38 user nova-compute[72820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)
Aug 27 02:30:38 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:30:38 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:30:38 user nova-compute[72820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)
Aug 27 02:30:38 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:30:38 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0c04e7-4176-47fb-9162-408943eec940]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260]
Aug 27 02:30:38 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260] successful.
Aug 27 02:30:38 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55b03d3-78c8-456f-b35e-751e330921c6]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f546025d-2664-447f-a819-0f36efa91042]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:30:38 user nova-compute[72820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)
Aug 27 02:30:38 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:30:38 user nova-compute[72820]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:30:38 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:30:38 user nova-compute[72820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)
Aug 27 02:30:38 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:30:38 user nova-compute[72820]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:30:38 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2f597a-70ae-41b7-abe3-703f01fa2d96]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:30:38 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hATvUwtH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:30:39 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:30:39 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23865303864626138', 'path': '/dev/sdd'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:30:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865303864626138', 'path': '/dev/sdd'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:30:39 user nova-compute[72820]: DEBUG nova.objects.instance [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lazy-loading 'flavor' on Instance uuid ac2f6797-8b7c-47d3-836d-fc1c617e23dd {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:30:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:30:39 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:30:39 user nova-compute[72820]:   <source dev="/dev/sdd"/>
Aug 27 02:30:39 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:30:39 user nova-compute[72820]:   <serial>27cad7eb-b82b-4588-b153-48d86f4da1a1</serial>
Aug 27 02:30:39 user nova-compute[72820]: </disk>
Aug 27 02:30:39 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:30:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:30:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:30:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] No VIF found with MAC fa:16:3e:b6:ef:6b, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:30:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e332a262-c7dd-413b-8cb4-d942414daff0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.367s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-1846ce5d-778e-4822-beaa-df9171d12a48 req-9ff8b7ab-b721-445c-a8b4-2ac201e7164b service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-changed-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG nova.compute.manager [req-1846ce5d-778e-4822-beaa-df9171d12a48 req-9ff8b7ab-b721-445c-a8b4-2ac201e7164b service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Refreshing instance network info cache due to event network-changed-91356c13-2f8e-4c32-993c-98aa52345f86. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1846ce5d-778e-4822-beaa-df9171d12a48 req-9ff8b7ab-b721-445c-a8b4-2ac201e7164b service nova] Acquiring lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1846ce5d-778e-4822-beaa-df9171d12a48 req-9ff8b7ab-b721-445c-a8b4-2ac201e7164b service nova] Acquired lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG nova.network.neutron [req-1846ce5d-778e-4822-beaa-df9171d12a48 req-9ff8b7ab-b721-445c-a8b4-2ac201e7164b service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Refreshing network info cache for port 91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG nova.compute.manager [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Stashing vm_state: active {{(pid=72820) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "89b66e95-2333-403b-b338-6096717ca20d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG nova.objects.instance [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'flavor' on Instance uuid 89b66e95-2333-403b-b338-6096717ca20d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "89b66e95-2333-403b-b338-6096717ca20d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:30:42 user nova-compute[72820]: INFO nova.compute.claims [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Claim successful on node user
Aug 27 02:30:42 user nova-compute[72820]: INFO nova.compute.resource_tracker [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Updating resource usage from migration ebf31c8f-7d9d-46e1-b1f4-4247c14bf8a1
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "89b66e95-2333-403b-b338-6096717ca20d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:42 user nova-compute[72820]: INFO nova.compute.manager [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Attaching volume 8adf12ba-21ce-457c-92da-d954fc8907cf to /dev/vdb
Aug 27 02:30:42 user nova-compute[72820]: DEBUG os_brick.utils [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG nova.network.neutron [req-1846ce5d-778e-4822-beaa-df9171d12a48 req-9ff8b7ab-b721-445c-a8b4-2ac201e7164b service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Updated VIF entry in instance network info cache for port 91356c13-2f8e-4c32-993c-98aa52345f86. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG nova.network.neutron [req-1846ce5d-778e-4822-beaa-df9171d12a48 req-9ff8b7ab-b721-445c-a8b4-2ac201e7164b service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Updating instance_info_cache with network_info: [{"id": "91356c13-2f8e-4c32-993c-98aa52345f86", "address": "fa:16:3e:d1:90:a2", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91356c13-2f", "ovs_interfaceid": "91356c13-2f8e-4c32-993c-98aa52345f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb10830-818f-4113-87f4-1d24cb61d474]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1846ce5d-778e-4822-beaa-df9171d12a48 req-9ff8b7ab-b721-445c-a8b4-2ac201e7164b service nova] Releasing lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c499e0e-49ee-4bb9-9bf0-26c0b2b25a7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[63330d75-7448-4658-b3fd-4863be627f3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b09e4a-3149-45fb-8a0e-ad50d679a1bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:30:42 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:30:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f6abdf-5631-4120-940c-ee734259a836]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG os_brick.utils [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:30:42 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Updating existing volume attachment record: 7805d2ef-0be8-4f12-8732-3e9f4b957c38 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:30:43 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:30:43 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:30:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.622s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:43 user nova-compute[72820]: INFO nova.compute.manager [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Migrating
Aug 27 02:30:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:30:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:30:43 user nova-compute[72820]: INFO nova.compute.rpcapi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 27 02:30:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:30:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:30:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquired lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:30:43 user nova-compute[72820]: DEBUG nova.network.neutron [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:30:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "63c67f6e-849b-404a-bd38-524604cae3d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "63c67f6e-849b-404a-bd38-524604cae3d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:43 user nova-compute[72820]: INFO nova.compute.manager [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Detaching volume 3ac09bd1-a440-4fa0-84d5-74556a3e9f94
Aug 27 02:30:43 user nova-compute[72820]: INFO nova.virt.block_device [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Attempting to driver detach volume 3ac09bd1-a440-4fa0-84d5-74556a3e9f94 from mountpoint /dev/vdb
Aug 27 02:30:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "63c67f6e-849b-404a-bd38-524604cae3d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Attempting to detach device vdb from instance 63c67f6e-849b-404a-bd38-524604cae3d8 from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:30:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:30:43 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:30:43 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:30:43 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:30:43 user nova-compute[72820]:   <serial>3ac09bd1-a440-4fa0-84d5-74556a3e9f94</serial>
Aug 27 02:30:43 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:30:43 user nova-compute[72820]: </disk>
Aug 27 02:30:43 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:30:43 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Successfully detached device vdb from instance 63c67f6e-849b-404a-bd38-524604cae3d8 from the persistent domain config.
Aug 27 02:30:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63c67f6e-849b-404a-bd38-524604cae3d8 from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:30:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:30:43 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:30:43 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:30:43 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:30:43 user nova-compute[72820]:   <serial>3ac09bd1-a440-4fa0-84d5-74556a3e9f94</serial>
Aug 27 02:30:43 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:30:43 user nova-compute[72820]: </disk>
Aug 27 02:30:43 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:30:43 user nova-compute[72820]: DEBUG nova.network.neutron [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Updating instance_info_cache with network_info: [{"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:30:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Releasing lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:30:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Starting migrate_disk_and_power_off {{(pid=72820) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693103444.0088632, 63c67f6e-849b-404a-bd38-524604cae3d8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63c67f6e-849b-404a-bd38-524604cae3d8 {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:30:44 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Successfully detached device vdb from instance 63c67f6e-849b-404a-bd38-524604cae3d8 from the live domain config.
Aug 27 02:30:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwClZKIO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:30:44 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82213cf-c7bd-41a5-9818-da857abbc9c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:30:44 user nova-compute[72820]: No targets found.
Aug 27 02:30:44 user nova-compute[72820]: iSNS:
Aug 27 02:30:44 user nova-compute[72820]: No targets found.
Aug 27 02:30:44 user nova-compute[72820]: STATIC:
Aug 27 02:30:44 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047
Aug 27 02:30:44 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:30:44 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:30:44 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1
Aug 27 02:30:44 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:30:44 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:30:44 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:30:44 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:30:44 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:30:44 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94
Aug 27 02:30:44 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:30:44 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:30:44 user nova-compute[72820]: FIRMWARE:
Aug 27 02:30:44 user nova-compute[72820]: No targets found.
Aug 27 02:30:44 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:30:44 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:30:44 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb07778-c625-41a4-a251-742c0c5fb7fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[daea3e41-20b7-4763-a2e0-7def25fbba8b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:30:44 user nova-compute[72820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)
Aug 27 02:30:44 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:30:44 user nova-compute[72820]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:30:44 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:30:44 user nova-compute[72820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 (non-flash)
Aug 27 02:30:44 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:30:44 user nova-compute[72820]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:30:44 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c02ef010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94'): ({'sdb'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Removing single pathed devices sdb {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c8a70c-ea2e-4ea4-95af-0c84aa0b6cbd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e592a362-9558-467b-ab31-82d6de0d6f4d]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Flushing IO for device /dev/sdb {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b64a2ac-25e4-4985-b43a-6da897dee381]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[372fa849-d1a4-4629-924d-4de4354c8679]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.059s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8c8046-eee8-49a7-9d5b-b20c1d9eb3c0]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG nova.compute.manager [req-db8ed482-4ec1-4460-a8a5-e576a376c0f8 req-e31fb07d-4c6e-453c-8341-90bf19780193 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received event network-vif-unplugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-db8ed482-4ec1-4460-a8a5-e576a376c0f8 req-e31fb07d-4c6e-453c-8341-90bf19780193 service nova] Acquiring lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-db8ed482-4ec1-4460-a8a5-e576a376c0f8 req-e31fb07d-4c6e-453c-8341-90bf19780193 service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-db8ed482-4ec1-4460-a8a5-e576a376c0f8 req-e31fb07d-4c6e-453c-8341-90bf19780193 service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG nova.compute.manager [req-db8ed482-4ec1-4460-a8a5-e576a376c0f8 req-e31fb07d-4c6e-453c-8341-90bf19780193 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] No waiting events found dispatching network-vif-unplugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:30:44 user nova-compute[72820]: WARNING nova.compute.manager [req-db8ed482-4ec1-4460-a8a5-e576a376c0f8 req-e31fb07d-4c6e-453c-8341-90bf19780193 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received unexpected event network-vif-unplugged-553b0551-3051-4ed5-9c80-27d77670620d for instance with vm_state active and task_state resize_migrating.
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3788b44-8ab4-4b81-93da-56e65f711845]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94, portal: 172.16.0.220,3260]
Aug 27 02:30:44 user nova-compute[72820]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94, portal: 172.16.0.220,3260] successful.
Aug 27 02:30:44 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe28946-fdd5-4110-a75f-f74995309e4e]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] <== disconnect_volume: return (446ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:30:44 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Instance destroyed successfully.
Aug 27 02:30:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:26:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-75697122',display_name='tempest-ServerActionsTestOtherB-server-75697122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-75697122',id=16,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp3hR8w9f7AOU3wBlGjx2QgjVCzjqvm+j+8m+weDqKoVqafaUie8myGeBPk3f9wFUM+nLfm1AWiPS+cjE0rgULgjP5MomAJch5aNo42dwR8Sd4aT6HChhwUBzyy0SaiOg==',key_name='tempest-keypair-1915839179',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:26:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb32c350e1a44044bc5b19942df53d05',ramdisk_id='',reservation_id='r-gmwi89nk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-657110753',owner_user_name='tempest-ServerActionsTestOtherB-657110753-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:30:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='555eff4f50e9450aac65344bec772685',uuid=ac2f6797-8b7c-47d3-836d-fc1c617e23dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-588087841-network", "vif_mac": "fa:16:3e:b6:ef:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Converting VIF {"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-588087841-network", "vif_mac": "fa:16:3e:b6:ef:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_vif [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap553b0551-30, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:30:44 user nova-compute[72820]: INFO os_vif [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30')
Aug 27 02:30:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hATvUwtH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:30:44 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[645dde23-ecd8-45bb-97b3-03562c9efe8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:30:44 user nova-compute[72820]: No targets found.
Aug 27 02:30:44 user nova-compute[72820]: iSNS:
Aug 27 02:30:44 user nova-compute[72820]: No targets found.
Aug 27 02:30:44 user nova-compute[72820]: STATIC:
Aug 27 02:30:44 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047
Aug 27 02:30:44 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:30:44 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:30:44 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1
Aug 27 02:30:44 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:30:44 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:30:44 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:30:44 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:30:44 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:30:44 user nova-compute[72820]: FIRMWARE:
Aug 27 02:30:44 user nova-compute[72820]: No targets found.
Aug 27 02:30:44 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:30:44 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:30:44 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[858b0d93-effd-4ae1-9b95-7ec12cb8ef85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9e5b57-db9a-416b-82f7-ede4214c490c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:30:44 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:30:44 user nova-compute[72820]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:30:44 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:30:44 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:30:44 user nova-compute[72820]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:30:44 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c02eeb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1'): ({'sdd'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Removing single pathed devices sdd {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32baf97-cff3-4f34-809c-cdbb621ef858]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41b9930-e5e6-4d1f-891d-9eb40d8d7e6a]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Flushing IO for device /dev/sdd {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf25eac-1ef0-4a5c-b18c-eec46930df53]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9de14b-0c10-41de-aafe-fafc0e845982]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[882fe19b-a792-48b1-b050-df57fc8bf95a]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b68e61c-e227-4bd7-87fa-e73518236002]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260]
Aug 27 02:30:45 user nova-compute[72820]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260] successful.
Aug 27 02:30:45 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1386f5-2876-43d0-9be0-4c80458cdb42]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] <== disconnect_volume: return (341ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG nova.objects.instance [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lazy-loading 'flavor' on Instance uuid 63c67f6e-849b-404a-bd38-524604cae3d8 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c90d7e44-c3a6-46c9-b1e8-6b7fc8b9dc67 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "63c67f6e-849b-404a-bd38-524604cae3d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.985s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "63c67f6e-849b-404a-bd38-524604cae3d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.864s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "63c67f6e-849b-404a-bd38-524604cae3d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "63c67f6e-849b-404a-bd38-524604cae3d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "63c67f6e-849b-404a-bd38-524604cae3d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:45 user nova-compute[72820]: INFO nova.compute.manager [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Terminating instance
Aug 27 02:30:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd_resize/disk /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CMD "cp -r /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd_resize/disk /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk" returned: 0 in 0.484s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd_resize/disk.info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk.info {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CMD "cp -r /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd_resize/disk.info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk.info" returned: 0 in 0.037s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:46 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Instance destroyed successfully.
Aug 27 02:30:46 user nova-compute[72820]: DEBUG nova.objects.instance [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lazy-loading 'resources' on Instance uuid 63c67f6e-849b-404a-bd38-524604cae3d8 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:27:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-986140919',display_name='tempest-VolumesSnapshotTestJSON-instance-986140919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-986140919',id=19,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDeztSs+8mHoKMzDC1PcBVCx86Hyijat/B3yLvX/ipmgaYBM7k8fIYCIOcwVsqHLyN+kMSfv/wysGBfZjNrEDxIkMKRd3rIha26t9IJu/srRzrMII64+onIbqucmzmjRQ==',key_name='tempest-keypair-918910425',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:27:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4abfae6cab24fef92f96422628dc7e6',ramdisk_id='',reservation_id='r-35sif06o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-941703694',owner_user_name='tempest-VolumesSnapshotTestJSON-941703694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:27:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e58dd305ae442ca84ae955894e7a074',uuid=63c67f6e-849b-404a-bd38-524604cae3d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "address": "fa:16:3e:cf:0e:bc", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13b95dc-bc", "ovs_interfaceid": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Converting VIF {"id": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "address": "fa:16:3e:cf:0e:bc", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13b95dc-bc", "ovs_interfaceid": "e13b95dc-bcba-4615-954c-61bc3cb2451f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:0e:bc,bridge_name='br-int',has_traffic_filtering=True,id=e13b95dc-bcba-4615-954c-61bc3cb2451f,network=Network(35f784f8-b045-4a19-a8e6-bbf5b06bdaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13b95dc-bc') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG os_vif [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:0e:bc,bridge_name='br-int',has_traffic_filtering=True,id=e13b95dc-bcba-4615-954c-61bc3cb2451f,network=Network(35f784f8-b045-4a19-a8e6-bbf5b06bdaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13b95dc-bc') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape13b95dc-bc, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:46 user nova-compute[72820]: INFO os_vif [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:0e:bc,bridge_name='br-int',has_traffic_filtering=True,id=e13b95dc-bcba-4615-954c-61bc3cb2451f,network=Network(35f784f8-b045-4a19-a8e6-bbf5b06bdaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13b95dc-bc')
Aug 27 02:30:46 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwClZKIO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:30:46 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:30:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[352a23e1-0603-4ee5-a6d0-5e5dcce4d097]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:30:46 user nova-compute[72820]: No targets found.
Aug 27 02:30:46 user nova-compute[72820]: iSNS:
Aug 27 02:30:46 user nova-compute[72820]: No targets found.
Aug 27 02:30:46 user nova-compute[72820]: STATIC:
Aug 27 02:30:46 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047
Aug 27 02:30:46 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:30:46 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:30:46 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:30:46 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:30:46 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:30:46 user nova-compute[72820]: FIRMWARE:
Aug 27 02:30:46 user nova-compute[72820]: No targets found.
Aug 27 02:30:46 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:30:46 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:30:46 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ac09bd1-a440-4fa0-84d5-74556a3e9f94', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79a7bb5-3fea-4777-a1da-e5daf2e0bf9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1306dea2-cddd-42b6-b12c-8eaa588ccd08]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:30:46 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:30:46 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:30:46 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:30:46 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75d0055750>, {}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Disconnecting from: [] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] <== disconnect_volume: return (86ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:30:46 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Deleting instance files /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8_del
Aug 27 02:30:46 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Deletion of /opt/stack/data/nova/instances/63c67f6e-849b-404a-bd38-524604cae3d8_del complete
Aug 27 02:30:46 user nova-compute[72820]: INFO nova.compute.manager [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 27 02:30:46 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG nova.compute.manager [req-f0212b64-dbc6-40f1-afc8-0fd875cd8c1f req-522562a8-0aff-44e7-805b-0d18c30765d8 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received event network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f0212b64-dbc6-40f1-afc8-0fd875cd8c1f req-522562a8-0aff-44e7-805b-0d18c30765d8 service nova] Acquiring lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f0212b64-dbc6-40f1-afc8-0fd875cd8c1f req-522562a8-0aff-44e7-805b-0d18c30765d8 service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f0212b64-dbc6-40f1-afc8-0fd875cd8c1f req-522562a8-0aff-44e7-805b-0d18c30765d8 service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:46 user nova-compute[72820]: DEBUG nova.compute.manager [req-f0212b64-dbc6-40f1-afc8-0fd875cd8c1f req-522562a8-0aff-44e7-805b-0d18c30765d8 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] No waiting events found dispatching network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:30:46 user nova-compute[72820]: WARNING nova.compute.manager [req-f0212b64-dbc6-40f1-afc8-0fd875cd8c1f req-522562a8-0aff-44e7-805b-0d18c30765d8 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received unexpected event network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d for instance with vm_state active and task_state resize_migrating.
Aug 27 02:30:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:47 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:30:47 user nova-compute[72820]: DEBUG nova.network.neutron [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Port 553b0551-3051-4ed5-9c80-27d77670620d binding to destination host user is already ACTIVE {{(pid=72820) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 27 02:30:47 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Took 0.91 seconds to deallocate network for instance.
Aug 27 02:30:47 user nova-compute[72820]: WARNING nova.volume.cinder [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Attachment 423f22ed-e25c-4ab0-a4ee-cb9352d7955a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 423f22ed-e25c-4ab0-a4ee-cb9352d7955a. (HTTP 404) (Request-ID: req-b4621eb5-f692-4568-b67c-8c71cada88ac)
Aug 27 02:30:47 user nova-compute[72820]: INFO nova.compute.manager [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Took 0.02 seconds to detach 1 volumes for instance.
Aug 27 02:30:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:30:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquired lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:30:47 user nova-compute[72820]: DEBUG nova.network.neutron [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:30:47 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:30:47 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:30:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:47 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Deleted allocations for instance 63c67f6e-849b-404a-bd38-524604cae3d8
Aug 27 02:30:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ce26863b-81fa-42ef-99b9-035c9ba552f6 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "63c67f6e-849b-404a-bd38-524604cae3d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.552s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG nova.network.neutron [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Updating instance_info_cache with network_info: [{"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Releasing lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-b9470662-bd16-4519-bf3b-41f7075c0df2 req-0c30b4b9-ca73-441d-81b3-d16dd76d43ab service nova] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Received event network-vif-deleted-e13b95dc-bcba-4615-954c-61bc3cb2451f {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG os_brick.utils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf52265-bd18-46dc-8462-c6647d44fa03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c103485f-7f30-47c6-b8fc-b013159fc797]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e4eb6b-07d5-448c-a37d-fd54e7f7c737]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd33a9c-0d55-4cb0-832f-3d0933b80f5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:30:48 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:30:48 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5629a4-a78f-4f55-88db-fde0aa4919bf]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:30:48 user nova-compute[72820]: DEBUG os_brick.utils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:30:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:49 user nova-compute[72820]: DEBUG nova.compute.manager [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:30:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:49 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:30:49 user nova-compute[72820]: INFO nova.compute.claims [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Claim successful on node user
Aug 27 02:30:50 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:30:50 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:30:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG nova.policy [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6dbf37c8dec47aebcdc9c93ad1f3d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5387e67178b141ae94025b9fd61f0124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:30:50 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Creating image(s)
Aug 27 02:30:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "/opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "/opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "/opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.179s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk 1073741824" returned: 0 in 0.049s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:51 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.183s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:51 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:30:51 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:51 user nova-compute[72820]: DEBUG nova.network.neutron [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Successfully created port: 8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:30:51 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:51 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Cannot resize image /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:30:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:30:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Ensure instance console log exists: /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:30:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.network.neutron [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Successfully updated port: 8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquired lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.network.neutron [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.network.neutron [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-c469d29f-f678-4332-b7b5-7aa8753c290e req-b4938c9b-9a55-472a-8cd9-c1ae602bf014 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-changed-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-c469d29f-f678-4332-b7b5-7aa8753c290e req-b4938c9b-9a55-472a-8cd9-c1ae602bf014 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Refreshing instance network info cache due to event network-changed-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c469d29f-f678-4332-b7b5-7aa8753c290e req-b4938c9b-9a55-472a-8cd9-c1ae602bf014 service nova] Acquiring lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.network.neutron [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Updating instance_info_cache with network_info: [{"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Releasing lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.compute.manager [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Instance network_info: |[{"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c469d29f-f678-4332-b7b5-7aa8753c290e req-b4938c9b-9a55-472a-8cd9-c1ae602bf014 service nova] Acquired lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.network.neutron [req-c469d29f-f678-4332-b7b5-7aa8753c290e req-b4938c9b-9a55-472a-8cd9-c1ae602bf014 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Refreshing network info cache for port 8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Start _get_guest_xml network_info=[{"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:30:52 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:30:52 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-992417993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-992417993',id=24,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQesFgtpIxxL8sCQQFFOwOmpNR4N6yUY2jMITT3BKSU+Fz4HCZ8wmzaU//D1VTaaMjREKL1z86PTxVdQd+Q3SwZ0mDplq3tWNJOexRZYowP0u7zMy6yID/Tzq9KN8h6/g==',key_name='tempest-keypair-398704580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5387e67178b141ae94025b9fd61f0124',ramdisk_id='',reservation_id='r-kyve7ptf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1913674887',owner_user_name='tempest-AttachVolumeShelveTestJSON-1913674887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:30:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6dbf37c8dec47aebcdc9c93ad1f3d69',uuid=a67eea06-dabf-4115-9650-ea4098f80bd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converting VIF {"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:b5,bridge_name='br-int',has_traffic_filtering=True,id=8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e251de1-2d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.objects.instance [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'pci_devices' on Instance uuid a67eea06-dabf-4115-9650-ea4098f80bd7 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:30:52 user nova-compute[72820]:   <uuid>a67eea06-dabf-4115-9650-ea4098f80bd7</uuid>
Aug 27 02:30:52 user nova-compute[72820]:   <name>instance-00000018</name>
Aug 27 02:30:52 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:30:52 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:30:52 user nova-compute[72820]:   <metadata>
Aug 27 02:30:52 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:30:52 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:30:52 user nova-compute[72820]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-992417993</nova:name>
Aug 27 02:30:52 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:30:52</nova:creationTime>
Aug 27 02:30:52 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:30:52 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:30:52 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:30:52 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:30:52 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:30:52 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:30:52 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:30:52 user nova-compute[72820]:       <nova:owner>
Aug 27 02:30:52 user nova-compute[72820]:         <nova:user uuid="e6dbf37c8dec47aebcdc9c93ad1f3d69">tempest-AttachVolumeShelveTestJSON-1913674887-project-member</nova:user>
Aug 27 02:30:52 user nova-compute[72820]:         <nova:project uuid="5387e67178b141ae94025b9fd61f0124">tempest-AttachVolumeShelveTestJSON-1913674887</nova:project>
Aug 27 02:30:52 user nova-compute[72820]:       </nova:owner>
Aug 27 02:30:52 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:30:52 user nova-compute[72820]:       <nova:ports>
Aug 27 02:30:52 user nova-compute[72820]:         <nova:port uuid="8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8">
Aug 27 02:30:52 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 02:30:52 user nova-compute[72820]:         </nova:port>
Aug 27 02:30:52 user nova-compute[72820]:       </nova:ports>
Aug 27 02:30:52 user nova-compute[72820]:     </nova:instance>
Aug 27 02:30:52 user nova-compute[72820]:   </metadata>
Aug 27 02:30:52 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:30:52 user nova-compute[72820]:     <system>
Aug 27 02:30:52 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:30:52 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:30:52 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:30:52 user nova-compute[72820]:       <entry name="serial">a67eea06-dabf-4115-9650-ea4098f80bd7</entry>
Aug 27 02:30:52 user nova-compute[72820]:       <entry name="uuid">a67eea06-dabf-4115-9650-ea4098f80bd7</entry>
Aug 27 02:30:52 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:30:52 user nova-compute[72820]:     </system>
Aug 27 02:30:52 user nova-compute[72820]:   </sysinfo>
Aug 27 02:30:52 user nova-compute[72820]:   <os>
Aug 27 02:30:52 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:30:52 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:30:52 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:30:52 user nova-compute[72820]:   </os>
Aug 27 02:30:52 user nova-compute[72820]:   <features>
Aug 27 02:30:52 user nova-compute[72820]:     <acpi/>
Aug 27 02:30:52 user nova-compute[72820]:     <apic/>
Aug 27 02:30:52 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:30:52 user nova-compute[72820]:   </features>
Aug 27 02:30:52 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:30:52 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:30:52 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:30:52 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:30:52 user nova-compute[72820]:   </clock>
Aug 27 02:30:52 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:30:52 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:30:52 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:30:52 user nova-compute[72820]:   </cpu>
Aug 27 02:30:52 user nova-compute[72820]:   <devices>
Aug 27 02:30:52 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:30:52 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:30:52 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk"/>
Aug 27 02:30:52 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:30:52 user nova-compute[72820]:     </disk>
Aug 27 02:30:52 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:30:52 user nova-compute[72820]:       <mac address="fa:16:3e:12:b9:b5"/>
Aug 27 02:30:52 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:30:52 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:30:52 user nova-compute[72820]:       <target dev="tap8e251de1-2d"/>
Aug 27 02:30:52 user nova-compute[72820]:     </interface>
Aug 27 02:30:52 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:30:52 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/console.log" append="off"/>
Aug 27 02:30:52 user nova-compute[72820]:     </serial>
Aug 27 02:30:52 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:30:52 user nova-compute[72820]:     <video>
Aug 27 02:30:52 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:30:52 user nova-compute[72820]:     </video>
Aug 27 02:30:52 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:30:52 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:30:52 user nova-compute[72820]:     </rng>
Aug 27 02:30:52 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:30:52 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:30:52 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:30:52 user nova-compute[72820]:     </memballoon>
Aug 27 02:30:52 user nova-compute[72820]:   </devices>
Aug 27 02:30:52 user nova-compute[72820]: </domain>
Aug 27 02:30:52 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-992417993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-992417993',id=24,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQesFgtpIxxL8sCQQFFOwOmpNR4N6yUY2jMITT3BKSU+Fz4HCZ8wmzaU//D1VTaaMjREKL1z86PTxVdQd+Q3SwZ0mDplq3tWNJOexRZYowP0u7zMy6yID/Tzq9KN8h6/g==',key_name='tempest-keypair-398704580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5387e67178b141ae94025b9fd61f0124',ramdisk_id='',reservation_id='r-kyve7ptf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1913674887',owner_user_name='tempest-AttachVolumeShelveTestJSON-1913674887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:30:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6dbf37c8dec47aebcdc9c93ad1f3d69',uuid=a67eea06-dabf-4115-9650-ea4098f80bd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converting VIF {"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:b5,bridge_name='br-int',has_traffic_filtering=True,id=8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e251de1-2d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG os_vif [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:b5,bridge_name='br-int',has_traffic_filtering=True,id=8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e251de1-2d') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e251de1-2d, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e251de1-2d, col_values=(('external_ids', {'iface-id': '8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:b9:b5', 'vm-uuid': 'a67eea06-dabf-4115-9650-ea4098f80bd7'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:52 user nova-compute[72820]: INFO os_vif [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:b5,bridge_name='br-int',has_traffic_filtering=True,id=8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e251de1-2d')
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:30:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] No VIF found with MAC fa:16:3e:12:b9:b5, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:30:53 user nova-compute[72820]: DEBUG nova.network.neutron [req-c469d29f-f678-4332-b7b5-7aa8753c290e req-b4938c9b-9a55-472a-8cd9-c1ae602bf014 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Updated VIF entry in instance network info cache for port 8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:30:53 user nova-compute[72820]: DEBUG nova.network.neutron [req-c469d29f-f678-4332-b7b5-7aa8753c290e req-b4938c9b-9a55-472a-8cd9-c1ae602bf014 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Updating instance_info_cache with network_info: [{"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:30:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c469d29f-f678-4332-b7b5-7aa8753c290e req-b4938c9b-9a55-472a-8cd9-c1ae602bf014 service nova] Releasing lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-f833700f-aca7-4741-a963-5d65233da7f3 req-6fd334c4-1e54-4553-a76e-75adad3e35b0 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f833700f-aca7-4741-a963-5d65233da7f3 req-6fd334c4-1e54-4553-a76e-75adad3e35b0 service nova] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f833700f-aca7-4741-a963-5d65233da7f3 req-6fd334c4-1e54-4553-a76e-75adad3e35b0 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f833700f-aca7-4741-a963-5d65233da7f3 req-6fd334c4-1e54-4553-a76e-75adad3e35b0 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-f833700f-aca7-4741-a963-5d65233da7f3 req-6fd334c4-1e54-4553-a76e-75adad3e35b0 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] No waiting events found dispatching network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:30:54 user nova-compute[72820]: WARNING nova.compute.manager [req-f833700f-aca7-4741-a963-5d65233da7f3 req-6fd334c4-1e54-4553-a76e-75adad3e35b0 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received unexpected event network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 for instance with vm_state building and task_state spawning.
Aug 27 02:30:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQzVeyCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:30:54 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:30:54 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:30:54 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94a2d93-1c18-4ed5-ba43-868737c814e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:30:54 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be47af3-4a5a-46e0-be05-1a7aa996af70]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf] added
Aug 27 02:30:54 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad121860-5f13-4dcf-a01d-151e7b15eff0]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[528e669d-a8ea-40c7-80ae-6d078b2766cb]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQzVeyCI {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQzVeyCI" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec94221f-606a-495a-b9b8-63abb803f832]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WQzVeyCI'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c52b7c-fde6-414c-a03d-2f84921f0503]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa63208-2a50-4fe3-9bab-acc083398af0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:30:54 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:30:54 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:30:54 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:30:54 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d283bec-4968-4112-8046-d3ff575dfe17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf, portal: 172.16.0.220,3260]
Aug 27 02:30:54 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf, portal: 172.16.0.220,3260] successful.
Aug 27 02:30:54 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc5f320-8c44-4bf8-b8ed-cbbdc75332bd]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a1e1c1-95c8-42e4-a89a-356150aca4f7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:30:54 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:30:54 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:30:54 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:30:54 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:30:54 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:30:54 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:30:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8fde8d-f4f8-4987-8397-7da3cfbf7913]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:30:55 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:30:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQzVeyCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26666623231376439', 'path': '/dev/sdb'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666623231376439', 'path': '/dev/sdb'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.objects.instance [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'flavor' on Instance uuid 89b66e95-2333-403b-b338-6096717ca20d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:30:56 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:30:56 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:30:56 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:30:56 user nova-compute[72820]:   <serial>8adf12ba-21ce-457c-92da-d954fc8907cf</serial>
Aug 27 02:30:56 user nova-compute[72820]: </disk>
Aug 27 02:30:56 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] No VIF found with MAC fa:16:3e:d1:90:a2, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-4d3cbba6-6345-4d02-89d2-7bb8d24e142c tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "89b66e95-2333-403b-b338-6096717ca20d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.947s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.compute.manager [req-a2372b21-133b-403f-a8ee-0f1213b575e7 req-e0b0c21e-676d-4b95-b7a7-9c1b667fb391 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a2372b21-133b-403f-a8ee-0f1213b575e7 req-e0b0c21e-676d-4b95-b7a7-9c1b667fb391 service nova] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a2372b21-133b-403f-a8ee-0f1213b575e7 req-e0b0c21e-676d-4b95-b7a7-9c1b667fb391 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a2372b21-133b-403f-a8ee-0f1213b575e7 req-e0b0c21e-676d-4b95-b7a7-9c1b667fb391 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.compute.manager [req-a2372b21-133b-403f-a8ee-0f1213b575e7 req-e0b0c21e-676d-4b95-b7a7-9c1b667fb391 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] No waiting events found dispatching network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:30:56 user nova-compute[72820]: WARNING nova.compute.manager [req-a2372b21-133b-403f-a8ee-0f1213b575e7 req-e0b0c21e-676d-4b95-b7a7-9c1b667fb391 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received unexpected event network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 for instance with vm_state building and task_state spawning.
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103456.617773, a67eea06-dabf-4115-9650-ea4098f80bd7 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:30:56 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] VM Resumed (Lifecycle Event)
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.compute.manager [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:30:56 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Instance spawned successfully.
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:30:56 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103456.6199398, a67eea06-dabf-4115-9650-ea4098f80bd7 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:30:56 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] VM Started (Lifecycle Event)
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:30:56 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:30:56 user nova-compute[72820]: INFO nova.compute.manager [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Took 6.17 seconds to spawn the instance on the hypervisor.
Aug 27 02:30:56 user nova-compute[72820]: DEBUG nova.compute.manager [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:30:56 user nova-compute[72820]: INFO nova.compute.manager [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Took 6.98 seconds to build instance.
Aug 27 02:30:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-21f91b2e-3f38-4b6b-b7dc-880e14d4fc46 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.074s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:57 user nova-compute[72820]: INFO nova.compute.manager [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Rescuing
Aug 27 02:30:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:30:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquired lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:30:57 user nova-compute[72820]: DEBUG nova.network.neutron [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:30:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:57 user nova-compute[72820]: DEBUG nova.network.neutron [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Updating instance_info_cache with network_info: [{"id": "91356c13-2f8e-4c32-993c-98aa52345f86", "address": "fa:16:3e:d1:90:a2", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91356c13-2f", "ovs_interfaceid": "91356c13-2f8e-4c32-993c-98aa52345f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:30:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Releasing lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:30:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-475aa679-dbf6-45e7-9ced-ccf0b14f0157 req-ef921304-d7ab-4987-8c48-980a39bc33f3 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-unplugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:30:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-475aa679-dbf6-45e7-9ced-ccf0b14f0157 req-ef921304-d7ab-4987-8c48-980a39bc33f3 service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-475aa679-dbf6-45e7-9ced-ccf0b14f0157 req-ef921304-d7ab-4987-8c48-980a39bc33f3 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-475aa679-dbf6-45e7-9ced-ccf0b14f0157 req-ef921304-d7ab-4987-8c48-980a39bc33f3 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-475aa679-dbf6-45e7-9ced-ccf0b14f0157 req-ef921304-d7ab-4987-8c48-980a39bc33f3 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-unplugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:30:57 user nova-compute[72820]: WARNING nova.compute.manager [req-475aa679-dbf6-45e7-9ced-ccf0b14f0157 req-ef921304-d7ab-4987-8c48-980a39bc33f3 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-unplugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state active and task_state rescuing.
Aug 27 02:30:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:30:58 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Instance destroyed successfully.
Aug 27 02:30:58 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Attempting rescue
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72820) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Instance directory exists: not creating {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 02:30:58 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Creating image(s)
Aug 27 02:30:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "/opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "/opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "/opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.objects.instance [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'trusted_certs' on Instance uuid 89b66e95-2333-403b-b338-6096717ca20d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.180s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk.rescue {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk.rescue" returned: 0 in 0.059s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.objects.instance [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'migration_context' on Instance uuid 89b66e95-2333-403b-b338-6096717ca20d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.objects.base [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Object Instance<89b66e95-2333-403b-b338-6096717ca20d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Start _get_guest_xml network_info=[{"id": "91356c13-2f8e-4c32-993c-98aa52345f86", "address": "fa:16:3e:d1:90:a2", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "vif_mac": "fa:16:3e:d1:90:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91356c13-2f", "ovs_interfaceid": "91356c13-2f8e-4c32-993c-98aa52345f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.objects.instance [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'resources' on Instance uuid 89b66e95-2333-403b-b338-6096717ca20d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.objects.base [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Object Instance<89b66e95-2333-403b-b338-6096717ca20d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.objects.instance [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'numa_topology' on Instance uuid 89b66e95-2333-403b-b338-6096717ca20d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.objects.base [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Object Instance<89b66e95-2333-403b-b338-6096717ca20d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:30:58 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:30:58 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.objects.instance [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'vcpu_model' on Instance uuid 89b66e95-2333-403b-b338-6096717ca20d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.objects.base [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Object Instance<89b66e95-2333-403b-b338-6096717ca20d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-355823437',display_name='tempest-ServerRescueNegativeTestJSON-server-355823437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-355823437',id=21,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz2mFD6VeJVeEVU4bU7rJ7+CBdqVCOpfH1WB5wQSUW8kAHES+nnx5GM+Ktt607QK8GYcW4ial+97ZltS3YdvZfuAyIWSeVL4sJV6+ADDwbebun0Ev2EoMYbmwQuwXYxjQ==',key_name='tempest-keypair-1667560198',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:28:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca683dd78dbf41ec8fbe3d3f76011272',ramdisk_id='',reservation_id='r-7v09jyny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1600105144',owner_user_name='tempest-ServerRescueNegativeTestJSON-1600105144-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:28:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7f59dea3a6f4315828320a9ae6c721d',uuid=89b66e95-2333-403b-b338-6096717ca20d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91356c13-2f8e-4c32-993c-98aa52345f86", "address": "fa:16:3e:d1:90:a2", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "vif_mac": "fa:16:3e:d1:90:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91356c13-2f", "ovs_interfaceid": "91356c13-2f8e-4c32-993c-98aa52345f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converting VIF {"id": "91356c13-2f8e-4c32-993c-98aa52345f86", "address": "fa:16:3e:d1:90:a2", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "vif_mac": "fa:16:3e:d1:90:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91356c13-2f", "ovs_interfaceid": "91356c13-2f8e-4c32-993c-98aa52345f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:90:a2,bridge_name='br-int',has_traffic_filtering=True,id=91356c13-2f8e-4c32-993c-98aa52345f86,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91356c13-2f') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.objects.instance [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'pci_devices' on Instance uuid 89b66e95-2333-403b-b338-6096717ca20d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.objects.base [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Object Instance<89b66e95-2333-403b-b338-6096717ca20d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:30:58 user nova-compute[72820]:   <uuid>89b66e95-2333-403b-b338-6096717ca20d</uuid>
Aug 27 02:30:58 user nova-compute[72820]:   <name>instance-00000015</name>
Aug 27 02:30:58 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:30:58 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:30:58 user nova-compute[72820]:   <metadata>
Aug 27 02:30:58 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:30:58 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:30:58 user nova-compute[72820]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-355823437</nova:name>
Aug 27 02:30:58 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:30:58</nova:creationTime>
Aug 27 02:30:58 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:30:58 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:30:58 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:30:58 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:30:58 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:30:58 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:30:58 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:30:58 user nova-compute[72820]:       <nova:owner>
Aug 27 02:30:58 user nova-compute[72820]:         <nova:user uuid="a7f59dea3a6f4315828320a9ae6c721d">tempest-ServerRescueNegativeTestJSON-1600105144-project-member</nova:user>
Aug 27 02:30:58 user nova-compute[72820]:         <nova:project uuid="ca683dd78dbf41ec8fbe3d3f76011272">tempest-ServerRescueNegativeTestJSON-1600105144</nova:project>
Aug 27 02:30:58 user nova-compute[72820]:       </nova:owner>
Aug 27 02:30:58 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:30:58 user nova-compute[72820]:       <nova:ports>
Aug 27 02:30:58 user nova-compute[72820]:         <nova:port uuid="91356c13-2f8e-4c32-993c-98aa52345f86">
Aug 27 02:30:58 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 02:30:58 user nova-compute[72820]:         </nova:port>
Aug 27 02:30:58 user nova-compute[72820]:       </nova:ports>
Aug 27 02:30:58 user nova-compute[72820]:     </nova:instance>
Aug 27 02:30:58 user nova-compute[72820]:   </metadata>
Aug 27 02:30:58 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:30:58 user nova-compute[72820]:     <system>
Aug 27 02:30:58 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:30:58 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:30:58 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:30:58 user nova-compute[72820]:       <entry name="serial">89b66e95-2333-403b-b338-6096717ca20d</entry>
Aug 27 02:30:58 user nova-compute[72820]:       <entry name="uuid">89b66e95-2333-403b-b338-6096717ca20d</entry>
Aug 27 02:30:58 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:30:58 user nova-compute[72820]:     </system>
Aug 27 02:30:58 user nova-compute[72820]:   </sysinfo>
Aug 27 02:30:58 user nova-compute[72820]:   <os>
Aug 27 02:30:58 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:30:58 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:30:58 user nova-compute[72820]:   </os>
Aug 27 02:30:58 user nova-compute[72820]:   <features>
Aug 27 02:30:58 user nova-compute[72820]:     <acpi/>
Aug 27 02:30:58 user nova-compute[72820]:     <apic/>
Aug 27 02:30:58 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:30:58 user nova-compute[72820]:   </features>
Aug 27 02:30:58 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:30:58 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:30:58 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:30:58 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:30:58 user nova-compute[72820]:   </clock>
Aug 27 02:30:58 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:30:58 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:30:58 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:30:58 user nova-compute[72820]:   </cpu>
Aug 27 02:30:58 user nova-compute[72820]:   <devices>
Aug 27 02:30:58 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:30:58 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:30:58 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk.rescue"/>
Aug 27 02:30:58 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:30:58 user nova-compute[72820]:     </disk>
Aug 27 02:30:58 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:30:58 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:30:58 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk"/>
Aug 27 02:30:58 user nova-compute[72820]:       <target dev="vdb" bus="virtio"/>
Aug 27 02:30:58 user nova-compute[72820]:     </disk>
Aug 27 02:30:58 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:30:58 user nova-compute[72820]:       <mac address="fa:16:3e:d1:90:a2"/>
Aug 27 02:30:58 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:30:58 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:30:58 user nova-compute[72820]:       <target dev="tap91356c13-2f"/>
Aug 27 02:30:58 user nova-compute[72820]:     </interface>
Aug 27 02:30:58 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:30:58 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/console.log" append="off"/>
Aug 27 02:30:58 user nova-compute[72820]:     </serial>
Aug 27 02:30:58 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:30:58 user nova-compute[72820]:     <video>
Aug 27 02:30:58 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:30:58 user nova-compute[72820]:     </video>
Aug 27 02:30:58 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:30:58 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:30:58 user nova-compute[72820]:     </rng>
Aug 27 02:30:58 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:30:58 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:30:58 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:30:58 user nova-compute[72820]:     </memballoon>
Aug 27 02:30:58 user nova-compute[72820]:   </devices>
Aug 27 02:30:58 user nova-compute[72820]: </domain>
Aug 27 02:30:58 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:30:58 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Instance destroyed successfully.
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:30:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] No VIF found with MAC fa:16:3e:d1:90:a2, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:30:59 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103444.6899796, ac2f6797-8b7c-47d3-836d-fc1c617e23dd => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:30:59 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] VM Stopped (Lifecycle Event)
Aug 27 02:30:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ddb8e76b-ec05-4b78-806d-76a72f5e30ff None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:30:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ddb8e76b-ec05-4b78-806d-76a72f5e30ff None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:30:59 user nova-compute[72820]: INFO nova.compute.manager [None req-ddb8e76b-ec05-4b78-806d-76a72f5e30ff None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 02:31:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-d5c97746-698f-4144-a509-f841125fbcec req-af2b5fe5-dcc9-486e-a618-e7de18727ba6 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:31:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d5c97746-698f-4144-a509-f841125fbcec req-af2b5fe5-dcc9-486e-a618-e7de18727ba6 service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d5c97746-698f-4144-a509-f841125fbcec req-af2b5fe5-dcc9-486e-a618-e7de18727ba6 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d5c97746-698f-4144-a509-f841125fbcec req-af2b5fe5-dcc9-486e-a618-e7de18727ba6 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-d5c97746-698f-4144-a509-f841125fbcec req-af2b5fe5-dcc9-486e-a618-e7de18727ba6 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:31:00 user nova-compute[72820]: WARNING nova.compute.manager [req-d5c97746-698f-4144-a509-f841125fbcec req-af2b5fe5-dcc9-486e-a618-e7de18727ba6 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state active and task_state rescuing.
Aug 27 02:31:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103446.2056198, 63c67f6e-849b-404a-bd38-524604cae3d8 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:31:01 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] VM Stopped (Lifecycle Event)
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Starting finish_migration {{(pid=72820) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Instance directory exists: not creating {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 02:31:01 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Creating image(s)
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a958f305-b891-4215-b777-36783a8ce416 None None] [instance: 63c67f6e-849b-404a-bd38-524604cae3d8] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.201s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk. size=21474836480 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk 21474836480 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk 21474836480" returned: 0 in 0.050s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Did not create local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Ensure instance console log exists: /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Start _get_guest_xml network_info=[{"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-588087841-network", "vif_mac": "fa:16:3e:b6:ef:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '00cd6678-9642-4057-8b3b-89d087079691', 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hATvUwtH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ac2f6797-8b7c-47d3-836d-fc1c617e23dd', 'attached_at': '2023-08-27T02:31:01.000000', 'detached_at': '', 'volume_id': '27cad7eb-b82b-4588-b153-48d86f4da1a1', 'serial': '27cad7eb-b82b-4588-b153-48d86f4da1a1'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:31:01 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:31:01 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hATvUwtH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:31:01 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:31:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:31:01 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:31:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:31:01 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8aff5a-1e3f-47fd-b00b-b70c1e8dffdd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:31:01 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10c86ad-8e3b-476a-9579-45eac28e875f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1] added
Aug 27 02:31:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a284d62-0f2d-4594-9394-acb532bdcb84]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b505a48b-bfc5-4b57-adcb-c2a18d54b641]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hATvUwtH {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hATvUwtH" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8b6a16-72c0-4928-a767-9a593bf603dd]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hATvUwtH'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f85044-9714-4e12-8f2b-8130109cc55e]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb76b71-6b4c-4f33-8d2e-a0e924f5616b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:31:01 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:31:01 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:31:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:31:01 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:31:01 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:31:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:31:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[727fefa3-0a5f-480a-8df2-c7d07f8880f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260]
Aug 27 02:31:02 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260] successful.
Aug 27 02:31:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18c9438-b0dc-49e6-9444-9fc0d130ace2]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG nova.compute.manager [req-75ba5770-8133-409e-b3ce-5f7b5327150b req-ee9ffa74-2c9d-4d38-8bf1-161671398ca9 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-75ba5770-8133-409e-b3ce-5f7b5327150b req-ee9ffa74-2c9d-4d38-8bf1-161671398ca9 service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-75ba5770-8133-409e-b3ce-5f7b5327150b req-ee9ffa74-2c9d-4d38-8bf1-161671398ca9 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-75ba5770-8133-409e-b3ce-5f7b5327150b req-ee9ffa74-2c9d-4d38-8bf1-161671398ca9 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG nova.compute.manager [req-75ba5770-8133-409e-b3ce-5f7b5327150b req-ee9ffa74-2c9d-4d38-8bf1-161671398ca9 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:31:02 user nova-compute[72820]: WARNING nova.compute.manager [req-75ba5770-8133-409e-b3ce-5f7b5327150b req-ee9ffa74-2c9d-4d38-8bf1-161671398ca9 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state active and task_state rescuing.
Aug 27 02:31:02 user nova-compute[72820]: DEBUG nova.compute.manager [req-75ba5770-8133-409e-b3ce-5f7b5327150b req-ee9ffa74-2c9d-4d38-8bf1-161671398ca9 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-75ba5770-8133-409e-b3ce-5f7b5327150b req-ee9ffa74-2c9d-4d38-8bf1-161671398ca9 service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-75ba5770-8133-409e-b3ce-5f7b5327150b req-ee9ffa74-2c9d-4d38-8bf1-161671398ca9 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-75ba5770-8133-409e-b3ce-5f7b5327150b req-ee9ffa74-2c9d-4d38-8bf1-161671398ca9 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG nova.compute.manager [req-75ba5770-8133-409e-b3ce-5f7b5327150b req-ee9ffa74-2c9d-4d38-8bf1-161671398ca9 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:31:02 user nova-compute[72820]: WARNING nova.compute.manager [req-75ba5770-8133-409e-b3ce-5f7b5327150b req-ee9ffa74-2c9d-4d38-8bf1-161671398ca9 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state active and task_state rescuing.
Aug 27 02:31:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa95ffdb-2e55-4eed-a570-d755a0259430]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:31:02 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:31:02 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:31:02 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:31:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:31:02 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:31:02 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:31:02 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:31:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfeaa8b-c658-45aa-8a4a-b446ee06b234]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: None {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Removed pending event for 89b66e95-2333-403b-b338-6096717ca20d due to event {{(pid=72820) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103462.5937562, 89b66e95-2333-403b-b338-6096717ca20d => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:31:02 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] VM Resumed (Lifecycle Event)
Aug 27 02:31:02 user nova-compute[72820]: DEBUG nova.compute.manager [None req-24084b18-2f88-42b8-984d-5d51f3318346 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:31:02 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 02:31:02 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103462.5940182, 89b66e95-2333-403b-b338-6096717ca20d => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:31:02 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] VM Started (Lifecycle Event)
Aug 27 02:31:02 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:31:02 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:31:02 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 02:31:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hATvUwtH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23865303864626138', 'path': '/dev/sdd'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865303864626138', 'path': '/dev/sdd'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:26:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-75697122',display_name='tempest-ServerActionsTestOtherB-server-75697122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-75697122',id=16,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp3hR8w9f7AOU3wBlGjx2QgjVCzjqvm+j+8m+weDqKoVqafaUie8myGeBPk3f9wFUM+nLfm1AWiPS+cjE0rgULgjP5MomAJch5aNo42dwR8Sd4aT6HChhwUBzyy0SaiOg==',key_name='tempest-keypair-1915839179',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:26:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb32c350e1a44044bc5b19942df53d05',ramdisk_id='',reservation_id='r-gmwi89nk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-657110753',owner_user_name='tempest-ServerActionsTestOtherB-657110753-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='555eff4f50e9450aac65344bec772685',uuid=ac2f6797-8b7c-47d3-836d-fc1c617e23dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-588087841-network", "vif_mac": "fa:16:3e:b6:ef:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Converting VIF {"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-588087841-network", "vif_mac": "fa:16:3e:b6:ef:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:31:03 user nova-compute[72820]:   <uuid>ac2f6797-8b7c-47d3-836d-fc1c617e23dd</uuid>
Aug 27 02:31:03 user nova-compute[72820]:   <name>instance-00000010</name>
Aug 27 02:31:03 user nova-compute[72820]:   <memory>2097152</memory>
Aug 27 02:31:03 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:31:03 user nova-compute[72820]:   <metadata>
Aug 27 02:31:03 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:31:03 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:31:03 user nova-compute[72820]:       <nova:name>tempest-ServerActionsTestOtherB-server-75697122</nova:name>
Aug 27 02:31:03 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:31:01</nova:creationTime>
Aug 27 02:31:03 user nova-compute[72820]:       <nova:flavor name="m1.small">
Aug 27 02:31:03 user nova-compute[72820]:         <nova:memory>2048</nova:memory>
Aug 27 02:31:03 user nova-compute[72820]:         <nova:disk>20</nova:disk>
Aug 27 02:31:03 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:31:03 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:31:03 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:31:03 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:31:03 user nova-compute[72820]:       <nova:owner>
Aug 27 02:31:03 user nova-compute[72820]:         <nova:user uuid="555eff4f50e9450aac65344bec772685">tempest-ServerActionsTestOtherB-657110753-project-member</nova:user>
Aug 27 02:31:03 user nova-compute[72820]:         <nova:project uuid="eb32c350e1a44044bc5b19942df53d05">tempest-ServerActionsTestOtherB-657110753</nova:project>
Aug 27 02:31:03 user nova-compute[72820]:       </nova:owner>
Aug 27 02:31:03 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:31:03 user nova-compute[72820]:       <nova:ports>
Aug 27 02:31:03 user nova-compute[72820]:         <nova:port uuid="553b0551-3051-4ed5-9c80-27d77670620d">
Aug 27 02:31:03 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 02:31:03 user nova-compute[72820]:         </nova:port>
Aug 27 02:31:03 user nova-compute[72820]:       </nova:ports>
Aug 27 02:31:03 user nova-compute[72820]:     </nova:instance>
Aug 27 02:31:03 user nova-compute[72820]:   </metadata>
Aug 27 02:31:03 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:31:03 user nova-compute[72820]:     <system>
Aug 27 02:31:03 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:31:03 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:31:03 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:31:03 user nova-compute[72820]:       <entry name="serial">ac2f6797-8b7c-47d3-836d-fc1c617e23dd</entry>
Aug 27 02:31:03 user nova-compute[72820]:       <entry name="uuid">ac2f6797-8b7c-47d3-836d-fc1c617e23dd</entry>
Aug 27 02:31:03 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:31:03 user nova-compute[72820]:     </system>
Aug 27 02:31:03 user nova-compute[72820]:   </sysinfo>
Aug 27 02:31:03 user nova-compute[72820]:   <os>
Aug 27 02:31:03 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:31:03 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:31:03 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:31:03 user nova-compute[72820]:   </os>
Aug 27 02:31:03 user nova-compute[72820]:   <features>
Aug 27 02:31:03 user nova-compute[72820]:     <acpi/>
Aug 27 02:31:03 user nova-compute[72820]:     <apic/>
Aug 27 02:31:03 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:31:03 user nova-compute[72820]:   </features>
Aug 27 02:31:03 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:31:03 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:31:03 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:31:03 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:31:03 user nova-compute[72820]:   </clock>
Aug 27 02:31:03 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:31:03 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:31:03 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:31:03 user nova-compute[72820]:   </cpu>
Aug 27 02:31:03 user nova-compute[72820]:   <devices>
Aug 27 02:31:03 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:31:03 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:31:03 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk"/>
Aug 27 02:31:03 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:31:03 user nova-compute[72820]:     </disk>
Aug 27 02:31:03 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:31:03 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:31:03 user nova-compute[72820]:       <source dev="/dev/sdd"/>
Aug 27 02:31:03 user nova-compute[72820]:       <target dev="vdb" bus="virtio"/>
Aug 27 02:31:03 user nova-compute[72820]:       <serial>27cad7eb-b82b-4588-b153-48d86f4da1a1</serial>
Aug 27 02:31:03 user nova-compute[72820]:     </disk>
Aug 27 02:31:03 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:31:03 user nova-compute[72820]:       <mac address="fa:16:3e:b6:ef:6b"/>
Aug 27 02:31:03 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:31:03 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:31:03 user nova-compute[72820]:       <target dev="tap553b0551-30"/>
Aug 27 02:31:03 user nova-compute[72820]:     </interface>
Aug 27 02:31:03 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:31:03 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/console.log" append="off"/>
Aug 27 02:31:03 user nova-compute[72820]:     </serial>
Aug 27 02:31:03 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:31:03 user nova-compute[72820]:     <video>
Aug 27 02:31:03 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:31:03 user nova-compute[72820]:     </video>
Aug 27 02:31:03 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:31:03 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:31:03 user nova-compute[72820]:     </rng>
Aug 27 02:31:03 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:31:03 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:31:03 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:31:03 user nova-compute[72820]:     </memballoon>
Aug 27 02:31:03 user nova-compute[72820]:   </devices>
Aug 27 02:31:03 user nova-compute[72820]: </domain>
Aug 27 02:31:03 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:26:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-75697122',display_name='tempest-ServerActionsTestOtherB-server-75697122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-75697122',id=16,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp3hR8w9f7AOU3wBlGjx2QgjVCzjqvm+j+8m+weDqKoVqafaUie8myGeBPk3f9wFUM+nLfm1AWiPS+cjE0rgULgjP5MomAJch5aNo42dwR8Sd4aT6HChhwUBzyy0SaiOg==',key_name='tempest-keypair-1915839179',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:26:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb32c350e1a44044bc5b19942df53d05',ramdisk_id='',reservation_id='r-gmwi89nk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-657110753',owner_user_name='tempest-ServerActionsTestOtherB-657110753-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='555eff4f50e9450aac65344bec772685',uuid=ac2f6797-8b7c-47d3-836d-fc1c617e23dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-588087841-network", "vif_mac": "fa:16:3e:b6:ef:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Converting VIF {"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-588087841-network", "vif_mac": "fa:16:3e:b6:ef:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG os_vif [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap553b0551-30, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap553b0551-30, col_values=(('external_ids', {'iface-id': '553b0551-3051-4ed5-9c80-27d77670620d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:ef:6b', 'vm-uuid': 'ac2f6797-8b7c-47d3-836d-fc1c617e23dd'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:03 user nova-compute[72820]: INFO os_vif [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30')
Aug 27 02:31:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:31:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] No VIF found with MAC fa:16:3e:b6:ef:6b, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:31:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:05 user nova-compute[72820]: DEBUG nova.compute.manager [req-4d4e10b8-c5f9-437d-b7fc-9b05927fb414 req-515ffc2f-b886-43db-8cd8-c907cc7819d7 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received event network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:31:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4d4e10b8-c5f9-437d-b7fc-9b05927fb414 req-515ffc2f-b886-43db-8cd8-c907cc7819d7 service nova] Acquiring lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4d4e10b8-c5f9-437d-b7fc-9b05927fb414 req-515ffc2f-b886-43db-8cd8-c907cc7819d7 service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4d4e10b8-c5f9-437d-b7fc-9b05927fb414 req-515ffc2f-b886-43db-8cd8-c907cc7819d7 service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:05 user nova-compute[72820]: DEBUG nova.compute.manager [req-4d4e10b8-c5f9-437d-b7fc-9b05927fb414 req-515ffc2f-b886-43db-8cd8-c907cc7819d7 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] No waiting events found dispatching network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:31:05 user nova-compute[72820]: WARNING nova.compute.manager [req-4d4e10b8-c5f9-437d-b7fc-9b05927fb414 req-515ffc2f-b886-43db-8cd8-c907cc7819d7 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received unexpected event network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d for instance with vm_state active and task_state resize_finish.
Aug 27 02:31:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-ad4496fe-c8ba-49a8-a127-0d86f0a88c34 req-2716686f-f2af-4c6e-8644-3887b67c761e service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received event network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:31:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ad4496fe-c8ba-49a8-a127-0d86f0a88c34 req-2716686f-f2af-4c6e-8644-3887b67c761e service nova] Acquiring lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ad4496fe-c8ba-49a8-a127-0d86f0a88c34 req-2716686f-f2af-4c6e-8644-3887b67c761e service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ad4496fe-c8ba-49a8-a127-0d86f0a88c34 req-2716686f-f2af-4c6e-8644-3887b67c761e service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-ad4496fe-c8ba-49a8-a127-0d86f0a88c34 req-2716686f-f2af-4c6e-8644-3887b67c761e service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] No waiting events found dispatching network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:31:07 user nova-compute[72820]: WARNING nova.compute.manager [req-ad4496fe-c8ba-49a8-a127-0d86f0a88c34 req-2716686f-f2af-4c6e-8644-3887b67c761e service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received unexpected event network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d for instance with vm_state active and task_state resize_finish.
Aug 27 02:31:07 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103467.3418527, ac2f6797-8b7c-47d3-836d-fc1c617e23dd => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:31:07 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] VM Resumed (Lifecycle Event)
Aug 27 02:31:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:31:07 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Instance running successfully.
Aug 27 02:31:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Failed to set time: agent not configured {{(pid=72820) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 27 02:31:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-20f9a8f6-231b-4b6d-b6d4-3518173c8e3a tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] finish_migration finished successfully. {{(pid=72820) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 27 02:31:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:31:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:31:07 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 02:31:07 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103467.3421104, ac2f6797-8b7c-47d3-836d-fc1c617e23dd => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:31:07 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] VM Started (Lifecycle Event)
Aug 27 02:31:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:31:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:31:07 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 02:31:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:08 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:31:09 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:31:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:31:10 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:31:10 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:31:10 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:31:10 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 02:31:10 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] There are 0 instances to clean {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 02:31:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:31:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:31:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:11 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:31:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:31:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:31:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:31:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:31:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:16 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:31:16 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7139MB free_disk=25.123348236083984GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Applying migration context for instance ac2f6797-8b7c-47d3-836d-fc1c617e23dd as it has an incoming, in-progress migration ebf31c8f-7d9d-46e1-b1f4-4247c14bf8a1. Migration status is finished {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 02:31:16 user nova-compute[72820]: INFO nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Updating resource usage from migration ebf31c8f-7d9d-46e1-b1f4-4247c14bf8a1
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 26581695-c4b9-40b8-ab7a-34c99db0dadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f8f612f3-41c9-4dae-8d49-218d61720b15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 050e0c2b-9244-4987-b07d-e4712e46f936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1591319d-3d15-4c46-b823-4edddf018b5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 7c42c4ae-0f80-4295-a64e-b426225b94c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 89b66e95-2333-403b-b338-6096717ca20d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 4becc265-4f3d-4f83-a9ac-c99100a870ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Migration ebf31c8f-7d9d-46e1-b1f4-4247c14bf8a1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance ac2f6797-8b7c-47d3-836d-fc1c617e23dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance a67eea06-dabf-4115-9650-ea4098f80bd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing inventories for resource provider a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Updating ProviderTree inventory for provider a962b30a-2750-431c-be10-075d0f991065 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Updating inventory in ProviderTree for provider a962b30a-2750-431c-be10-075d0f991065 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing aggregate associations for resource provider a962b30a-2750-431c-be10-075d0f991065, aggregates: None {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 02:31:16 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing trait associations for resource provider a962b30a-2750-431c-be10-075d0f991065, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 02:31:17 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:31:17 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:31:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:31:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.729s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:17 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:31:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:18 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:31:18 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:31:18 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:31:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-050e0c2b-9244-4987-b07d-e4712e46f936" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:31:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-050e0c2b-9244-4987-b07d-e4712e46f936" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:31:18 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:31:18 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Updating instance_info_cache with network_info: [{"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:31:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-050e0c2b-9244-4987-b07d-e4712e46f936" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:31:18 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:31:18 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:31:18 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:31:18 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 02:31:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:28 user nova-compute[72820]: DEBUG nova.compute.manager [req-41b6bcda-af96-458d-b99b-74663b9a746d req-ccee740a-b391-45c0-b25f-0f1786366346 service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Received event network-changed-bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:31:28 user nova-compute[72820]: DEBUG nova.compute.manager [req-41b6bcda-af96-458d-b99b-74663b9a746d req-ccee740a-b391-45c0-b25f-0f1786366346 service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Refreshing instance network info cache due to event network-changed-bcc2e999-9d21-4d4c-84b8-b29ffddfedb9. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:31:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-41b6bcda-af96-458d-b99b-74663b9a746d req-ccee740a-b391-45c0-b25f-0f1786366346 service nova] Acquiring lock "refresh_cache-4becc265-4f3d-4f83-a9ac-c99100a870ff" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:31:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-41b6bcda-af96-458d-b99b-74663b9a746d req-ccee740a-b391-45c0-b25f-0f1786366346 service nova] Acquired lock "refresh_cache-4becc265-4f3d-4f83-a9ac-c99100a870ff" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:31:28 user nova-compute[72820]: DEBUG nova.network.neutron [req-41b6bcda-af96-458d-b99b-74663b9a746d req-ccee740a-b391-45c0-b25f-0f1786366346 service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Refreshing network info cache for port bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG nova.network.neutron [req-41b6bcda-af96-458d-b99b-74663b9a746d req-ccee740a-b391-45c0-b25f-0f1786366346 service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Updated VIF entry in instance network info cache for port bcc2e999-9d21-4d4c-84b8-b29ffddfedb9. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG nova.network.neutron [req-41b6bcda-af96-458d-b99b-74663b9a746d req-ccee740a-b391-45c0-b25f-0f1786366346 service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Updating instance_info_cache with network_info: [{"id": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "address": "fa:16:3e:ec:8f:95", "network": {"id": "39de3116-51df-478a-bead-efb89526d4d2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-127107834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf987dacdf44dc4807c74d4aa283357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcc2e999-9d", "ovs_interfaceid": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-41b6bcda-af96-458d-b99b-74663b9a746d req-ccee740a-b391-45c0-b25f-0f1786366346 service nova] Releasing lock "refresh_cache-4becc265-4f3d-4f83-a9ac-c99100a870ff" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG nova.objects.instance [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lazy-loading 'flavor' on Instance uuid 4becc265-4f3d-4f83-a9ac-c99100a870ff {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:29 user nova-compute[72820]: INFO nova.compute.manager [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Attaching volume 7a61e3b0-c116-4d65-87a6-c9e9839f160f to /dev/vdb
Aug 27 02:31:29 user nova-compute[72820]: DEBUG os_brick.utils [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80595bf-2421-4895-add3-7fbbb83bdb84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ee47d4-fe3d-4306-8037-7fed00260bab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[afefb59a-c482-4876-b7de-7fd7dcd30a72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c6c024-f511-49d2-b760-27b3228ab907]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:31:29 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:31:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9e12b5-3b4a-4287-8483-585122861588]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG os_brick.utils [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:31:29 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Updating existing volume attachment record: caba832f-b664-49f5-98e4-b1625307475c {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:31:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "94323d83-f8fe-4814-82af-f860a20071bf" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "94323d83-f8fe-4814-82af-f860a20071bf" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.004s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:35 user nova-compute[72820]: INFO nova.compute.manager [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Unshelving
Aug 27 02:31:35 user nova-compute[72820]: INFO nova.virt.block_device [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Booting with volume 497c2055-ee13-45f0-8652-3ac5ba9b8c37 at /dev/vda
Aug 27 02:31:35 user nova-compute[72820]: DEBUG os_brick.utils [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[732c677b-cbd0-4be2-a973-16ba2911b115]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2c3de2-9682-4461-8bd6-d212aac63500]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58c553a-2c86-461b-bcb4-f5f8b91497c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[68486245-825d-4a29-88b7-6da9b4663f08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:31:35 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:31:35 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fab70e-d81a-4e82-8183-eb96e09895ab]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG os_brick.utils [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:31:35 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Updating existing volume attachment record: b51662bc-efea-49b2-876c-6ad45b90e9de {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:31:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oUhBxzkT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:31:41 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:31:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:31:41 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:31:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:31:41 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e733d233-c1e6-4c76-b244-a2325a06ab72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:31:41 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e840e1c-0b89-4417-a73c-4e5cfdf11d6c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f] added
Aug 27 02:31:41 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd21908-e7f4-4233-a583-3542e9d87ee7]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eda8a6b-c4f9-498f-87be-87da6a682c5c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oUhBxzkT {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oUhBxzkT" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a0456f-1611-48d0-bc85-e6f7c9887c5f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oUhBxzkT'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a53fdc-7317-42ce-b004-4ec0e8b3d865]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8943ba-e286-4b1b-bf71-cdb79df6262a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:31:41 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:31:41 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:31:41 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:31:41 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:31:41 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:31:41 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:31:41 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:31:41 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:31:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a090f2-138f-465d-9670-c8048c73ed35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f, portal: 172.16.0.220,3260]
Aug 27 02:31:42 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f, portal: 172.16.0.220,3260] successful.
Aug 27 02:31:42 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdef3a1-8076-400c-894f-788602bf5c8b]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9e6cc3-76de-48cd-8a23-c40ca0074b09]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:31:42 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:31:42 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:31:42 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:31:42 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:31:42 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:31:42 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:31:42 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:31:42 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:31:42 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:31:42 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83d8b75-9b91-40ef-9f6a-6a26b794c963]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:42 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: None {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oUhBxzkT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23764626162376565', 'path': '/dev/sde'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764626162376565', 'path': '/dev/sde'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG nova.objects.instance [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lazy-loading 'flavor' on Instance uuid 4becc265-4f3d-4f83-a9ac-c99100a870ff {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:31:43 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:31:43 user nova-compute[72820]:   <source dev="/dev/sde"/>
Aug 27 02:31:43 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:31:43 user nova-compute[72820]:   <serial>7a61e3b0-c116-4d65-87a6-c9e9839f160f</serial>
Aug 27 02:31:43 user nova-compute[72820]: </disk>
Aug 27 02:31:43 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "050e0c2b-9244-4987-b07d-e4712e46f936" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:43 user nova-compute[72820]: INFO nova.compute.manager [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Detaching volume eef65157-3d3e-4206-a2a3-d72d56a55047
Aug 27 02:31:43 user nova-compute[72820]: INFO nova.virt.block_device [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Attempting to driver detach volume eef65157-3d3e-4206-a2a3-d72d56a55047 from mountpoint /dev/vdb
Aug 27 02:31:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Attempting to detach device vdb from instance 050e0c2b-9244-4987-b07d-e4712e46f936 from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:31:43 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:31:43 user nova-compute[72820]:   <source dev="/dev/sdc"/>
Aug 27 02:31:43 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:31:43 user nova-compute[72820]:   <serial>eef65157-3d3e-4206-a2a3-d72d56a55047</serial>
Aug 27 02:31:43 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 02:31:43 user nova-compute[72820]: </disk>
Aug 27 02:31:43 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:31:43 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Successfully detached device vdb from instance 050e0c2b-9244-4987-b07d-e4712e46f936 from the persistent domain config.
Aug 27 02:31:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 050e0c2b-9244-4987-b07d-e4712e46f936 from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:31:43 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:31:43 user nova-compute[72820]:   <source dev="/dev/sdc"/>
Aug 27 02:31:43 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:31:43 user nova-compute[72820]:   <serial>eef65157-3d3e-4206-a2a3-d72d56a55047</serial>
Aug 27 02:31:43 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 02:31:43 user nova-compute[72820]: </disk>
Aug 27 02:31:43 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] No VIF found with MAC fa:16:3e:ec:8f:95, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:31:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7c8a8106-9a24-4eca-997a-6821c891dfc3 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.326s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693103504.1245525, 050e0c2b-9244-4987-b07d-e4712e46f936 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:31:44 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Successfully detached device vdb from instance 050e0c2b-9244-4987-b07d-e4712e46f936 from the live domain config.
Aug 27 02:31:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlOEvWhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:31:44 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f245cd86-b20a-4bcd-a5c4-77e0e3dea838]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:31:44 user nova-compute[72820]: No targets found.
Aug 27 02:31:44 user nova-compute[72820]: iSNS:
Aug 27 02:31:44 user nova-compute[72820]: No targets found.
Aug 27 02:31:44 user nova-compute[72820]: STATIC:
Aug 27 02:31:44 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f
Aug 27 02:31:44 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:31:44 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:31:44 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047
Aug 27 02:31:44 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:31:44 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:31:44 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1
Aug 27 02:31:44 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:31:44 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:31:44 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:31:44 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:31:44 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:31:44 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf
Aug 27 02:31:44 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:31:44 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:31:44 user nova-compute[72820]: FIRMWARE:
Aug 27 02:31:44 user nova-compute[72820]: No targets found.
Aug 27 02:31:44 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:31:44 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:31:44 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2422db29-e1fe-43e8-802d-a05a95cb0ccc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[722650b6-557a-4169-9a8e-1eaeae186b40]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:31:44 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:31:44 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:31:44 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:31:44 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:31:44 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:31:44 user nova-compute[72820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 (non-flash)
Aug 27 02:31:44 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:31:44 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:31:44 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:31:44 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75d00d64d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047'): ({'sdc'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Removing single pathed devices sdc {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e6e530-61bb-4901-b185-7657d4c17a0a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5e31b0-da33-4d60-baa2-fff4eb8715fa]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Flushing IO for device /dev/sdc {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c834a2-2131-4821-9643-65250c57a3ca]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57aea9f-0d60-4f74-a1b3-e8a516d842e7]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c7312c-ec04-4c36-bcb4-c6cb775d0f21]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ff85b2-bbd3-4b51-99b2-12a4a8064e65]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047, portal: 172.16.0.220,3260]
Aug 27 02:31:44 user nova-compute[72820]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047, portal: 172.16.0.220,3260] successful.
Aug 27 02:31:44 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef65157-3d3e-4206-a2a3-d72d56a55047 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddd095b-273d-44ef-ac11-b13cf8fdbcad]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] <== disconnect_volume: return (325ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:31:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:31:45 user nova-compute[72820]: DEBUG nova.objects.instance [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'flavor' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:31:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-55af0619-ad3c-45bc-b9c3-14316ad95bda tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "050e0c2b-9244-4987-b07d-e4712e46f936" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.739s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-63ae50a1-a346-45bb-9dd9-b7c9004cea64 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-63ae50a1-a346-45bb-9dd9-b7c9004cea64 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "050e0c2b-9244-4987-b07d-e4712e46f936" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-63ae50a1-a346-45bb-9dd9-b7c9004cea64 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:31:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-63ae50a1-a346-45bb-9dd9-b7c9004cea64 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72820) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 27 02:31:45 user nova-compute[72820]: DEBUG nova.objects.instance [None req-63ae50a1-a346-45bb-9dd9-b7c9004cea64 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'flavor' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:31:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-3253daf0-4c3d-428b-af14-9d813f6e2c4f req-e7e58a14-5b30-4e56-a74b-1420e192ae8b service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received event network-vif-unplugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:31:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3253daf0-4c3d-428b-af14-9d813f6e2c4f req-e7e58a14-5b30-4e56-a74b-1420e192ae8b service nova] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3253daf0-4c3d-428b-af14-9d813f6e2c4f req-e7e58a14-5b30-4e56-a74b-1420e192ae8b service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3253daf0-4c3d-428b-af14-9d813f6e2c4f req-e7e58a14-5b30-4e56-a74b-1420e192ae8b service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-3253daf0-4c3d-428b-af14-9d813f6e2c4f req-e7e58a14-5b30-4e56-a74b-1420e192ae8b service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] No waiting events found dispatching network-vif-unplugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:31:45 user nova-compute[72820]: WARNING nova.compute.manager [req-3253daf0-4c3d-428b-af14-9d813f6e2c4f req-e7e58a14-5b30-4e56-a74b-1420e192ae8b service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received unexpected event network-vif-unplugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 for instance with vm_state active and task_state powering-off.
Aug 27 02:31:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:46 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Instance destroyed successfully.
Aug 27 02:31:46 user nova-compute[72820]: DEBUG nova.compute.manager [None req-63ae50a1-a346-45bb-9dd9-b7c9004cea64 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:31:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-63ae50a1-a346-45bb-9dd9-b7c9004cea64 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "050e0c2b-9244-4987-b07d-e4712e46f936" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.920s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG nova.objects.instance [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lazy-loading 'flavor' on Instance uuid 4becc265-4f3d-4f83-a9ac-c99100a870ff {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG nova.compute.manager [req-ad67d06e-ebf0-4fd8-b0ba-f5617145e583 req-8e7d936b-c7c2-4d71-a4d1-3a5a05285cd9 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received event network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ad67d06e-ebf0-4fd8-b0ba-f5617145e583 req-8e7d936b-c7c2-4d71-a4d1-3a5a05285cd9 service nova] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ad67d06e-ebf0-4fd8-b0ba-f5617145e583 req-8e7d936b-c7c2-4d71-a4d1-3a5a05285cd9 service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ad67d06e-ebf0-4fd8-b0ba-f5617145e583 req-8e7d936b-c7c2-4d71-a4d1-3a5a05285cd9 service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG nova.compute.manager [req-ad67d06e-ebf0-4fd8-b0ba-f5617145e583 req-8e7d936b-c7c2-4d71-a4d1-3a5a05285cd9 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] No waiting events found dispatching network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:31:47 user nova-compute[72820]: WARNING nova.compute.manager [req-ad67d06e-ebf0-4fd8-b0ba-f5617145e583 req-8e7d936b-c7c2-4d71-a4d1-3a5a05285cd9 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received unexpected event network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 for instance with vm_state stopped and task_state None.
Aug 27 02:31:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG nova.objects.instance [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lazy-loading 'pci_requests' on Instance uuid 94323d83-f8fe-4814-82af-f860a20071bf {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:47 user nova-compute[72820]: INFO nova.compute.manager [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Attaching volume 50591bcd-7dee-45b5-904f-4c9f26565eea to /dev/vdc
Aug 27 02:31:47 user nova-compute[72820]: DEBUG nova.objects.instance [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lazy-loading 'numa_topology' on Instance uuid 94323d83-f8fe-4814-82af-f860a20071bf {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:31:47 user nova-compute[72820]: INFO nova.compute.claims [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Claim successful on node user
Aug 27 02:31:47 user nova-compute[72820]: DEBUG os_brick.utils [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[644ccbbc-34b0-4697-a673-6a3ab9aff6ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e477efd2-23bf-469d-8eee-d0247ffc9bc7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:48 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b194b21-4c86-4ee7-bf94-487f6c5012e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:48 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b372e8-2144-4654-89ca-a55d5376e698]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:31:48 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:31:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:31:48 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:31:48 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e544fb7d-042e-45db-8d3f-23555765b640]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:48 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:31:48 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:31:48 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:31:48 user nova-compute[72820]: DEBUG os_brick.utils [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:31:48 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Updating existing volume attachment record: 3d04ff58-e1b4-4cba-bc34-b2df4a223893 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:31:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:48 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:31:48 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:31:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:48 user nova-compute[72820]: INFO nova.network.neutron [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Updating port 03bf65d2-99ae-4eea-863b-3edc35e19dd4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquired lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Updating instance_info_cache with network_info: [{"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Releasing lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:31:49 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Creating image(s)
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Did not create local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Ensure instance console log exists: /opt/stack/data/nova/instances/94323d83-f8fe-4814-82af-f860a20071bf/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Start _get_guest_xml network_info=[{"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b51662bc-efea-49b2-876c-6ad45b90e9de', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIGKvAka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94323d83-f8fe-4814-82af-f860a20071bf', 'attached_at': '', 'detached_at': '', 'volume_id': '497c2055-ee13-45f0-8652-3ac5ba9b8c37', 'serial': '497c2055-ee13-45f0-8652-3ac5ba9b8c37'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:31:49 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:31:49 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.objects.instance [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lazy-loading 'vcpu_model' on Instance uuid 94323d83-f8fe-4814-82af-f860a20071bf {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.objects.base [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Object Instance<94323d83-f8fe-4814-82af-f860a20071bf> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIGKvAka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:31:49 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:31:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:31:49 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:31:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:31:49 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdc3ed5-ba1c-401e-a48d-d4a7ec06d3ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:31:49 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bf60ea-4717-4d4d-baee-9882630d5343]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37] added
Aug 27 02:31:49 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e51ea0-e10d-4146-a0cc-4240ca1ce765]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5498126-7f00-40d0-a4d0-61cab2233edb]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EIGKvAka {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EIGKvAka" returned: 0 in 0.047s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbab28e-c60a-4480-81b7-ddd4a7f2f261]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EIGKvAka'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.compute.manager [req-6f32727c-ff6b-4972-9637-58d8854051a7 req-be4d5342-f24f-4af9-abc0-4e26f2d6cfc5 service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received event network-changed-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.compute.manager [req-6f32727c-ff6b-4972-9637-58d8854051a7 req-be4d5342-f24f-4af9-abc0-4e26f2d6cfc5 service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Refreshing instance network info cache due to event network-changed-03bf65d2-99ae-4eea-863b-3edc35e19dd4. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6f32727c-ff6b-4972-9637-58d8854051a7 req-be4d5342-f24f-4af9-abc0-4e26f2d6cfc5 service nova] Acquiring lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6f32727c-ff6b-4972-9637-58d8854051a7 req-be4d5342-f24f-4af9-abc0-4e26f2d6cfc5 service nova] Acquired lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG nova.network.neutron [req-6f32727c-ff6b-4972-9637-58d8854051a7 req-be4d5342-f24f-4af9-abc0-4e26f2d6cfc5 service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Refreshing network info cache for port 03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c5b5ee-d77e-4f55-8476-90779fdd1845]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1f5684-8eb2-4ddd-a02f-52a3b7c497c1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:31:49 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:31:49 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:31:49 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:31:49 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:31:49 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:31:49 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:31:49 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:31:49 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:31:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0642289-9755-41e5-b028-5d0ae84e4ddf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37, portal: 172.16.0.220,3260]
Aug 27 02:31:50 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37, portal: 172.16.0.220,3260] successful.
Aug 27 02:31:50 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c0e2b6-2904-4197-a86f-555056563021]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a291d6f-6a27-40ad-9734-966366516232]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:31:50 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:31:50 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:31:50 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:31:50 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:31:50 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:31:50 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:31:50 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:31:50 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:31:50 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:31:50 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[adeb2a20-6e4c-4576-92b0-c0d4a24d5bed]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIGKvAka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG nova.network.neutron [req-6f32727c-ff6b-4972-9637-58d8854051a7 req-be4d5342-f24f-4af9-abc0-4e26f2d6cfc5 service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Updated VIF entry in instance network info cache for port 03bf65d2-99ae-4eea-863b-3edc35e19dd4. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG nova.network.neutron [req-6f32727c-ff6b-4972-9637-58d8854051a7 req-be4d5342-f24f-4af9-abc0-4e26f2d6cfc5 service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Updating instance_info_cache with network_info: [{"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:31:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6f32727c-ff6b-4972-9637-58d8854051a7 req-be4d5342-f24f-4af9-abc0-4e26f2d6cfc5 service nova] Releasing lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23938663130633164', 'path': '/dev/sdc'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938663130633164', 'path': '/dev/sdc'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T02:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1937387142',display_name='tempest-TestShelveInstance-server-1937387142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1937387142',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1669796109',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:28:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bbf36cee8a5645d5950878c914bf1f85',ramdisk_id='',reservation_id='r-u2u632ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1813275073',owner_user_name='tempest-TestShelveInstance-1813275073-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:31:35Z,user_data=None,user_id='4863de7cf43b4c8599cfc292b3308f56',uuid=94323d83-f8fe-4814-82af-f860a20071bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Converting VIF {"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:59,bridge_name='br-int',has_traffic_filtering=True,id=03bf65d2-99ae-4eea-863b-3edc35e19dd4,network=Network(36de333f-9660-4657-89e8-fd4409b55471),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf65d2-99') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG nova.objects.instance [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lazy-loading 'pci_devices' on Instance uuid 94323d83-f8fe-4814-82af-f860a20071bf {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG nova.objects.base [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Object Instance<94323d83-f8fe-4814-82af-f860a20071bf> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:31:51 user nova-compute[72820]:   <uuid>94323d83-f8fe-4814-82af-f860a20071bf</uuid>
Aug 27 02:31:51 user nova-compute[72820]:   <name>instance-00000014</name>
Aug 27 02:31:51 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:31:51 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:31:51 user nova-compute[72820]:   <metadata>
Aug 27 02:31:51 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:31:51 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:31:51 user nova-compute[72820]:       <nova:name>tempest-TestShelveInstance-server-1937387142</nova:name>
Aug 27 02:31:51 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:31:49</nova:creationTime>
Aug 27 02:31:51 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:31:51 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:31:51 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:31:51 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:31:51 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:31:51 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:31:51 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:31:51 user nova-compute[72820]:       <nova:owner>
Aug 27 02:31:51 user nova-compute[72820]:         <nova:user uuid="4863de7cf43b4c8599cfc292b3308f56">tempest-TestShelveInstance-1813275073-project-member</nova:user>
Aug 27 02:31:51 user nova-compute[72820]:         <nova:project uuid="bbf36cee8a5645d5950878c914bf1f85">tempest-TestShelveInstance-1813275073</nova:project>
Aug 27 02:31:51 user nova-compute[72820]:       </nova:owner>
Aug 27 02:31:51 user nova-compute[72820]:       <nova:ports>
Aug 27 02:31:51 user nova-compute[72820]:         <nova:port uuid="03bf65d2-99ae-4eea-863b-3edc35e19dd4">
Aug 27 02:31:51 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 02:31:51 user nova-compute[72820]:         </nova:port>
Aug 27 02:31:51 user nova-compute[72820]:       </nova:ports>
Aug 27 02:31:51 user nova-compute[72820]:     </nova:instance>
Aug 27 02:31:51 user nova-compute[72820]:   </metadata>
Aug 27 02:31:51 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:31:51 user nova-compute[72820]:     <system>
Aug 27 02:31:51 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:31:51 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:31:51 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:31:51 user nova-compute[72820]:       <entry name="serial">94323d83-f8fe-4814-82af-f860a20071bf</entry>
Aug 27 02:31:51 user nova-compute[72820]:       <entry name="uuid">94323d83-f8fe-4814-82af-f860a20071bf</entry>
Aug 27 02:31:51 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:31:51 user nova-compute[72820]:     </system>
Aug 27 02:31:51 user nova-compute[72820]:   </sysinfo>
Aug 27 02:31:51 user nova-compute[72820]:   <os>
Aug 27 02:31:51 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:31:51 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:31:51 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:31:51 user nova-compute[72820]:   </os>
Aug 27 02:31:51 user nova-compute[72820]:   <features>
Aug 27 02:31:51 user nova-compute[72820]:     <acpi/>
Aug 27 02:31:51 user nova-compute[72820]:     <apic/>
Aug 27 02:31:51 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:31:51 user nova-compute[72820]:   </features>
Aug 27 02:31:51 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:31:51 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:31:51 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:31:51 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:31:51 user nova-compute[72820]:   </clock>
Aug 27 02:31:51 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:31:51 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:31:51 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:31:51 user nova-compute[72820]:   </cpu>
Aug 27 02:31:51 user nova-compute[72820]:   <devices>
Aug 27 02:31:51 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:31:51 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:31:51 user nova-compute[72820]:       <source dev="/dev/sdc"/>
Aug 27 02:31:51 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:31:51 user nova-compute[72820]:       <serial>497c2055-ee13-45f0-8652-3ac5ba9b8c37</serial>
Aug 27 02:31:51 user nova-compute[72820]:     </disk>
Aug 27 02:31:51 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:31:51 user nova-compute[72820]:       <mac address="fa:16:3e:bb:1b:59"/>
Aug 27 02:31:51 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:31:51 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:31:51 user nova-compute[72820]:       <target dev="tap03bf65d2-99"/>
Aug 27 02:31:51 user nova-compute[72820]:     </interface>
Aug 27 02:31:51 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:31:51 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/94323d83-f8fe-4814-82af-f860a20071bf/console.log" append="off"/>
Aug 27 02:31:51 user nova-compute[72820]:     </serial>
Aug 27 02:31:51 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:31:51 user nova-compute[72820]:     <video>
Aug 27 02:31:51 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:31:51 user nova-compute[72820]:     </video>
Aug 27 02:31:51 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:31:51 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:31:51 user nova-compute[72820]:     </rng>
Aug 27 02:31:51 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:31:51 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:31:51 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:31:51 user nova-compute[72820]:     </memballoon>
Aug 27 02:31:51 user nova-compute[72820]:   </devices>
Aug 27 02:31:51 user nova-compute[72820]: </domain>
Aug 27 02:31:51 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T02:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1937387142',display_name='tempest-TestShelveInstance-server-1937387142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1937387142',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1669796109',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:28:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bbf36cee8a5645d5950878c914bf1f85',ramdisk_id='',reservation_id='r-u2u632ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1813275073',owner_user_name='tempest-TestShelveInstance-1813275073-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:31:35Z,user_data=None,user_id='4863de7cf43b4c8599cfc292b3308f56',uuid=94323d83-f8fe-4814-82af-f860a20071bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Converting VIF {"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:59,bridge_name='br-int',has_traffic_filtering=True,id=03bf65d2-99ae-4eea-863b-3edc35e19dd4,network=Network(36de333f-9660-4657-89e8-fd4409b55471),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf65d2-99') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG os_vif [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:59,bridge_name='br-int',has_traffic_filtering=True,id=03bf65d2-99ae-4eea-863b-3edc35e19dd4,network=Network(36de333f-9660-4657-89e8-fd4409b55471),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf65d2-99') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03bf65d2-99, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03bf65d2-99, col_values=(('external_ids', {'iface-id': '03bf65d2-99ae-4eea-863b-3edc35e19dd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:1b:59', 'vm-uuid': '94323d83-f8fe-4814-82af-f860a20071bf'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:51 user nova-compute[72820]: INFO os_vif [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:59,bridge_name='br-int',has_traffic_filtering=True,id=03bf65d2-99ae-4eea-863b-3edc35e19dd4,network=Network(36de333f-9660-4657-89e8-fd4409b55471),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf65d2-99')
Aug 27 02:31:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:31:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] No VIF found with MAC fa:16:3e:bb:1b:59, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:31:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-74c49dc6-c38e-4943-9200-599241cf9003 req-9530460c-d1d3-4653-8e9b-3911408fb93b service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received event network-vif-plugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:31:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-74c49dc6-c38e-4943-9200-599241cf9003 req-9530460c-d1d3-4653-8e9b-3911408fb93b service nova] Acquiring lock "94323d83-f8fe-4814-82af-f860a20071bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-74c49dc6-c38e-4943-9200-599241cf9003 req-9530460c-d1d3-4653-8e9b-3911408fb93b service nova] Lock "94323d83-f8fe-4814-82af-f860a20071bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-74c49dc6-c38e-4943-9200-599241cf9003 req-9530460c-d1d3-4653-8e9b-3911408fb93b service nova] Lock "94323d83-f8fe-4814-82af-f860a20071bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-74c49dc6-c38e-4943-9200-599241cf9003 req-9530460c-d1d3-4653-8e9b-3911408fb93b service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] No waiting events found dispatching network-vif-plugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:31:52 user nova-compute[72820]: WARNING nova.compute.manager [req-74c49dc6-c38e-4943-9200-599241cf9003 req-9530460c-d1d3-4653-8e9b-3911408fb93b service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received unexpected event network-vif-plugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 02:31:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:54 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103514.7637005, 94323d83-f8fe-4814-82af-f860a20071bf => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:31:54 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] VM Resumed (Lifecycle Event)
Aug 27 02:31:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:31:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:31:54 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Instance spawned successfully.
Aug 27 02:31:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:31:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:31:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:31:54 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:31:54 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103514.7659454, 94323d83-f8fe-4814-82af-f860a20071bf => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:31:54 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] VM Started (Lifecycle Event)
Aug 27 02:31:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:31:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:31:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c7696a63-f11d-478a-8156-a7c58e71bc51 tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "94323d83-f8fe-4814-82af-f860a20071bf" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.757s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-14119c6d-db14-4795-af4d-f82275f7f76b req-72a5b3f7-908e-4a3f-bc40-27d9d5e0e75a service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received event network-vif-plugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:31:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-14119c6d-db14-4795-af4d-f82275f7f76b req-72a5b3f7-908e-4a3f-bc40-27d9d5e0e75a service nova] Acquiring lock "94323d83-f8fe-4814-82af-f860a20071bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:31:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-14119c6d-db14-4795-af4d-f82275f7f76b req-72a5b3f7-908e-4a3f-bc40-27d9d5e0e75a service nova] Lock "94323d83-f8fe-4814-82af-f860a20071bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:31:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-14119c6d-db14-4795-af4d-f82275f7f76b req-72a5b3f7-908e-4a3f-bc40-27d9d5e0e75a service nova] Lock "94323d83-f8fe-4814-82af-f860a20071bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:31:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-14119c6d-db14-4795-af4d-f82275f7f76b req-72a5b3f7-908e-4a3f-bc40-27d9d5e0e75a service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] No waiting events found dispatching network-vif-plugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:31:54 user nova-compute[72820]: WARNING nova.compute.manager [req-14119c6d-db14-4795-af4d-f82275f7f76b req-72a5b3f7-908e-4a3f-bc40-27d9d5e0e75a service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received unexpected event network-vif-plugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 for instance with vm_state active and task_state None.
Aug 27 02:31:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:31:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLpZwXeg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:32:00 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:32:00 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:32:00 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b8b837-0fa3-4c80-9c2f-7ade117d0068]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:32:00 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdf7edd-7046-46bf-9faf-c9cbbc4c78fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea] added
Aug 27 02:32:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3923edd-5c3c-475e-859d-740894ba69e8]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa77ee42-a876-402f-b72a-bf57a6b884ba]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uLpZwXeg {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uLpZwXeg" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1bf889-b378-478c-852c-1ffe82062e4b]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uLpZwXeg'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d2bbfb-49aa-4a8d-9458-2d6d1b3975d9]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5317d08-532b-4057-9ae3-af61deb9dac3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:32:00 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:32:00 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:32:00 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:32:00 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:32:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:32:00 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:32:00 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:32:00 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:32:00 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:32:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c703bc85-94bc-46fe-b6d0-8cc7037bdb03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea, portal: 172.16.0.220,3260]
Aug 27 02:32:00 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea, portal: 172.16.0.220,3260] successful.
Aug 27 02:32:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[93223257-f2c6-4b8a-a154-3989bfa2fed0]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8f2036-6e90-43ee-88fe-6262193f8bb7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:32:00 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:32:00 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:32:00 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:32:00 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:32:00 user nova-compute[72820]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea (non-flash)
Aug 27 02:32:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:32:00 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:32:00 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:32:00 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:32:00 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:32:00 user nova-compute[72820]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea (non-flash)
Aug 27 02:32:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] HCTL ('38', '-', '-', 0) found on session 30 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f63d4c-2339-4eba-9c0d-592edb2bfa38]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Searching for a device in session 30 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:32:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLpZwXeg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:32:01 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:01 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103506.3302302, 050e0c2b-9244-4987-b07d-e4712e46f936 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:32:01 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] VM Stopped (Lifecycle Event)
Aug 27 02:32:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-431a9998-705e-4e7a-9923-68dca530a2c5 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-431a9998-705e-4e7a-9923-68dca530a2c5 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:32:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:32:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23039663033616431', 'path': '/dev/sdg'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:32:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039663033616431', 'path': '/dev/sdg'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:32:01 user nova-compute[72820]: DEBUG nova.objects.instance [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lazy-loading 'flavor' on Instance uuid 4becc265-4f3d-4f83-a9ac-c99100a870ff {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:32:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:32:01 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:32:01 user nova-compute[72820]:   <source dev="/dev/sdg"/>
Aug 27 02:32:01 user nova-compute[72820]:   <target dev="vdc" bus="virtio"/>
Aug 27 02:32:01 user nova-compute[72820]:   <serial>50591bcd-7dee-45b5-904f-4c9f26565eea</serial>
Aug 27 02:32:01 user nova-compute[72820]: </disk>
Aug 27 02:32:01 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:32:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:32:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:32:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:32:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] No VIF found with MAC fa:16:3e:ec:8f:95, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:32:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b8b9f43a-011a-412a-9b1d-32ad253dbc6f tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.450s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:03 user nova-compute[72820]: INFO nova.compute.manager [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Detaching volume 50591bcd-7dee-45b5-904f-4c9f26565eea
Aug 27 02:32:03 user nova-compute[72820]: INFO nova.virt.block_device [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Attempting to driver detach volume 50591bcd-7dee-45b5-904f-4c9f26565eea from mountpoint /dev/vdc
Aug 27 02:32:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Attempting to detach device vdc from instance 4becc265-4f3d-4f83-a9ac-c99100a870ff from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:32:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:32:03 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:32:03 user nova-compute[72820]:   <source dev="/dev/sdg"/>
Aug 27 02:32:03 user nova-compute[72820]:   <target dev="vdc" bus="virtio"/>
Aug 27 02:32:03 user nova-compute[72820]:   <serial>50591bcd-7dee-45b5-904f-4c9f26565eea</serial>
Aug 27 02:32:03 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 02:32:03 user nova-compute[72820]: </disk>
Aug 27 02:32:03 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:32:03 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Successfully detached device vdc from instance 4becc265-4f3d-4f83-a9ac-c99100a870ff from the persistent domain config.
Aug 27 02:32:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4becc265-4f3d-4f83-a9ac-c99100a870ff from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:32:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:32:03 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:32:03 user nova-compute[72820]:   <source dev="/dev/sdg"/>
Aug 27 02:32:03 user nova-compute[72820]:   <target dev="vdc" bus="virtio"/>
Aug 27 02:32:03 user nova-compute[72820]:   <serial>50591bcd-7dee-45b5-904f-4c9f26565eea</serial>
Aug 27 02:32:03 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 02:32:03 user nova-compute[72820]: </disk>
Aug 27 02:32:03 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:32:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693103523.9114146, 4becc265-4f3d-4f83-a9ac-c99100a870ff => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:32:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4becc265-4f3d-4f83-a9ac-c99100a870ff {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:32:03 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Successfully detached device vdc from instance 4becc265-4f3d-4f83-a9ac-c99100a870ff from the live domain config.
Aug 27 02:32:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:32:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLpZwXeg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:32:03 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:32:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:32:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:32:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:03 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f16263-af9b-42d0-b6d0-803ce36cbe9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:32:03 user nova-compute[72820]: No targets found.
Aug 27 02:32:03 user nova-compute[72820]: iSNS:
Aug 27 02:32:03 user nova-compute[72820]: No targets found.
Aug 27 02:32:03 user nova-compute[72820]: STATIC:
Aug 27 02:32:03 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea
Aug 27 02:32:03 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:32:03 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:32:03 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f
Aug 27 02:32:03 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:32:03 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:32:03 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37
Aug 27 02:32:03 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:32:03 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:32:03 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1
Aug 27 02:32:03 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:32:03 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:32:03 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:32:03 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:32:03 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:32:03 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf
Aug 27 02:32:03 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:32:03 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:32:03 user nova-compute[72820]: FIRMWARE:
Aug 27 02:32:03 user nova-compute[72820]: No targets found.
Aug 27 02:32:03 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:32:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:32:03 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:32:03 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:32:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:32:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:03 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5205f5-ea17-45f7-b759-5ca94fd7e548]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4702fe5f-064c-4809-b7c1-417f724884da]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:32:04 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:32:04 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:32:04 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:32:04 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:32:04 user nova-compute[72820]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea (non-flash)
Aug 27 02:32:04 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:32:04 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:32:04 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:32:04 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:32:04 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:32:04 user nova-compute[72820]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea (non-flash)
Aug 27 02:32:04 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75cd959cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea'): ({'sdg'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Removing single pathed devices sdg {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8939e8-7082-4199-bdca-f1c67fc2394a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9343a2-1518-45d0-8334-529a5d700ad3]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Flushing IO for device /dev/sdg {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed0b13d-b278-4d80-a02b-7070ba0c0395]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceacf39-68aa-4333-9132-7cd6b9b9e9f5]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] SCSI volumes sdg have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7db0af1-1982-4789-aa3f-102d299f033e]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a18050b-0d91-4ef5-87fa-bb5c810d735d]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea, portal: 172.16.0.220,3260]
Aug 27 02:32:04 user nova-compute[72820]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea, portal: 172.16.0.220,3260] successful.
Aug 27 02:32:04 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50591bcd-7dee-45b5-904f-4c9f26565eea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbbac2c-35f9-472d-a514-0fd5ed5c5a84]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] <== disconnect_volume: return (337ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:32:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:32:05 user nova-compute[72820]: DEBUG nova.objects.instance [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lazy-loading 'flavor' on Instance uuid 4becc265-4f3d-4f83-a9ac-c99100a870ff {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:32:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-98741677-493a-44e6-afcd-5e9a68b205c1 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.296s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:08 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:32:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:09 user nova-compute[72820]: INFO nova.compute.manager [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Terminating instance
Aug 27 02:32:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "85c8fa72-19be-49a0-975f-d6a0d30d011f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-68eec043-704f-4220-ae98-5b1092c148ba req-15d09105-519c-4e4b-b4fe-b559796e4edf service nova] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Received event network-vif-unplugged-95c4ddc9-d1c5-434a-b733-f59fdc71e748 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-68eec043-704f-4220-ae98-5b1092c148ba req-15d09105-519c-4e4b-b4fe-b559796e4edf service nova] Acquiring lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-68eec043-704f-4220-ae98-5b1092c148ba req-15d09105-519c-4e4b-b4fe-b559796e4edf service nova] Lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-68eec043-704f-4220-ae98-5b1092c148ba req-15d09105-519c-4e4b-b4fe-b559796e4edf service nova] Lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-68eec043-704f-4220-ae98-5b1092c148ba req-15d09105-519c-4e4b-b4fe-b559796e4edf service nova] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] No waiting events found dispatching network-vif-unplugged-95c4ddc9-d1c5-434a-b733-f59fdc71e748 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-68eec043-704f-4220-ae98-5b1092c148ba req-15d09105-519c-4e4b-b4fe-b559796e4edf service nova] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Received event network-vif-unplugged-95c4ddc9-d1c5-434a-b733-f59fdc71e748 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:32:10 user nova-compute[72820]: INFO nova.compute.claims [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Claim successful on node user
Aug 27 02:32:10 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Instance destroyed successfully.
Aug 27 02:32:10 user nova-compute[72820]: DEBUG nova.objects.instance [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lazy-loading 'resources' on Instance uuid 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1279829371',display_name='tempest-VolumesAdminNegativeTest-server-1279829371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1279829371',id=23,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:30:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ddd7d54478749cba3988913864379ed',ramdisk_id='',reservation_id='r-yvllix1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1861523875',owner_user_name='tempest-VolumesAdminNegativeTest-1861523875-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:30:12Z,user_data=None,user_id='76b3417256eb4ff7924db6912e97726c',uuid=3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "address": "fa:16:3e:e1:25:37", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c4ddc9-d1", "ovs_interfaceid": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Converting VIF {"id": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "address": "fa:16:3e:e1:25:37", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c4ddc9-d1", "ovs_interfaceid": "95c4ddc9-d1c5-434a-b733-f59fdc71e748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:37,bridge_name='br-int',has_traffic_filtering=True,id=95c4ddc9-d1c5-434a-b733-f59fdc71e748,network=Network(8741024c-a257-4a16-b983-d6ac4f6b5ad2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c4ddc9-d1') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG os_vif [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:37,bridge_name='br-int',has_traffic_filtering=True,id=95c4ddc9-d1c5-434a-b733-f59fdc71e748,network=Network(8741024c-a257-4a16-b983-d6ac4f6b5ad2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c4ddc9-d1') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95c4ddc9-d1, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:10 user nova-compute[72820]: INFO os_vif [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:37,bridge_name='br-int',has_traffic_filtering=True,id=95c4ddc9-d1c5-434a-b733-f59fdc71e748,network=Network(8741024c-a257-4a16-b983-d6ac4f6b5ad2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c4ddc9-d1')
Aug 27 02:32:10 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Deleting instance files /opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d_del
Aug 27 02:32:10 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Deletion of /opt/stack/data/nova/instances/3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d_del complete
Aug 27 02:32:10 user nova-compute[72820]: INFO nova.compute.manager [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 27 02:32:10 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:32:10 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:32:11 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:32:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:32:11 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Took 0.56 seconds to deallocate network for instance.
Aug 27 02:32:11 user nova-compute[72820]: INFO nova.virt.block_device [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Booting with volume 4265fa4c-ed31-4423-83e2-100c129caa8e at /dev/vda
Aug 27 02:32:11 user nova-compute[72820]: DEBUG nova.policy [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '275f713edfd042d4b4fa32620956484a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7797569db44f40f193483e6e6933a0d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG os_brick.utils [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a128fec6-e7d2-4073-be6b-20d67727cd89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc882ad-6ba7-42e1-afc9-d980c8261988]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb048db-a5e3-4dec-86aa-d8c67f9f4669]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe3b1ae-f37e-437d-b6af-06c69cc17ede]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:32:11 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:32:11 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9de26bc-2b74-4712-9e76-4f0765e28696]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG os_brick.utils [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Updating existing volume attachment record: 9dab3cc1-f882-4d4d-a09d-d013de0e3301 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:32:11 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.663s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:12 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Deleted allocations for instance 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d
Aug 27 02:32:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0032beba-3283-4d10-a9b6-01c85856adef tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.219s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Successfully created port: b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG nova.compute.manager [req-2e73a3d5-a2af-49f1-9543-01a5354f4c99 req-9735129d-0d06-4001-9025-73a320ad6fb2 service nova] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Received event network-vif-plugged-95c4ddc9-d1c5-434a-b733-f59fdc71e748 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2e73a3d5-a2af-49f1-9543-01a5354f4c99 req-9735129d-0d06-4001-9025-73a320ad6fb2 service nova] Acquiring lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2e73a3d5-a2af-49f1-9543-01a5354f4c99 req-9735129d-0d06-4001-9025-73a320ad6fb2 service nova] Lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2e73a3d5-a2af-49f1-9543-01a5354f4c99 req-9735129d-0d06-4001-9025-73a320ad6fb2 service nova] Lock "3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG nova.compute.manager [req-2e73a3d5-a2af-49f1-9543-01a5354f4c99 req-9735129d-0d06-4001-9025-73a320ad6fb2 service nova] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] No waiting events found dispatching network-vif-plugged-95c4ddc9-d1c5-434a-b733-f59fdc71e748 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:12 user nova-compute[72820]: WARNING nova.compute.manager [req-2e73a3d5-a2af-49f1-9543-01a5354f4c99 req-9735129d-0d06-4001-9025-73a320ad6fb2 service nova] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Received unexpected event network-vif-plugged-95c4ddc9-d1c5-434a-b733-f59fdc71e748 for instance with vm_state deleted and task_state None.
Aug 27 02:32:12 user nova-compute[72820]: DEBUG nova.compute.manager [req-2e73a3d5-a2af-49f1-9543-01a5354f4c99 req-9735129d-0d06-4001-9025-73a320ad6fb2 service nova] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Received event network-vif-deleted-95c4ddc9-d1c5-434a-b733-f59fdc71e748 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Successfully updated port: b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "refresh_cache-85c8fa72-19be-49a0-975f-d6a0d30d011f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquired lock "refresh_cache-85c8fa72-19be-49a0-975f-d6a0d30d011f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-273fdbfc-6862-43aa-9ac9-edf5b2ba347a req-9d9f0dad-a115-4880-8b54-0ed2ca8376e3 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received event network-changed-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-273fdbfc-6862-43aa-9ac9-edf5b2ba347a req-9d9f0dad-a115-4880-8b54-0ed2ca8376e3 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Refreshing instance network info cache due to event network-changed-b1cbacdf-27a3-48f2-8c08-e77c49f40d81. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-273fdbfc-6862-43aa-9ac9-edf5b2ba347a req-9d9f0dad-a115-4880-8b54-0ed2ca8376e3 service nova] Acquiring lock "refresh_cache-85c8fa72-19be-49a0-975f-d6a0d30d011f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Updating instance_info_cache with network_info: [{"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Releasing lock "refresh_cache-85c8fa72-19be-49a0-975f-d6a0d30d011f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Instance network_info: |[{"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-273fdbfc-6862-43aa-9ac9-edf5b2ba347a req-9d9f0dad-a115-4880-8b54-0ed2ca8376e3 service nova] Acquired lock "refresh_cache-85c8fa72-19be-49a0-975f-d6a0d30d011f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG nova.network.neutron [req-273fdbfc-6862-43aa-9ac9-edf5b2ba347a req-9d9f0dad-a115-4880-8b54-0ed2ca8376e3 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Refreshing network info cache for port b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:14 user nova-compute[72820]: DEBUG nova.network.neutron [req-273fdbfc-6862-43aa-9ac9-edf5b2ba347a req-9d9f0dad-a115-4880-8b54-0ed2ca8376e3 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Updated VIF entry in instance network info cache for port b1cbacdf-27a3-48f2-8c08-e77c49f40d81. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:32:14 user nova-compute[72820]: DEBUG nova.network.neutron [req-273fdbfc-6862-43aa-9ac9-edf5b2ba347a req-9d9f0dad-a115-4880-8b54-0ed2ca8376e3 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Updating instance_info_cache with network_info: [{"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:32:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-273fdbfc-6862-43aa-9ac9-edf5b2ba347a req-9d9f0dad-a115-4880-8b54-0ed2ca8376e3 service nova] Releasing lock "refresh_cache-85c8fa72-19be-49a0-975f-d6a0d30d011f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:32:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:32:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:32:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:17 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:32:17 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7089MB free_disk=25.144535064697266GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Applying migration context for instance ac2f6797-8b7c-47d3-836d-fc1c617e23dd as it has an incoming, in-progress migration ebf31c8f-7d9d-46e1-b1f4-4247c14bf8a1. Migration status is finished {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 02:32:17 user nova-compute[72820]: INFO nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Updating resource usage from migration ebf31c8f-7d9d-46e1-b1f4-4247c14bf8a1
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 26581695-c4b9-40b8-ab7a-34c99db0dadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f8f612f3-41c9-4dae-8d49-218d61720b15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 050e0c2b-9244-4987-b07d-e4712e46f936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1591319d-3d15-4c46-b823-4edddf018b5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 7c42c4ae-0f80-4295-a64e-b426225b94c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 89b66e95-2333-403b-b338-6096717ca20d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 4becc265-4f3d-4f83-a9ac-c99100a870ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Migration ebf31c8f-7d9d-46e1-b1f4-4247c14bf8a1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance ac2f6797-8b7c-47d3-836d-fc1c617e23dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance a67eea06-dabf-4115-9650-ea4098f80bd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 94323d83-f8fe-4814-82af-f860a20071bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 85c8fa72-19be-49a0-975f-d6a0d30d011f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:32:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:19 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:32:19 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:32:19 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:32:19 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:32:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:32:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:32:20 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:32:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:20 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Updating instance_info_cache with network_info: [{"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:32:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:32:20 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:32:20 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:32:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:32:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:21 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:32:21 user nova-compute[72820]: INFO nova.compute.claims [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Claim successful on node user
Aug 27 02:32:21 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:32:21 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:32:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:32:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:32:21 user nova-compute[72820]: DEBUG nova.network.neutron [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:32:21 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:32:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG nova.policy [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e58dd305ae442ca84ae955894e7a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4abfae6cab24fef92f96422628dc7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:32:22 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Creating image(s)
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "/opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "/opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.185s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk 1073741824" returned: 0 in 0.056s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.171s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Cannot resize image /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Ensure instance console log exists: /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:32:23 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Creating image(s)
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Did not create local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Ensure instance console log exists: /opt/stack/data/nova/instances/85c8fa72-19be-49a0-975f-d6a0d30d011f/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Start _get_guest_xml network_info=[{"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9dab3cc1-f882-4d4d-a09d-d013de0e3301', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bWCZxFLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '85c8fa72-19be-49a0-975f-d6a0d30d011f', 'attached_at': '', 'detached_at': '', 'volume_id': '4265fa4c-ed31-4423-83e2-100c129caa8e', 'serial': '4265fa4c-ed31-4423-83e2-100c129caa8e'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:32:23 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:32:23 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bWCZxFLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:32:23 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:32:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:32:23 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:32:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:32:23 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:32:23 user nova-compute[72820]: DEBUG nova.network.neutron [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Successfully created port: af8b1ee6-b3bb-4e30-b36d-3be720fa1130 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f63aca5-53fe-4a03-b76e-2eae190b65e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:32:23 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c93711d-4516-4d69-a9fe-ee7742ac665d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e] added
Aug 27 02:32:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[682eca0f-afb5-453d-9e83-45d5658dacef]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a619d4e-0d35-4a5b-993a-5f6453667f01]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bWCZxFLy {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bWCZxFLy" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0125a4-f593-4e9f-8171-852ff18a945c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bWCZxFLy'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8aa6c22-70df-45c8-a0ee-86713ed6968d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a41764-5aa1-4689-9a2b-309a6510a951]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:32:23 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:32:23 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:32:23 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:32:23 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:32:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:32:23 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:32:23 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:32:23 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:32:23 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:32:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:32:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3776c8b-4cf2-46cb-9061-b4e2d505d7ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e, portal: 172.16.0.220,3260]
Aug 27 02:32:24 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e, portal: 172.16.0.220,3260] successful.
Aug 27 02:32:24 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[64363d01-1f3f-43ad-a767-90384853df9b]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b51e8c-61cb-4142-ac9d-2a68ae4c0b21]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:32:24 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:32:24 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:32:24 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:32:24 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:32:24 user nova-compute[72820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:32:24 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:32:24 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:32:24 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:32:24 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:32:24 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:32:24 user nova-compute[72820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:32:24 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4424ce34-7407-4f1f-9b08-55e28e3ece51]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: None {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:32:24 user nova-compute[72820]: INFO nova.compute.claims [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Claim successful on node user
Aug 27 02:32:24 user nova-compute[72820]: DEBUG nova.network.neutron [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Successfully updated port: af8b1ee6-b3bb-4e30-b36d-3be720fa1130 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "refresh_cache-6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquired lock "refresh_cache-6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG nova.network.neutron [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-972382d6-c05a-4080-b5ad-d5b44734bf4f req-984b76aa-25cd-4ec2-b887-9514ef0fc92c service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Received event network-changed-af8b1ee6-b3bb-4e30-b36d-3be720fa1130 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-972382d6-c05a-4080-b5ad-d5b44734bf4f req-984b76aa-25cd-4ec2-b887-9514ef0fc92c service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Refreshing instance network info cache due to event network-changed-af8b1ee6-b3bb-4e30-b36d-3be720fa1130. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-972382d6-c05a-4080-b5ad-d5b44734bf4f req-984b76aa-25cd-4ec2-b887-9514ef0fc92c service nova] Acquiring lock "refresh_cache-6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG nova.network.neutron [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:32:24 user nova-compute[72820]: DEBUG nova.network.neutron [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:32:24 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:32:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.policy [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb67e11ecdd648a89dd58b4bf416060a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f023daf1767f4088bf0a23524587e662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:32:25 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Creating image(s)
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "/opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "/opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "/opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.network.neutron [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Updating instance_info_cache with network_info: [{"id": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "address": "fa:16:3e:a4:f0:b7", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b1ee6-b3", "ovs_interfaceid": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Releasing lock "refresh_cache-6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Instance network_info: |[{"id": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "address": "fa:16:3e:a4:f0:b7", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b1ee6-b3", "ovs_interfaceid": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-972382d6-c05a-4080-b5ad-d5b44734bf4f req-984b76aa-25cd-4ec2-b887-9514ef0fc92c service nova] Acquired lock "refresh_cache-6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.network.neutron [req-972382d6-c05a-4080-b5ad-d5b44734bf4f req-984b76aa-25cd-4ec2-b887-9514ef0fc92c service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Refreshing network info cache for port af8b1ee6-b3bb-4e30-b36d-3be720fa1130 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Start _get_guest_xml network_info=[{"id": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "address": "fa:16:3e:a4:f0:b7", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b1ee6-b3", "ovs_interfaceid": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bWCZxFLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23633316263366132', 'path': '/dev/sdg'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633316263366132', 'path': '/dev/sdg'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:32:25 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:32:25 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-667076212',display_name='tempest-VolumesSnapshotTestJSON-instance-667076212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-667076212',id=26,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVRVlzhEhZcnfaxsrApGIaHxPts9faYqCHhtzUdmX6E5D9toQXkqxh+fsrtmZE0MZ6DUJJTA3ZtMyxebwTTsvdC+Ud5yvWO0ZlLKgEMfIWStwbT5D4wYqueeQaTPPGSCw==',key_name='tempest-keypair-599864003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4abfae6cab24fef92f96422628dc7e6',ramdisk_id='',reservation_id='r-k9tfhbfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-941703694',owner_user_name='tempest-VolumesSnapshotTestJSON-941703694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e58dd305ae442ca84ae955894e7a074',uuid=6a9299e0-d1dc-4cf7-948b-35d1ef6d6310,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "address": "fa:16:3e:a4:f0:b7", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b1ee6-b3", "ovs_interfaceid": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Converting VIF {"id": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "address": "fa:16:3e:a4:f0:b7", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b1ee6-b3", "ovs_interfaceid": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:f0:b7,bridge_name='br-int',has_traffic_filtering=True,id=af8b1ee6-b3bb-4e30-b36d-3be720fa1130,network=Network(35f784f8-b045-4a19-a8e6-bbf5b06bdaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8b1ee6-b3') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.objects.instance [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-831814397',display_name='tempest-ServerActionsTestOtherA-server-831814397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-831814397',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuMDNJccFoG9J2MvjXPhebjkkaCvYt2BV0fWoVRWE0WGnLVqeM0TmypkIBpwP+aIP0dc17AS8ytt0zxz7hB47f2I8lo+2akMvc3UtIkl7mLDLkN7AXVg520jT6ETK7MXw==',key_name='tempest-keypair-1957607282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7797569db44f40f193483e6e6933a0d0',ramdisk_id='',reservation_id='r-ggl9724x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-892102693',owner_user_name='tempest-ServerActionsTestOtherA-892102693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:32:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='275f713edfd042d4b4fa32620956484a',uuid=85c8fa72-19be-49a0-975f-d6a0d30d011f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converting VIF {"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:bd:22,bridge_name='br-int',has_traffic_filtering=True,id=b1cbacdf-27a3-48f2-8c08-e77c49f40d81,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cbacdf-27') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.objects.instance [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lazy-loading 'pci_devices' on Instance uuid 85c8fa72-19be-49a0-975f-d6a0d30d011f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:32:25 user nova-compute[72820]:   <uuid>6a9299e0-d1dc-4cf7-948b-35d1ef6d6310</uuid>
Aug 27 02:32:25 user nova-compute[72820]:   <name>instance-0000001a</name>
Aug 27 02:32:25 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:32:25 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:32:25 user nova-compute[72820]:   <metadata>
Aug 27 02:32:25 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:32:25 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:32:25 user nova-compute[72820]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-667076212</nova:name>
Aug 27 02:32:25 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:32:25</nova:creationTime>
Aug 27 02:32:25 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:32:25 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:32:25 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:32:25 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:32:25 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:32:25 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:32:25 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:32:25 user nova-compute[72820]:       <nova:owner>
Aug 27 02:32:25 user nova-compute[72820]:         <nova:user uuid="3e58dd305ae442ca84ae955894e7a074">tempest-VolumesSnapshotTestJSON-941703694-project-member</nova:user>
Aug 27 02:32:25 user nova-compute[72820]:         <nova:project uuid="e4abfae6cab24fef92f96422628dc7e6">tempest-VolumesSnapshotTestJSON-941703694</nova:project>
Aug 27 02:32:25 user nova-compute[72820]:       </nova:owner>
Aug 27 02:32:25 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:32:25 user nova-compute[72820]:       <nova:ports>
Aug 27 02:32:25 user nova-compute[72820]:         <nova:port uuid="af8b1ee6-b3bb-4e30-b36d-3be720fa1130">
Aug 27 02:32:25 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 02:32:25 user nova-compute[72820]:         </nova:port>
Aug 27 02:32:25 user nova-compute[72820]:       </nova:ports>
Aug 27 02:32:25 user nova-compute[72820]:     </nova:instance>
Aug 27 02:32:25 user nova-compute[72820]:   </metadata>
Aug 27 02:32:25 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:32:25 user nova-compute[72820]:     <system>
Aug 27 02:32:25 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:32:25 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:32:25 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:32:25 user nova-compute[72820]:       <entry name="serial">6a9299e0-d1dc-4cf7-948b-35d1ef6d6310</entry>
Aug 27 02:32:25 user nova-compute[72820]:       <entry name="uuid">6a9299e0-d1dc-4cf7-948b-35d1ef6d6310</entry>
Aug 27 02:32:25 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:32:25 user nova-compute[72820]:     </system>
Aug 27 02:32:25 user nova-compute[72820]:   </sysinfo>
Aug 27 02:32:25 user nova-compute[72820]:   <os>
Aug 27 02:32:25 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:32:25 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:32:25 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:32:25 user nova-compute[72820]:   </os>
Aug 27 02:32:25 user nova-compute[72820]:   <features>
Aug 27 02:32:25 user nova-compute[72820]:     <acpi/>
Aug 27 02:32:25 user nova-compute[72820]:     <apic/>
Aug 27 02:32:25 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:32:25 user nova-compute[72820]:   </features>
Aug 27 02:32:25 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:32:25 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:32:25 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:32:25 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:32:25 user nova-compute[72820]:   </clock>
Aug 27 02:32:25 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:32:25 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:32:25 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:32:25 user nova-compute[72820]:   </cpu>
Aug 27 02:32:25 user nova-compute[72820]:   <devices>
Aug 27 02:32:25 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:32:25 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:32:25 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk"/>
Aug 27 02:32:25 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:32:25 user nova-compute[72820]:     </disk>
Aug 27 02:32:25 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:32:25 user nova-compute[72820]:       <mac address="fa:16:3e:a4:f0:b7"/>
Aug 27 02:32:25 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:32:25 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:32:25 user nova-compute[72820]:       <target dev="tapaf8b1ee6-b3"/>
Aug 27 02:32:25 user nova-compute[72820]:     </interface>
Aug 27 02:32:25 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:32:25 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/console.log" append="off"/>
Aug 27 02:32:25 user nova-compute[72820]:     </serial>
Aug 27 02:32:25 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:32:25 user nova-compute[72820]:     <video>
Aug 27 02:32:25 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:32:25 user nova-compute[72820]:     </video>
Aug 27 02:32:25 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:32:25 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:32:25 user nova-compute[72820]:     </rng>
Aug 27 02:32:25 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:32:25 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:32:25 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:32:25 user nova-compute[72820]:     </memballoon>
Aug 27 02:32:25 user nova-compute[72820]:   </devices>
Aug 27 02:32:25 user nova-compute[72820]: </domain>
Aug 27 02:32:25 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-667076212',display_name='tempest-VolumesSnapshotTestJSON-instance-667076212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-667076212',id=26,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVRVlzhEhZcnfaxsrApGIaHxPts9faYqCHhtzUdmX6E5D9toQXkqxh+fsrtmZE0MZ6DUJJTA3ZtMyxebwTTsvdC+Ud5yvWO0ZlLKgEMfIWStwbT5D4wYqueeQaTPPGSCw==',key_name='tempest-keypair-599864003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4abfae6cab24fef92f96422628dc7e6',ramdisk_id='',reservation_id='r-k9tfhbfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-941703694',owner_user_name='tempest-VolumesSnapshotTestJSON-941703694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e58dd305ae442ca84ae955894e7a074',uuid=6a9299e0-d1dc-4cf7-948b-35d1ef6d6310,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "address": "fa:16:3e:a4:f0:b7", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b1ee6-b3", "ovs_interfaceid": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Converting VIF {"id": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "address": "fa:16:3e:a4:f0:b7", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b1ee6-b3", "ovs_interfaceid": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:f0:b7,bridge_name='br-int',has_traffic_filtering=True,id=af8b1ee6-b3bb-4e30-b36d-3be720fa1130,network=Network(35f784f8-b045-4a19-a8e6-bbf5b06bdaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8b1ee6-b3') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG os_vif [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:f0:b7,bridge_name='br-int',has_traffic_filtering=True,id=af8b1ee6-b3bb-4e30-b36d-3be720fa1130,network=Network(35f784f8-b045-4a19-a8e6-bbf5b06bdaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8b1ee6-b3') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:32:25 user nova-compute[72820]:   <uuid>85c8fa72-19be-49a0-975f-d6a0d30d011f</uuid>
Aug 27 02:32:25 user nova-compute[72820]:   <name>instance-00000019</name>
Aug 27 02:32:25 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:32:25 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:32:25 user nova-compute[72820]:   <metadata>
Aug 27 02:32:25 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:32:25 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:32:25 user nova-compute[72820]:       <nova:name>tempest-ServerActionsTestOtherA-server-831814397</nova:name>
Aug 27 02:32:25 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:32:23</nova:creationTime>
Aug 27 02:32:25 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:32:25 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:32:25 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:32:25 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:32:25 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:32:25 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:32:25 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:32:25 user nova-compute[72820]:       <nova:owner>
Aug 27 02:32:25 user nova-compute[72820]:         <nova:user uuid="275f713edfd042d4b4fa32620956484a">tempest-ServerActionsTestOtherA-892102693-project-member</nova:user>
Aug 27 02:32:25 user nova-compute[72820]:         <nova:project uuid="7797569db44f40f193483e6e6933a0d0">tempest-ServerActionsTestOtherA-892102693</nova:project>
Aug 27 02:32:25 user nova-compute[72820]:       </nova:owner>
Aug 27 02:32:25 user nova-compute[72820]:       <nova:ports>
Aug 27 02:32:25 user nova-compute[72820]:         <nova:port uuid="b1cbacdf-27a3-48f2-8c08-e77c49f40d81">
Aug 27 02:32:25 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 02:32:25 user nova-compute[72820]:         </nova:port>
Aug 27 02:32:25 user nova-compute[72820]:       </nova:ports>
Aug 27 02:32:25 user nova-compute[72820]:     </nova:instance>
Aug 27 02:32:25 user nova-compute[72820]:   </metadata>
Aug 27 02:32:25 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:32:25 user nova-compute[72820]:     <system>
Aug 27 02:32:25 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:32:25 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:32:25 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:32:25 user nova-compute[72820]:       <entry name="serial">85c8fa72-19be-49a0-975f-d6a0d30d011f</entry>
Aug 27 02:32:25 user nova-compute[72820]:       <entry name="uuid">85c8fa72-19be-49a0-975f-d6a0d30d011f</entry>
Aug 27 02:32:25 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:32:25 user nova-compute[72820]:     </system>
Aug 27 02:32:25 user nova-compute[72820]:   </sysinfo>
Aug 27 02:32:25 user nova-compute[72820]:   <os>
Aug 27 02:32:25 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:32:25 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:32:25 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:32:25 user nova-compute[72820]:   </os>
Aug 27 02:32:25 user nova-compute[72820]:   <features>
Aug 27 02:32:25 user nova-compute[72820]:     <acpi/>
Aug 27 02:32:25 user nova-compute[72820]:     <apic/>
Aug 27 02:32:25 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:32:25 user nova-compute[72820]:   </features>
Aug 27 02:32:25 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:32:25 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:32:25 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:32:25 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:32:25 user nova-compute[72820]:   </clock>
Aug 27 02:32:25 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:32:25 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:32:25 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:32:25 user nova-compute[72820]:   </cpu>
Aug 27 02:32:25 user nova-compute[72820]:   <devices>
Aug 27 02:32:25 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:32:25 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:32:25 user nova-compute[72820]:       <source dev="/dev/sdg"/>
Aug 27 02:32:25 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:32:25 user nova-compute[72820]:       <serial>4265fa4c-ed31-4423-83e2-100c129caa8e</serial>
Aug 27 02:32:25 user nova-compute[72820]:     </disk>
Aug 27 02:32:25 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:32:25 user nova-compute[72820]:       <mac address="fa:16:3e:52:bd:22"/>
Aug 27 02:32:25 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:32:25 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:32:25 user nova-compute[72820]:       <target dev="tapb1cbacdf-27"/>
Aug 27 02:32:25 user nova-compute[72820]:     </interface>
Aug 27 02:32:25 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:32:25 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/85c8fa72-19be-49a0-975f-d6a0d30d011f/console.log" append="off"/>
Aug 27 02:32:25 user nova-compute[72820]:     </serial>
Aug 27 02:32:25 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:32:25 user nova-compute[72820]:     <video>
Aug 27 02:32:25 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:32:25 user nova-compute[72820]:     </video>
Aug 27 02:32:25 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:32:25 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:32:25 user nova-compute[72820]:     </rng>
Aug 27 02:32:25 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:32:25 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:32:25 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:32:25 user nova-compute[72820]:     </memballoon>
Aug 27 02:32:25 user nova-compute[72820]:   </devices>
Aug 27 02:32:25 user nova-compute[72820]: </domain>
Aug 27 02:32:25 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-831814397',display_name='tempest-ServerActionsTestOtherA-server-831814397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-831814397',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuMDNJccFoG9J2MvjXPhebjkkaCvYt2BV0fWoVRWE0WGnLVqeM0TmypkIBpwP+aIP0dc17AS8ytt0zxz7hB47f2I8lo+2akMvc3UtIkl7mLDLkN7AXVg520jT6ETK7MXw==',key_name='tempest-keypair-1957607282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7797569db44f40f193483e6e6933a0d0',ramdisk_id='',reservation_id='r-ggl9724x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-892102693',owner_user_name='tempest-ServerActionsTestOtherA-892102693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:32:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='275f713edfd042d4b4fa32620956484a',uuid=85c8fa72-19be-49a0-975f-d6a0d30d011f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converting VIF {"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:bd:22,bridge_name='br-int',has_traffic_filtering=True,id=b1cbacdf-27a3-48f2-8c08-e77c49f40d81,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cbacdf-27') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG os_vif [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:bd:22,bridge_name='br-int',has_traffic_filtering=True,id=b1cbacdf-27a3-48f2-8c08-e77c49f40d81,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cbacdf-27') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf8b1ee6-b3, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf8b1ee6-b3, col_values=(('external_ids', {'iface-id': 'af8b1ee6-b3bb-4e30-b36d-3be720fa1130', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:f0:b7', 'vm-uuid': '6a9299e0-d1dc-4cf7-948b-35d1ef6d6310'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:25 user nova-compute[72820]: INFO os_vif [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:f0:b7,bridge_name='br-int',has_traffic_filtering=True,id=af8b1ee6-b3bb-4e30-b36d-3be720fa1130,network=Network(35f784f8-b045-4a19-a8e6-bbf5b06bdaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8b1ee6-b3')
Aug 27 02:32:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1cbacdf-27, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1cbacdf-27, col_values=(('external_ids', {'iface-id': 'b1cbacdf-27a3-48f2-8c08-e77c49f40d81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:bd:22', 'vm-uuid': '85c8fa72-19be-49a0-975f-d6a0d30d011f'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.191s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:25 user nova-compute[72820]: INFO os_vif [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:bd:22,bridge_name='br-int',has_traffic_filtering=True,id=b1cbacdf-27a3-48f2-8c08-e77c49f40d81,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cbacdf-27')
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] No VIF found with MAC fa:16:3e:a4:f0:b7, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] No VIF found with MAC fa:16:3e:52:bd:22, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.200s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103530.513136, 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:32:25 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] VM Stopped (Lifecycle Event)
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk 1073741824" returned: 0 in 0.065s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7bf96e73-073f-478f-adb2-c3f413dcda03 None None] [instance: 3aebe6d7-9dc8-45a0-9f48-5ce4084cd12d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.network.neutron [req-972382d6-c05a-4080-b5ad-d5b44734bf4f req-984b76aa-25cd-4ec2-b887-9514ef0fc92c service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Updated VIF entry in instance network info cache for port af8b1ee6-b3bb-4e30-b36d-3be720fa1130. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.network.neutron [req-972382d6-c05a-4080-b5ad-d5b44734bf4f req-984b76aa-25cd-4ec2-b887-9514ef0fc92c service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Updating instance_info_cache with network_info: [{"id": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "address": "fa:16:3e:a4:f0:b7", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b1ee6-b3", "ovs_interfaceid": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.184s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-972382d6-c05a-4080-b5ad-d5b44734bf4f req-984b76aa-25cd-4ec2-b887-9514ef0fc92c service nova] Releasing lock "refresh_cache-6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.network.neutron [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Successfully created port: 91420809-21b7-4f29-8db7-389b1fd06f7b {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Cannot resize image /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Ensure instance console log exists: /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.network.neutron [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Successfully updated port: 91420809-21b7-4f29-8db7-389b1fd06f7b {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "refresh_cache-15a1062a-ecfb-42b7-b8e5-03adbd6b8056" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquired lock "refresh_cache-15a1062a-ecfb-42b7-b8e5-03adbd6b8056" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.network.neutron [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.compute.manager [req-4b9b9e0a-062d-4891-ab04-ecf3f577f170 req-03da5c6c-899c-43f4-bc38-a5e7cefe97d0 service nova] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Received event network-changed-91420809-21b7-4f29-8db7-389b1fd06f7b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.compute.manager [req-4b9b9e0a-062d-4891-ab04-ecf3f577f170 req-03da5c6c-899c-43f4-bc38-a5e7cefe97d0 service nova] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Refreshing instance network info cache due to event network-changed-91420809-21b7-4f29-8db7-389b1fd06f7b. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4b9b9e0a-062d-4891-ab04-ecf3f577f170 req-03da5c6c-899c-43f4-bc38-a5e7cefe97d0 service nova] Acquiring lock "refresh_cache-15a1062a-ecfb-42b7-b8e5-03adbd6b8056" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.network.neutron [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.network.neutron [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Updating instance_info_cache with network_info: [{"id": "91420809-21b7-4f29-8db7-389b1fd06f7b", "address": "fa:16:3e:13:aa:0b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91420809-21", "ovs_interfaceid": "91420809-21b7-4f29-8db7-389b1fd06f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Releasing lock "refresh_cache-15a1062a-ecfb-42b7-b8e5-03adbd6b8056" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Instance network_info: |[{"id": "91420809-21b7-4f29-8db7-389b1fd06f7b", "address": "fa:16:3e:13:aa:0b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91420809-21", "ovs_interfaceid": "91420809-21b7-4f29-8db7-389b1fd06f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4b9b9e0a-062d-4891-ab04-ecf3f577f170 req-03da5c6c-899c-43f4-bc38-a5e7cefe97d0 service nova] Acquired lock "refresh_cache-15a1062a-ecfb-42b7-b8e5-03adbd6b8056" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.network.neutron [req-4b9b9e0a-062d-4891-ab04-ecf3f577f170 req-03da5c6c-899c-43f4-bc38-a5e7cefe97d0 service nova] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Refreshing network info cache for port 91420809-21b7-4f29-8db7-389b1fd06f7b {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Start _get_guest_xml network_info=[{"id": "91420809-21b7-4f29-8db7-389b1fd06f7b", "address": "fa:16:3e:13:aa:0b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91420809-21", "ovs_interfaceid": "91420809-21b7-4f29-8db7-389b1fd06f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:32:26 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:32:26 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:32:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:32:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-126401999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-126401999',id=27,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f023daf1767f4088bf0a23524587e662',ramdisk_id='',reservation_id='r-5xg29lxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:32:25Z,user_data=None,user_id='bb67e11ecdd648a89dd58b4bf416060a',uuid=15a1062a-ecfb-42b7-b8e5-03adbd6b8056,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91420809-21b7-4f29-8db7-389b1fd06f7b", "address": "fa:16:3e:13:aa:0b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91420809-21", "ovs_interfaceid": "91420809-21b7-4f29-8db7-389b1fd06f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converting VIF {"id": "91420809-21b7-4f29-8db7-389b1fd06f7b", "address": "fa:16:3e:13:aa:0b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91420809-21", "ovs_interfaceid": "91420809-21b7-4f29-8db7-389b1fd06f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:aa:0b,bridge_name='br-int',has_traffic_filtering=True,id=91420809-21b7-4f29-8db7-389b1fd06f7b,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91420809-21') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG nova.objects.instance [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'pci_devices' on Instance uuid 15a1062a-ecfb-42b7-b8e5-03adbd6b8056 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:32:27 user nova-compute[72820]:   <uuid>15a1062a-ecfb-42b7-b8e5-03adbd6b8056</uuid>
Aug 27 02:32:27 user nova-compute[72820]:   <name>instance-0000001b</name>
Aug 27 02:32:27 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:32:27 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:32:27 user nova-compute[72820]:   <metadata>
Aug 27 02:32:27 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:32:27 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:32:27 user nova-compute[72820]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-126401999</nova:name>
Aug 27 02:32:27 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:32:26</nova:creationTime>
Aug 27 02:32:27 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:32:27 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:32:27 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:32:27 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:32:27 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:32:27 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:32:27 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:32:27 user nova-compute[72820]:       <nova:owner>
Aug 27 02:32:27 user nova-compute[72820]:         <nova:user uuid="bb67e11ecdd648a89dd58b4bf416060a">tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member</nova:user>
Aug 27 02:32:27 user nova-compute[72820]:         <nova:project uuid="f023daf1767f4088bf0a23524587e662">tempest-ServerBootFromVolumeStableRescueTest-2088708325</nova:project>
Aug 27 02:32:27 user nova-compute[72820]:       </nova:owner>
Aug 27 02:32:27 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:32:27 user nova-compute[72820]:       <nova:ports>
Aug 27 02:32:27 user nova-compute[72820]:         <nova:port uuid="91420809-21b7-4f29-8db7-389b1fd06f7b">
Aug 27 02:32:27 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 02:32:27 user nova-compute[72820]:         </nova:port>
Aug 27 02:32:27 user nova-compute[72820]:       </nova:ports>
Aug 27 02:32:27 user nova-compute[72820]:     </nova:instance>
Aug 27 02:32:27 user nova-compute[72820]:   </metadata>
Aug 27 02:32:27 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:32:27 user nova-compute[72820]:     <system>
Aug 27 02:32:27 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:32:27 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:32:27 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:32:27 user nova-compute[72820]:       <entry name="serial">15a1062a-ecfb-42b7-b8e5-03adbd6b8056</entry>
Aug 27 02:32:27 user nova-compute[72820]:       <entry name="uuid">15a1062a-ecfb-42b7-b8e5-03adbd6b8056</entry>
Aug 27 02:32:27 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:32:27 user nova-compute[72820]:     </system>
Aug 27 02:32:27 user nova-compute[72820]:   </sysinfo>
Aug 27 02:32:27 user nova-compute[72820]:   <os>
Aug 27 02:32:27 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:32:27 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:32:27 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:32:27 user nova-compute[72820]:   </os>
Aug 27 02:32:27 user nova-compute[72820]:   <features>
Aug 27 02:32:27 user nova-compute[72820]:     <acpi/>
Aug 27 02:32:27 user nova-compute[72820]:     <apic/>
Aug 27 02:32:27 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:32:27 user nova-compute[72820]:   </features>
Aug 27 02:32:27 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:32:27 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:32:27 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:32:27 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:32:27 user nova-compute[72820]:   </clock>
Aug 27 02:32:27 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:32:27 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:32:27 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:32:27 user nova-compute[72820]:   </cpu>
Aug 27 02:32:27 user nova-compute[72820]:   <devices>
Aug 27 02:32:27 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:32:27 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:32:27 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk"/>
Aug 27 02:32:27 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:32:27 user nova-compute[72820]:     </disk>
Aug 27 02:32:27 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:32:27 user nova-compute[72820]:       <mac address="fa:16:3e:13:aa:0b"/>
Aug 27 02:32:27 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:32:27 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:32:27 user nova-compute[72820]:       <target dev="tap91420809-21"/>
Aug 27 02:32:27 user nova-compute[72820]:     </interface>
Aug 27 02:32:27 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:32:27 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/console.log" append="off"/>
Aug 27 02:32:27 user nova-compute[72820]:     </serial>
Aug 27 02:32:27 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:32:27 user nova-compute[72820]:     <video>
Aug 27 02:32:27 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:32:27 user nova-compute[72820]:     </video>
Aug 27 02:32:27 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:32:27 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:32:27 user nova-compute[72820]:     </rng>
Aug 27 02:32:27 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:32:27 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:32:27 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:32:27 user nova-compute[72820]:     </memballoon>
Aug 27 02:32:27 user nova-compute[72820]:   </devices>
Aug 27 02:32:27 user nova-compute[72820]: </domain>
Aug 27 02:32:27 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:32:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-126401999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-126401999',id=27,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f023daf1767f4088bf0a23524587e662',ramdisk_id='',reservation_id='r-5xg29lxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:32:25Z,user_data=None,user_id='bb67e11ecdd648a89dd58b4bf416060a',uuid=15a1062a-ecfb-42b7-b8e5-03adbd6b8056,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91420809-21b7-4f29-8db7-389b1fd06f7b", "address": "fa:16:3e:13:aa:0b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91420809-21", "ovs_interfaceid": "91420809-21b7-4f29-8db7-389b1fd06f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converting VIF {"id": "91420809-21b7-4f29-8db7-389b1fd06f7b", "address": "fa:16:3e:13:aa:0b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91420809-21", "ovs_interfaceid": "91420809-21b7-4f29-8db7-389b1fd06f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:aa:0b,bridge_name='br-int',has_traffic_filtering=True,id=91420809-21b7-4f29-8db7-389b1fd06f7b,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91420809-21') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG os_vif [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:aa:0b,bridge_name='br-int',has_traffic_filtering=True,id=91420809-21b7-4f29-8db7-389b1fd06f7b,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91420809-21') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91420809-21, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91420809-21, col_values=(('external_ids', {'iface-id': '91420809-21b7-4f29-8db7-389b1fd06f7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:aa:0b', 'vm-uuid': '15a1062a-ecfb-42b7-b8e5-03adbd6b8056'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:27 user nova-compute[72820]: INFO os_vif [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:aa:0b,bridge_name='br-int',has_traffic_filtering=True,id=91420809-21b7-4f29-8db7-389b1fd06f7b,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91420809-21')
Aug 27 02:32:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] No VIF found with MAC fa:16:3e:13:aa:0b, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG nova.network.neutron [req-4b9b9e0a-062d-4891-ab04-ecf3f577f170 req-03da5c6c-899c-43f4-bc38-a5e7cefe97d0 service nova] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Updated VIF entry in instance network info cache for port 91420809-21b7-4f29-8db7-389b1fd06f7b. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG nova.network.neutron [req-4b9b9e0a-062d-4891-ab04-ecf3f577f170 req-03da5c6c-899c-43f4-bc38-a5e7cefe97d0 service nova] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Updating instance_info_cache with network_info: [{"id": "91420809-21b7-4f29-8db7-389b1fd06f7b", "address": "fa:16:3e:13:aa:0b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91420809-21", "ovs_interfaceid": "91420809-21b7-4f29-8db7-389b1fd06f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:32:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4b9b9e0a-062d-4891-ab04-ecf3f577f170 req-03da5c6c-899c-43f4-bc38-a5e7cefe97d0 service nova] Releasing lock "refresh_cache-15a1062a-ecfb-42b7-b8e5-03adbd6b8056" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:32:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:28 user nova-compute[72820]: DEBUG nova.compute.manager [req-8063917f-4ad3-46ae-89ce-faf0dcba720d req-c59bde1a-03ed-41ae-a5c2-2431b8986a6d service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Received event network-vif-plugged-af8b1ee6-b3bb-4e30-b36d-3be720fa1130 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8063917f-4ad3-46ae-89ce-faf0dcba720d req-c59bde1a-03ed-41ae-a5c2-2431b8986a6d service nova] Acquiring lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8063917f-4ad3-46ae-89ce-faf0dcba720d req-c59bde1a-03ed-41ae-a5c2-2431b8986a6d service nova] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8063917f-4ad3-46ae-89ce-faf0dcba720d req-c59bde1a-03ed-41ae-a5c2-2431b8986a6d service nova] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:28 user nova-compute[72820]: DEBUG nova.compute.manager [req-8063917f-4ad3-46ae-89ce-faf0dcba720d req-c59bde1a-03ed-41ae-a5c2-2431b8986a6d service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] No waiting events found dispatching network-vif-plugged-af8b1ee6-b3bb-4e30-b36d-3be720fa1130 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:28 user nova-compute[72820]: WARNING nova.compute.manager [req-8063917f-4ad3-46ae-89ce-faf0dcba720d req-c59bde1a-03ed-41ae-a5c2-2431b8986a6d service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Received unexpected event network-vif-plugged-af8b1ee6-b3bb-4e30-b36d-3be720fa1130 for instance with vm_state building and task_state spawning.
Aug 27 02:32:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Received event network-vif-plugged-af8b1ee6-b3bb-4e30-b36d-3be720fa1130 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] Acquiring lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] No waiting events found dispatching network-vif-plugged-af8b1ee6-b3bb-4e30-b36d-3be720fa1130 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:30 user nova-compute[72820]: WARNING nova.compute.manager [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Received unexpected event network-vif-plugged-af8b1ee6-b3bb-4e30-b36d-3be720fa1130 for instance with vm_state building and task_state spawning.
Aug 27 02:32:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received event network-vif-plugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] Acquiring lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] No waiting events found dispatching network-vif-plugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:30 user nova-compute[72820]: WARNING nova.compute.manager [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received unexpected event network-vif-plugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 for instance with vm_state building and task_state spawning.
Aug 27 02:32:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received event network-vif-plugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] Acquiring lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] No waiting events found dispatching network-vif-plugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:30 user nova-compute[72820]: WARNING nova.compute.manager [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received unexpected event network-vif-plugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 for instance with vm_state building and task_state spawning.
Aug 27 02:32:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Received event network-vif-plugged-91420809-21b7-4f29-8db7-389b1fd06f7b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] Acquiring lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] Lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] Lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] No waiting events found dispatching network-vif-plugged-91420809-21b7-4f29-8db7-389b1fd06f7b {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:30 user nova-compute[72820]: WARNING nova.compute.manager [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Received unexpected event network-vif-plugged-91420809-21b7-4f29-8db7-389b1fd06f7b for instance with vm_state building and task_state spawning.
Aug 27 02:32:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Received event network-vif-plugged-91420809-21b7-4f29-8db7-389b1fd06f7b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] Acquiring lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] Lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] Lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] No waiting events found dispatching network-vif-plugged-91420809-21b7-4f29-8db7-389b1fd06f7b {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:30 user nova-compute[72820]: WARNING nova.compute.manager [req-34050b2b-fbce-40ec-a964-511d1c6aa986 req-e142ea87-bb5c-4e7d-b6d5-9b3d3c9d0249 service nova] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Received unexpected event network-vif-plugged-91420809-21b7-4f29-8db7-389b1fd06f7b for instance with vm_state building and task_state spawning.
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103551.679942, 85c8fa72-19be-49a0-975f-d6a0d30d011f => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:32:31 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] VM Resumed (Lifecycle Event)
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:32:31 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Instance spawned successfully.
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:32:31 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103551.6813815, 85c8fa72-19be-49a0-975f-d6a0d30d011f => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:32:31 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] VM Started (Lifecycle Event)
Aug 27 02:32:31 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Instance spawned successfully.
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:32:31 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103551.7175217, 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:32:31 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] VM Resumed (Lifecycle Event)
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:32:31 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Instance spawned successfully.
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:32:31 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103551.7193198, 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:32:31 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] VM Started (Lifecycle Event)
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:32:31 user nova-compute[72820]: INFO nova.compute.manager [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Took 8.20 seconds to spawn the instance on the hypervisor.
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:31 user nova-compute[72820]: INFO nova.compute.manager [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Took 9.81 seconds to spawn the instance on the hypervisor.
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:32:31 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103551.8601458, 15a1062a-ecfb-42b7-b8e5-03adbd6b8056 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:32:31 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] VM Resumed (Lifecycle Event)
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:32:32 user nova-compute[72820]: INFO nova.compute.manager [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Took 6.95 seconds to spawn the instance on the hypervisor.
Aug 27 02:32:32 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:32 user nova-compute[72820]: INFO nova.compute.manager [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Took 21.55 seconds to build instance.
Aug 27 02:32:32 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:32:32 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103551.860627, 15a1062a-ecfb-42b7-b8e5-03adbd6b8056 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:32:32 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] VM Started (Lifecycle Event)
Aug 27 02:32:32 user nova-compute[72820]: INFO nova.compute.manager [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Took 10.69 seconds to build instance.
Aug 27 02:32:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:32 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3cd56b6b-8400-4b81-9e08-dd01b866aca1 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.676s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:32 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:32:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ffc7f694-be99-4400-b89e-7e6c23910b5f tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.813s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:32 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:32:32 user nova-compute[72820]: INFO nova.compute.manager [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Took 7.77 seconds to build instance.
Aug 27 02:32:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6233f36e-bb2c-4bed-9840-1afc0e8df3c8 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.905s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:32 user nova-compute[72820]: DEBUG nova.network.neutron [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Port 553b0551-3051-4ed5-9c80-27d77670620d binding to destination host user is already ACTIVE {{(pid=72820) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 27 02:32:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:32:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquired lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:32:32 user nova-compute[72820]: DEBUG nova.network.neutron [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:32:32 user nova-compute[72820]: DEBUG nova.network.neutron [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Updating instance_info_cache with network_info: [{"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:32:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Releasing lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:32:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Creating tmpfile /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/tmp7top0mg7 to verify with other compute node that the instance is on the same shared storage. {{(pid=72820) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG nova.compute.manager [req-8b0d4ed1-e6e8-40f2-8bfb-38a4339050bf req-3f0e4a5e-8e39-42b9-906f-4043c20aef12 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received event network-vif-unplugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8b0d4ed1-e6e8-40f2-8bfb-38a4339050bf req-3f0e4a5e-8e39-42b9-906f-4043c20aef12 service nova] Acquiring lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8b0d4ed1-e6e8-40f2-8bfb-38a4339050bf req-3f0e4a5e-8e39-42b9-906f-4043c20aef12 service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8b0d4ed1-e6e8-40f2-8bfb-38a4339050bf req-3f0e4a5e-8e39-42b9-906f-4043c20aef12 service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG nova.compute.manager [req-8b0d4ed1-e6e8-40f2-8bfb-38a4339050bf req-3f0e4a5e-8e39-42b9-906f-4043c20aef12 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] No waiting events found dispatching network-vif-unplugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:33 user nova-compute[72820]: WARNING nova.compute.manager [req-8b0d4ed1-e6e8-40f2-8bfb-38a4339050bf req-3f0e4a5e-8e39-42b9-906f-4043c20aef12 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received unexpected event network-vif-unplugged-553b0551-3051-4ed5-9c80-27d77670620d for instance with vm_state resized and task_state resize_reverting.
Aug 27 02:32:33 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Instance destroyed successfully.
Aug 27 02:32:33 user nova-compute[72820]: DEBUG nova.objects.instance [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lazy-loading 'resources' on Instance uuid ac2f6797-8b7c-47d3-836d-fc1c617e23dd {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:26:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-75697122',display_name='tempest-ServerActionsTestOtherB-server-75697122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-75697122',id=16,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp3hR8w9f7AOU3wBlGjx2QgjVCzjqvm+j+8m+weDqKoVqafaUie8myGeBPk3f9wFUM+nLfm1AWiPS+cjE0rgULgjP5MomAJch5aNo42dwR8Sd4aT6HChhwUBzyy0SaiOg==',key_name='tempest-keypair-1915839179',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:31:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb32c350e1a44044bc5b19942df53d05',ramdisk_id='',reservation_id='r-gmwi89nk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-657110753',owner_user_name='tempest-ServerActionsTestOtherB-657110753-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:31:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='555eff4f50e9450aac65344bec772685',uuid=ac2f6797-8b7c-47d3-836d-fc1c617e23dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Converting VIF {"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG os_vif [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap553b0551-30, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:33 user nova-compute[72820]: INFO os_vif [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30')
Aug 27 02:32:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hATvUwtH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:32:33 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:32:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a09cb2a-2753-4260-801b-93f67eefe4cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:32:33 user nova-compute[72820]: No targets found.
Aug 27 02:32:33 user nova-compute[72820]: iSNS:
Aug 27 02:32:33 user nova-compute[72820]: No targets found.
Aug 27 02:32:33 user nova-compute[72820]: STATIC:
Aug 27 02:32:33 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f
Aug 27 02:32:33 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:32:33 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:32:33 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37
Aug 27 02:32:33 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:32:33 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:32:33 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1
Aug 27 02:32:33 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:32:33 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:32:33 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:32:33 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:32:33 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:32:33 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf
Aug 27 02:32:33 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:32:33 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:32:33 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e
Aug 27 02:32:33 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:32:33 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:32:33 user nova-compute[72820]: FIRMWARE:
Aug 27 02:32:33 user nova-compute[72820]: No targets found.
Aug 27 02:32:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:32:33 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:32:33 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1934322-f4a3-439b-a841-43440572944c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f9c131-7a65-47fb-a508-7a66a6678509]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:32:33 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:32:33 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:32:33 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:32:33 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:32:33 user nova-compute[72820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:32:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:32:33 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:32:33 user nova-compute[72820]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:32:33 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:32:33 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:32:33 user nova-compute[72820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:32:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a03883a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1'): ({'sdd'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:32:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Removing single pathed devices sdd {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ade6838-ec88-49e7-ab86-afbb7ede0616]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[636695f8-554e-4072-82c7-bb6f1bf7ea32]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Flushing IO for device /dev/sdd {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f33190-1690-4f36-a9be-d0640381000c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1750eadb-239f-4738-b642-8267cb6f14bc]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0cbea7-f443-40ca-a768-8053c582fbdc]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97f8a18-f0fc-4598-afd1-83f1d3944855]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260]
Aug 27 02:32:34 user nova-compute[72820]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260] successful.
Aug 27 02:32:34 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff6ad0e-0f11-4af8-bffc-9784a0b7a850]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] <== disconnect_volume: return (376ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:32:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:32:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:35 user nova-compute[72820]: DEBUG nova.objects.instance [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lazy-loading 'migration_context' on Instance uuid ac2f6797-8b7c-47d3-836d-fc1c617e23dd {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:32:35 user nova-compute[72820]: DEBUG nova.objects.base [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Object Instance<ac2f6797-8b7c-47d3-836d-fc1c617e23dd> lazy-loaded attributes: resources,migration_context {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:32:35 user nova-compute[72820]: DEBUG nova.compute.manager [req-36b28505-5167-42cd-befb-8423c09644da req-b354816f-070b-485c-b1f5-5d1e9ef2010c service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received event network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-36b28505-5167-42cd-befb-8423c09644da req-b354816f-070b-485c-b1f5-5d1e9ef2010c service nova] Acquiring lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-36b28505-5167-42cd-befb-8423c09644da req-b354816f-070b-485c-b1f5-5d1e9ef2010c service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-36b28505-5167-42cd-befb-8423c09644da req-b354816f-070b-485c-b1f5-5d1e9ef2010c service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:35 user nova-compute[72820]: DEBUG nova.compute.manager [req-36b28505-5167-42cd-befb-8423c09644da req-b354816f-070b-485c-b1f5-5d1e9ef2010c service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] No waiting events found dispatching network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:35 user nova-compute[72820]: WARNING nova.compute.manager [req-36b28505-5167-42cd-befb-8423c09644da req-b354816f-070b-485c-b1f5-5d1e9ef2010c service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received unexpected event network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d for instance with vm_state resized and task_state resize_reverting.
Aug 27 02:32:35 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:32:35 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:32:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.626s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:36 user nova-compute[72820]: INFO nova.compute.manager [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Swapping old allocation on dict_keys(['a962b30a-2750-431c-be10-075d0f991065']) held by migration ebf31c8f-7d9d-46e1-b1f4-4247c14bf8a1 for instance
Aug 27 02:32:36 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Overwriting current allocation {'allocations': {'a962b30a-2750-431c-be10-075d0f991065': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 32}}, 'project_id': 'eb32c350e1a44044bc5b19942df53d05', 'user_id': '555eff4f50e9450aac65344bec772685', 'consumer_generation': 1} on consumer ac2f6797-8b7c-47d3-836d-fc1c617e23dd {{(pid=72820) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 27 02:32:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:32:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquired lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:32:36 user nova-compute[72820]: DEBUG nova.network.neutron [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG nova.network.neutron [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Updating instance_info_cache with network_info: [{"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Releasing lock "refresh_cache-ac2f6797-8b7c-47d3-836d-fc1c617e23dd" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG os_brick.utils [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c950a96-e6df-4dba-8ddf-96d74cd03b40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a777f6a6-034a-4757-8293-8d63f3545656]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4dc68d-259c-48d9-a44f-16befe448458]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a54978-5bdd-4e6f-9e45-64e2f43db2e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:32:37 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:32:37 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5927e6-a770-4513-8c8b-b9bee71a5d29]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:32:37 user nova-compute[72820]: DEBUG os_brick.utils [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:32:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-78ab4ae5-d898-40d3-8401-1e572ab23f69 req-6357566d-058a-4c43-83f9-c180c8d84995 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-changed-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-78ab4ae5-d898-40d3-8401-1e572ab23f69 req-6357566d-058a-4c43-83f9-c180c8d84995 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Refreshing instance network info cache due to event network-changed-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:32:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-78ab4ae5-d898-40d3-8401-1e572ab23f69 req-6357566d-058a-4c43-83f9-c180c8d84995 service nova] Acquiring lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:32:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-78ab4ae5-d898-40d3-8401-1e572ab23f69 req-6357566d-058a-4c43-83f9-c180c8d84995 service nova] Acquired lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:32:40 user nova-compute[72820]: DEBUG nova.network.neutron [req-78ab4ae5-d898-40d3-8401-1e572ab23f69 req-6357566d-058a-4c43-83f9-c180c8d84995 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Refreshing network info cache for port 8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:32:41 user nova-compute[72820]: DEBUG nova.network.neutron [req-78ab4ae5-d898-40d3-8401-1e572ab23f69 req-6357566d-058a-4c43-83f9-c180c8d84995 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Updated VIF entry in instance network info cache for port 8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:32:41 user nova-compute[72820]: DEBUG nova.network.neutron [req-78ab4ae5-d898-40d3-8401-1e572ab23f69 req-6357566d-058a-4c43-83f9-c180c8d84995 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Updating instance_info_cache with network_info: [{"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:32:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-78ab4ae5-d898-40d3-8401-1e572ab23f69 req-6357566d-058a-4c43-83f9-c180c8d84995 service nova] Releasing lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:32:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:46 user nova-compute[72820]: INFO nova.compute.manager [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Shelving
Aug 27 02:32:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:47 user nova-compute[72820]: DEBUG nova.compute.manager [req-4edb6934-eaa9-4abc-a64e-b1ae081cfbcf req-d5d71d46-3fc7-4d56-be28-60c3b9139c9d service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-vif-unplugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4edb6934-eaa9-4abc-a64e-b1ae081cfbcf req-d5d71d46-3fc7-4d56-be28-60c3b9139c9d service nova] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4edb6934-eaa9-4abc-a64e-b1ae081cfbcf req-d5d71d46-3fc7-4d56-be28-60c3b9139c9d service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4edb6934-eaa9-4abc-a64e-b1ae081cfbcf req-d5d71d46-3fc7-4d56-be28-60c3b9139c9d service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:47 user nova-compute[72820]: DEBUG nova.compute.manager [req-4edb6934-eaa9-4abc-a64e-b1ae081cfbcf req-d5d71d46-3fc7-4d56-be28-60c3b9139c9d service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] No waiting events found dispatching network-vif-unplugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:47 user nova-compute[72820]: WARNING nova.compute.manager [req-4edb6934-eaa9-4abc-a64e-b1ae081cfbcf req-d5d71d46-3fc7-4d56-be28-60c3b9139c9d service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received unexpected event network-vif-unplugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 for instance with vm_state active and task_state shelving.
Aug 27 02:32:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:47 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Instance destroyed successfully.
Aug 27 02:32:47 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Beginning cold snapshot process
Aug 27 02:32:47 user nova-compute[72820]: DEBUG nova.privsep.utils [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 02:32:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk /opt/stack/data/nova/instances/snapshots/tmp4k45zymg/9c6ac2dd774b4315a521430f414a93c9 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:48 user nova-compute[72820]: INFO nova.compute.manager [None req-9e77ce98-087c-4a62-8674-37fb45926645 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Unrescuing
Aug 27 02:32:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9e77ce98-087c-4a62-8674-37fb45926645 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:32:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9e77ce98-087c-4a62-8674-37fb45926645 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquired lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:32:48 user nova-compute[72820]: DEBUG nova.network.neutron [None req-9e77ce98-087c-4a62-8674-37fb45926645 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:32:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk /opt/stack/data/nova/instances/snapshots/tmp4k45zymg/9c6ac2dd774b4315a521430f414a93c9" returned: 0 in 0.671s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:48 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Snapshot extracted, beginning image upload
Aug 27 02:32:48 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103553.8316453, ac2f6797-8b7c-47d3-836d-fc1c617e23dd => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:32:48 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] VM Stopped (Lifecycle Event)
Aug 27 02:32:48 user nova-compute[72820]: DEBUG nova.network.neutron [None req-9e77ce98-087c-4a62-8674-37fb45926645 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Updating instance_info_cache with network_info: [{"id": "91356c13-2f8e-4c32-993c-98aa52345f86", "address": "fa:16:3e:d1:90:a2", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91356c13-2f", "ovs_interfaceid": "91356c13-2f8e-4c32-993c-98aa52345f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:32:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-26cade6f-c20b-4d8f-bd7d-684a386201c5 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9e77ce98-087c-4a62-8674-37fb45926645 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Releasing lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:32:48 user nova-compute[72820]: DEBUG nova.objects.instance [None req-9e77ce98-087c-4a62-8674-37fb45926645 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'flavor' on Instance uuid 89b66e95-2333-403b-b338-6096717ca20d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:32:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG nova.compute.manager [req-d97702be-a7ce-4506-aca5-021d750b771f req-13a30e51-db37-4b7c-8946-b37193ca2db5 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d97702be-a7ce-4506-aca5-021d750b771f req-13a30e51-db37-4b7c-8946-b37193ca2db5 service nova] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d97702be-a7ce-4506-aca5-021d750b771f req-13a30e51-db37-4b7c-8946-b37193ca2db5 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d97702be-a7ce-4506-aca5-021d750b771f req-13a30e51-db37-4b7c-8946-b37193ca2db5 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG nova.compute.manager [req-d97702be-a7ce-4506-aca5-021d750b771f req-13a30e51-db37-4b7c-8946-b37193ca2db5 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] No waiting events found dispatching network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:49 user nova-compute[72820]: WARNING nova.compute.manager [req-d97702be-a7ce-4506-aca5-021d750b771f req-13a30e51-db37-4b7c-8946-b37193ca2db5 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received unexpected event network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 for instance with vm_state active and task_state shelving_image_uploading.
Aug 27 02:32:49 user nova-compute[72820]: DEBUG nova.compute.manager [req-1e1e9a03-508b-4429-b571-da9eb353a583 req-ed74f2e3-bbce-4426-bff7-e9d440d16654 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-unplugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1e1e9a03-508b-4429-b571-da9eb353a583 req-ed74f2e3-bbce-4426-bff7-e9d440d16654 service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1e1e9a03-508b-4429-b571-da9eb353a583 req-ed74f2e3-bbce-4426-bff7-e9d440d16654 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1e1e9a03-508b-4429-b571-da9eb353a583 req-ed74f2e3-bbce-4426-bff7-e9d440d16654 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG nova.compute.manager [req-1e1e9a03-508b-4429-b571-da9eb353a583 req-ed74f2e3-bbce-4426-bff7-e9d440d16654 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-unplugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:49 user nova-compute[72820]: WARNING nova.compute.manager [req-1e1e9a03-508b-4429-b571-da9eb353a583 req-ed74f2e3-bbce-4426-bff7-e9d440d16654 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-unplugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:32:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:49 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Instance destroyed successfully.
Aug 27 02:32:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Starting finish_revert_migration {{(pid=72820) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Start _get_guest_xml network_info=[{"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'af72bc04-2537-4a57-95d9-c316b50def7f', 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hATvUwtH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ac2f6797-8b7c-47d3-836d-fc1c617e23dd', 'attached_at': '2023-08-27T02:32:50.000000', 'detached_at': '', 'volume_id': '27cad7eb-b82b-4588-b153-48d86f4da1a1', 'serial': '27cad7eb-b82b-4588-b153-48d86f4da1a1'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:32:50 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:32:50 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.objects.instance [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lazy-loading 'vcpu_model' on Instance uuid ac2f6797-8b7c-47d3-836d-fc1c617e23dd {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hATvUwtH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:32:50 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:32:50 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:32:50 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccca3549-d6f7-4175-bba6-ce7b96423ced]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:32:50 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[66462587-898f-4196-bc48-009f856ff117]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1] added
Aug 27 02:32:50 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62415f3-b1b4-4f91-8b22-c9e9add14678]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24a03e3-42f8-4c41-a463-fec09972ec3d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hATvUwtH {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hATvUwtH" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33c6b29-a158-478a-abca-003f57b39eee]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hATvUwtH'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac7e0a4-b74b-475a-b550-337ed3e5a90b]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[40790e72-9b95-4b56-a05c-8f3fece03d1e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:32:50 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:32:50 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:32:50 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:32:50 user nova-compute[72820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:32:50 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:32:50 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:32:50 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:32:50 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:32:50 user nova-compute[72820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:32:50 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbb00a5-9cae-4b92-93d4-160f76d0bd51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260]
Aug 27 02:32:50 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260] successful.
Aug 27 02:32:50 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad6f95d-7f10-4168-aa61-8dcfdf871882]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[12603c49-ec8f-4911-856f-cef089c35919]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:32:50 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:32:50 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:32:50 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:32:50 user nova-compute[72820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:32:50 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:32:50 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:32:50 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:32:50 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:32:50 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:32:50 user nova-compute[72820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:32:50 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:32:50 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fa571f-9f2e-4692-a71b-65323f83bf03]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: None {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:51 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Snapshot image upload complete
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:51 user nova-compute[72820]: INFO nova.compute.manager [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Shelve offloading
Aug 27 02:32:51 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Instance destroyed successfully.
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:51 user nova-compute[72820]: WARNING nova.compute.manager [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:51 user nova-compute[72820]: WARNING nova.compute.manager [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:51 user nova-compute[72820]: WARNING nova.compute.manager [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-unplugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-unplugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:51 user nova-compute[72820]: WARNING nova.compute.manager [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-unplugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:51 user nova-compute[72820]: WARNING nova.compute.manager [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:51 user nova-compute[72820]: WARNING nova.compute.manager [req-46aea4c1-3e10-4dc1-ba9d-22b898d703ee req-350a1f94-b2aa-4253-9308-3816038f32cc service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquired lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.network.neutron [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hATvUwtH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23865303864626138', 'path': '/dev/sdd'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865303864626138', 'path': '/dev/sdd'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:26:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-75697122',display_name='tempest-ServerActionsTestOtherB-server-75697122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-75697122',id=16,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp3hR8w9f7AOU3wBlGjx2QgjVCzjqvm+j+8m+weDqKoVqafaUie8myGeBPk3f9wFUM+nLfm1AWiPS+cjE0rgULgjP5MomAJch5aNo42dwR8Sd4aT6HChhwUBzyy0SaiOg==',key_name='tempest-keypair-1915839179',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:31:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb32c350e1a44044bc5b19942df53d05',ramdisk_id='',reservation_id='r-gmwi89nk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-657110753',owner_user_name='tempest-ServerActionsTestOtherB-657110753-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:32:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='555eff4f50e9450aac65344bec772685',uuid=ac2f6797-8b7c-47d3-836d-fc1c617e23dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Converting VIF {"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:32:51 user nova-compute[72820]:   <uuid>ac2f6797-8b7c-47d3-836d-fc1c617e23dd</uuid>
Aug 27 02:32:51 user nova-compute[72820]:   <name>instance-00000010</name>
Aug 27 02:32:51 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:32:51 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:32:51 user nova-compute[72820]:   <metadata>
Aug 27 02:32:51 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:32:51 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:32:51 user nova-compute[72820]:       <nova:name>tempest-ServerActionsTestOtherB-server-75697122</nova:name>
Aug 27 02:32:51 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:32:50</nova:creationTime>
Aug 27 02:32:51 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:32:51 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:32:51 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:32:51 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:32:51 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:32:51 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:32:51 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:32:51 user nova-compute[72820]:       <nova:owner>
Aug 27 02:32:51 user nova-compute[72820]:         <nova:user uuid="555eff4f50e9450aac65344bec772685">tempest-ServerActionsTestOtherB-657110753-project-member</nova:user>
Aug 27 02:32:51 user nova-compute[72820]:         <nova:project uuid="eb32c350e1a44044bc5b19942df53d05">tempest-ServerActionsTestOtherB-657110753</nova:project>
Aug 27 02:32:51 user nova-compute[72820]:       </nova:owner>
Aug 27 02:32:51 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:32:51 user nova-compute[72820]:       <nova:ports>
Aug 27 02:32:51 user nova-compute[72820]:         <nova:port uuid="553b0551-3051-4ed5-9c80-27d77670620d">
Aug 27 02:32:51 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 02:32:51 user nova-compute[72820]:         </nova:port>
Aug 27 02:32:51 user nova-compute[72820]:       </nova:ports>
Aug 27 02:32:51 user nova-compute[72820]:     </nova:instance>
Aug 27 02:32:51 user nova-compute[72820]:   </metadata>
Aug 27 02:32:51 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:32:51 user nova-compute[72820]:     <system>
Aug 27 02:32:51 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:32:51 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:32:51 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:32:51 user nova-compute[72820]:       <entry name="serial">ac2f6797-8b7c-47d3-836d-fc1c617e23dd</entry>
Aug 27 02:32:51 user nova-compute[72820]:       <entry name="uuid">ac2f6797-8b7c-47d3-836d-fc1c617e23dd</entry>
Aug 27 02:32:51 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:32:51 user nova-compute[72820]:     </system>
Aug 27 02:32:51 user nova-compute[72820]:   </sysinfo>
Aug 27 02:32:51 user nova-compute[72820]:   <os>
Aug 27 02:32:51 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:32:51 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:32:51 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:32:51 user nova-compute[72820]:   </os>
Aug 27 02:32:51 user nova-compute[72820]:   <features>
Aug 27 02:32:51 user nova-compute[72820]:     <acpi/>
Aug 27 02:32:51 user nova-compute[72820]:     <apic/>
Aug 27 02:32:51 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:32:51 user nova-compute[72820]:   </features>
Aug 27 02:32:51 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:32:51 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:32:51 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:32:51 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:32:51 user nova-compute[72820]:   </clock>
Aug 27 02:32:51 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:32:51 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:32:51 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:32:51 user nova-compute[72820]:   </cpu>
Aug 27 02:32:51 user nova-compute[72820]:   <devices>
Aug 27 02:32:51 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:32:51 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:32:51 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk"/>
Aug 27 02:32:51 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:32:51 user nova-compute[72820]:     </disk>
Aug 27 02:32:51 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:32:51 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:32:51 user nova-compute[72820]:       <source dev="/dev/sdd"/>
Aug 27 02:32:51 user nova-compute[72820]:       <target dev="vdb" bus="virtio"/>
Aug 27 02:32:51 user nova-compute[72820]:       <serial>27cad7eb-b82b-4588-b153-48d86f4da1a1</serial>
Aug 27 02:32:51 user nova-compute[72820]:     </disk>
Aug 27 02:32:51 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:32:51 user nova-compute[72820]:       <mac address="fa:16:3e:b6:ef:6b"/>
Aug 27 02:32:51 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:32:51 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:32:51 user nova-compute[72820]:       <target dev="tap553b0551-30"/>
Aug 27 02:32:51 user nova-compute[72820]:     </interface>
Aug 27 02:32:51 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:32:51 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/console.log" append="off"/>
Aug 27 02:32:51 user nova-compute[72820]:     </serial>
Aug 27 02:32:51 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:32:51 user nova-compute[72820]:     <video>
Aug 27 02:32:51 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:32:51 user nova-compute[72820]:     </video>
Aug 27 02:32:51 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:32:51 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:32:51 user nova-compute[72820]:     </rng>
Aug 27 02:32:51 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:32:51 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:32:51 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:32:51 user nova-compute[72820]:     </memballoon>
Aug 27 02:32:51 user nova-compute[72820]:   </devices>
Aug 27 02:32:51 user nova-compute[72820]: </domain>
Aug 27 02:32:51 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:26:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-75697122',display_name='tempest-ServerActionsTestOtherB-server-75697122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-75697122',id=16,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp3hR8w9f7AOU3wBlGjx2QgjVCzjqvm+j+8m+weDqKoVqafaUie8myGeBPk3f9wFUM+nLfm1AWiPS+cjE0rgULgjP5MomAJch5aNo42dwR8Sd4aT6HChhwUBzyy0SaiOg==',key_name='tempest-keypair-1915839179',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:31:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb32c350e1a44044bc5b19942df53d05',ramdisk_id='',reservation_id='r-gmwi89nk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-657110753',owner_user_name='tempest-ServerActionsTestOtherB-657110753-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:32:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='555eff4f50e9450aac65344bec772685',uuid=ac2f6797-8b7c-47d3-836d-fc1c617e23dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Converting VIF {"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG os_vif [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap553b0551-30, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap553b0551-30, col_values=(('external_ids', {'iface-id': '553b0551-3051-4ed5-9c80-27d77670620d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:ef:6b', 'vm-uuid': 'ac2f6797-8b7c-47d3-836d-fc1c617e23dd'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:32:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:51 user nova-compute[72820]: INFO os_vif [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30')
Aug 27 02:32:52 user nova-compute[72820]: DEBUG nova.network.neutron [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Updating instance_info_cache with network_info: [{"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:32:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Releasing lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:32:53 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Instance destroyed successfully.
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.objects.instance [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'resources' on Instance uuid a67eea06-dabf-4115-9650-ea4098f80bd7 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-992417993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-992417993',id=24,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQesFgtpIxxL8sCQQFFOwOmpNR4N6yUY2jMITT3BKSU+Fz4HCZ8wmzaU//D1VTaaMjREKL1z86PTxVdQd+Q3SwZ0mDplq3tWNJOexRZYowP0u7zMy6yID/Tzq9KN8h6/g==',key_name='tempest-keypair-398704580',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:30:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5387e67178b141ae94025b9fd61f0124',ramdisk_id='',reservation_id='r-kyve7ptf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1913674887',owner_user_name='tempest-AttachVolumeShelveTestJSON-1913674887-project-member',shelved_at='2023-08-27T02:32:51.185216',shelved_host='user',shelved_image_id='1d35110d-4c15-47da-9f05-1cfc67773675'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:32:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6dbf37c8dec47aebcdc9c93ad1f3d69',uuid=a67eea06-dabf-4115-9650-ea4098f80bd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converting VIF {"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:b5,bridge_name='br-int',has_traffic_filtering=True,id=8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e251de1-2d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG os_vif [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:b5,bridge_name='br-int',has_traffic_filtering=True,id=8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e251de1-2d') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e251de1-2d, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:53 user nova-compute[72820]: INFO os_vif [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:b5,bridge_name='br-int',has_traffic_filtering=True,id=8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e251de1-2d')
Aug 27 02:32:53 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Deleting instance files /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7_del
Aug 27 02:32:53 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Deletion of /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7_del complete
Aug 27 02:32:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Removed pending event for 89b66e95-2333-403b-b338-6096717ca20d due to event {{(pid=72820) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103573.2195342, 89b66e95-2333-403b-b338-6096717ca20d => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:32:53 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] VM Resumed (Lifecycle Event)
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.compute.manager [None req-9e77ce98-087c-4a62-8674-37fb45926645 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:32:53 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103573.226487, 89b66e95-2333-403b-b338-6096717ca20d => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:32:53 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] VM Started (Lifecycle Event)
Aug 27 02:32:53 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Deleted allocations for instance a67eea06-dabf-4115-9650-ea4098f80bd7
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-f76ff921-4160-4a5a-b3a7-73a61f2acb32 req-b7ba4a6c-d9a1-4ec1-b9ef-cc7ab1a2a598 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f76ff921-4160-4a5a-b3a7-73a61f2acb32 req-b7ba4a6c-d9a1-4ec1-b9ef-cc7ab1a2a598 service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f76ff921-4160-4a5a-b3a7-73a61f2acb32 req-b7ba4a6c-d9a1-4ec1-b9ef-cc7ab1a2a598 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f76ff921-4160-4a5a-b3a7-73a61f2acb32 req-b7ba4a6c-d9a1-4ec1-b9ef-cc7ab1a2a598 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-f76ff921-4160-4a5a-b3a7-73a61f2acb32 req-b7ba4a6c-d9a1-4ec1-b9ef-cc7ab1a2a598 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:53 user nova-compute[72820]: WARNING nova.compute.manager [req-f76ff921-4160-4a5a-b3a7-73a61f2acb32 req-b7ba4a6c-d9a1-4ec1-b9ef-cc7ab1a2a598 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state active and task_state None.
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-f76ff921-4160-4a5a-b3a7-73a61f2acb32 req-b7ba4a6c-d9a1-4ec1-b9ef-cc7ab1a2a598 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-changed-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-f76ff921-4160-4a5a-b3a7-73a61f2acb32 req-b7ba4a6c-d9a1-4ec1-b9ef-cc7ab1a2a598 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Refreshing instance network info cache due to event network-changed-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f76ff921-4160-4a5a-b3a7-73a61f2acb32 req-b7ba4a6c-d9a1-4ec1-b9ef-cc7ab1a2a598 service nova] Acquiring lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f76ff921-4160-4a5a-b3a7-73a61f2acb32 req-b7ba4a6c-d9a1-4ec1-b9ef-cc7ab1a2a598 service nova] Acquired lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.network.neutron [req-f76ff921-4160-4a5a-b3a7-73a61f2acb32 req-b7ba4a6c-d9a1-4ec1-b9ef-cc7ab1a2a598 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Refreshing network info cache for port 8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.objects.instance [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'numa_topology' on Instance uuid a67eea06-dabf-4115-9650-ea4098f80bd7 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-e1d51246-eb0d-4650-9524-f6478ab026e3 req-c6e9cab9-12c0-412e-87b6-60718f202443 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received event network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e1d51246-eb0d-4650-9524-f6478ab026e3 req-c6e9cab9-12c0-412e-87b6-60718f202443 service nova] Acquiring lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e1d51246-eb0d-4650-9524-f6478ab026e3 req-c6e9cab9-12c0-412e-87b6-60718f202443 service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e1d51246-eb0d-4650-9524-f6478ab026e3 req-c6e9cab9-12c0-412e-87b6-60718f202443 service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-e1d51246-eb0d-4650-9524-f6478ab026e3 req-c6e9cab9-12c0-412e-87b6-60718f202443 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] No waiting events found dispatching network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:53 user nova-compute[72820]: WARNING nova.compute.manager [req-e1d51246-eb0d-4650-9524-f6478ab026e3 req-c6e9cab9-12c0-412e-87b6-60718f202443 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received unexpected event network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d for instance with vm_state resized and task_state resize_reverting.
Aug 27 02:32:53 user nova-compute[72820]: DEBUG nova.objects.base [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Object Instance<a67eea06-dabf-4115-9650-ea4098f80bd7> lazy-loaded attributes: resources,numa_topology {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:53 user nova-compute[72820]: INFO nova.compute.manager [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Detaching volume 7a61e3b0-c116-4d65-87a6-c9e9839f160f
Aug 27 02:32:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG nova.network.neutron [req-f76ff921-4160-4a5a-b3a7-73a61f2acb32 req-b7ba4a6c-d9a1-4ec1-b9ef-cc7ab1a2a598 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Updated VIF entry in instance network info cache for port 8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG nova.network.neutron [req-f76ff921-4160-4a5a-b3a7-73a61f2acb32 req-b7ba4a6c-d9a1-4ec1-b9ef-cc7ab1a2a598 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Updating instance_info_cache with network_info: [{"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8e251de1-2d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:32:54 user nova-compute[72820]: INFO nova.virt.block_device [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Attempting to driver detach volume 7a61e3b0-c116-4d65-87a6-c9e9839f160f from mountpoint /dev/vdb
Aug 27 02:32:54 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f76ff921-4160-4a5a-b3a7-73a61f2acb32 req-b7ba4a6c-d9a1-4ec1-b9ef-cc7ab1a2a598 service nova] Releasing lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.661s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Attempting to detach device vdb from instance 4becc265-4f3d-4f83-a9ac-c99100a870ff from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:32:54 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:32:54 user nova-compute[72820]:   <source dev="/dev/sde"/>
Aug 27 02:32:54 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:32:54 user nova-compute[72820]:   <serial>7a61e3b0-c116-4d65-87a6-c9e9839f160f</serial>
Aug 27 02:32:54 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:32:54 user nova-compute[72820]: </disk>
Aug 27 02:32:54 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:32:54 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Successfully detached device vdb from instance 4becc265-4f3d-4f83-a9ac-c99100a870ff from the persistent domain config.
Aug 27 02:32:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4becc265-4f3d-4f83-a9ac-c99100a870ff from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:32:54 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:32:54 user nova-compute[72820]:   <source dev="/dev/sde"/>
Aug 27 02:32:54 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:32:54 user nova-compute[72820]:   <serial>7a61e3b0-c116-4d65-87a6-c9e9839f160f</serial>
Aug 27 02:32:54 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:32:54 user nova-compute[72820]: </disk>
Aug 27 02:32:54 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e348635f-90b4-4569-a634-82707349521a tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.399s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693103574.6172082, 4becc265-4f3d-4f83-a9ac-c99100a870ff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4becc265-4f3d-4f83-a9ac-c99100a870ff {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:32:54 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Successfully detached device vdb from instance 4becc265-4f3d-4f83-a9ac-c99100a870ff from the live domain config.
Aug 27 02:32:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oUhBxzkT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:32:54 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:32:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddbd246-1550-4390-929a-e41241abc187]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:32:54 user nova-compute[72820]: No targets found.
Aug 27 02:32:54 user nova-compute[72820]: iSNS:
Aug 27 02:32:54 user nova-compute[72820]: No targets found.
Aug 27 02:32:54 user nova-compute[72820]: STATIC:
Aug 27 02:32:54 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f
Aug 27 02:32:54 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:32:54 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:32:54 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37
Aug 27 02:32:54 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:32:54 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:32:54 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1
Aug 27 02:32:54 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:32:54 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:32:54 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:32:54 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:32:54 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:32:54 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf
Aug 27 02:32:54 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:32:54 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:32:54 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e
Aug 27 02:32:54 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:32:54 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:32:54 user nova-compute[72820]: FIRMWARE:
Aug 27 02:32:54 user nova-compute[72820]: No targets found.
Aug 27 02:32:54 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:32:54 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:32:54 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e4d7aa-5e63-4cbb-9da2-84ba1189b7d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e150a811-10da-41e2-84e0-f4b1f94b64b8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:32:54 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:32:54 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:32:54 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:32:54 user nova-compute[72820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:32:54 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:32:54 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:32:54 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:32:54 user nova-compute[72820]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f (non-flash)
Aug 27 02:32:54 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:32:54 user nova-compute[72820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:32:54 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:32:54 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c4d12950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f'): ({'sde'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Removing single pathed devices sde {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4965663c-e000-4fa8-bb40-56de6139c3d3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbab7fd-f294-4141-b554-863e98432cae]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Flushing IO for device /dev/sde {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0373740-62b1-496a-95b3-848b548e9799]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[71648034-aa78-4565-9b07-059f4a56e059]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] SCSI volumes sde have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d122dc-0e21-48b6-9d4f-1c2153e66530]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7545f45e-9416-42d1-ad5b-1d7843dcb7bc]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f, portal: 172.16.0.220,3260]
Aug 27 02:32:54 user nova-compute[72820]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f, portal: 172.16.0.220,3260] successful.
Aug 27 02:32:54 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:32:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a61e3b0-c116-4d65-87a6-c9e9839f160f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:32:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea18a42b-4bfb-4084-bc3d-0204e4d8b7e2]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:32:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:32:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:32:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] <== disconnect_volume: return (395ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:32:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:32:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-5e53847b-f1ce-46f6-beda-39b57d67b0f1 req-91040584-2fbf-49c4-afb4-e8ed80bfe410 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received event network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:32:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5e53847b-f1ce-46f6-beda-39b57d67b0f1 req-91040584-2fbf-49c4-afb4-e8ed80bfe410 service nova] Acquiring lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:32:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5e53847b-f1ce-46f6-beda-39b57d67b0f1 req-91040584-2fbf-49c4-afb4-e8ed80bfe410 service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:32:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5e53847b-f1ce-46f6-beda-39b57d67b0f1 req-91040584-2fbf-49c4-afb4-e8ed80bfe410 service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-5e53847b-f1ce-46f6-beda-39b57d67b0f1 req-91040584-2fbf-49c4-afb4-e8ed80bfe410 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] No waiting events found dispatching network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:32:55 user nova-compute[72820]: WARNING nova.compute.manager [req-5e53847b-f1ce-46f6-beda-39b57d67b0f1 req-91040584-2fbf-49c4-afb4-e8ed80bfe410 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received unexpected event network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d for instance with vm_state resized and task_state resize_reverting.
Aug 27 02:32:55 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103575.7436292, ac2f6797-8b7c-47d3-836d-fc1c617e23dd => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:32:55 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] VM Resumed (Lifecycle Event)
Aug 27 02:32:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:32:55 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Instance running successfully.
Aug 27 02:32:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] finish_revert_migration finished successfully. {{(pid=72820) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 27 02:32:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:32:55 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 27 02:32:55 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103575.745005, ac2f6797-8b7c-47d3-836d-fc1c617e23dd => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:32:55 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] VM Started (Lifecycle Event)
Aug 27 02:32:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:32:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:32:55 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 27 02:32:55 user nova-compute[72820]: INFO nova.compute.manager [None req-696d84a3-7922-4cce-a0de-21a451f998f0 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Updating instance to original state: 'active'
Aug 27 02:32:55 user nova-compute[72820]: DEBUG nova.objects.instance [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lazy-loading 'flavor' on Instance uuid 4becc265-4f3d-4f83-a9ac-c99100a870ff {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:32:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d32b162e-668a-4c20-b608-9c25221f684b tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.052s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:32:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:32:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:02 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103567.594054, a67eea06-dabf-4115-9650-ea4098f80bd7 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:33:02 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] VM Stopped (Lifecycle Event)
Aug 27 02:33:02 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e7bf3723-4ac1-4b13-9040-9917da200453 None None] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:33:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:10 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:33:10 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:33:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:33:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "7c42c4ae-0f80-4295-a64e-b426225b94c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "7c42c4ae-0f80-4295-a64e-b426225b94c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:11 user nova-compute[72820]: INFO nova.compute.manager [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Terminating instance
Aug 27 02:33:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:33:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-0f2f4514-5362-41da-b0f5-d945c395b4d1 req-e6e7742c-6155-4dcb-b9fd-010d228197f7 service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Received event network-vif-unplugged-d901c17c-746e-41ac-8066-cb1d4c4b0d69 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:33:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0f2f4514-5362-41da-b0f5-d945c395b4d1 req-e6e7742c-6155-4dcb-b9fd-010d228197f7 service nova] Acquiring lock "7c42c4ae-0f80-4295-a64e-b426225b94c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0f2f4514-5362-41da-b0f5-d945c395b4d1 req-e6e7742c-6155-4dcb-b9fd-010d228197f7 service nova] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0f2f4514-5362-41da-b0f5-d945c395b4d1 req-e6e7742c-6155-4dcb-b9fd-010d228197f7 service nova] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-0f2f4514-5362-41da-b0f5-d945c395b4d1 req-e6e7742c-6155-4dcb-b9fd-010d228197f7 service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] No waiting events found dispatching network-vif-unplugged-d901c17c-746e-41ac-8066-cb1d4c4b0d69 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:33:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-0f2f4514-5362-41da-b0f5-d945c395b4d1 req-e6e7742c-6155-4dcb-b9fd-010d228197f7 service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Received event network-vif-unplugged-d901c17c-746e-41ac-8066-cb1d4c4b0d69 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:33:12 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Instance destroyed successfully.
Aug 27 02:33:12 user nova-compute[72820]: DEBUG nova.objects.instance [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lazy-loading 'resources' on Instance uuid 7c42c4ae-0f80-4295-a64e-b426225b94c5 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:33:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:26:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-468413800',display_name='tempest-VolumesAdminNegativeTest-server-468413800',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-468413800',id=18,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8iM92FaA00mKy2De9QnWQRjd2n/WUAKku5o4xuj5gyiqETxjfoVzQfjhLqNf9EJzi+mx2g9bBlU6/XhebjHQBxb+GrQRtr+ScNA4C44LcxSwaYMihvVrbfUJsoyJDgrA==',key_name='tempest-keypair-301165627',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:27:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ddd7d54478749cba3988913864379ed',ramdisk_id='',reservation_id='r-5607uo4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1861523875',owner_user_name='tempest-VolumesAdminNegativeTest-1861523875-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:27:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76b3417256eb4ff7924db6912e97726c',uuid=7c42c4ae-0f80-4295-a64e-b426225b94c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "address": "fa:16:3e:51:e5:4a", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd901c17c-74", "ovs_interfaceid": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:33:12 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Converting VIF {"id": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "address": "fa:16:3e:51:e5:4a", "network": {"id": "8741024c-a257-4a16-b983-d6ac4f6b5ad2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2026845429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddd7d54478749cba3988913864379ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd901c17c-74", "ovs_interfaceid": "d901c17c-746e-41ac-8066-cb1d4c4b0d69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:33:12 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:e5:4a,bridge_name='br-int',has_traffic_filtering=True,id=d901c17c-746e-41ac-8066-cb1d4c4b0d69,network=Network(8741024c-a257-4a16-b983-d6ac4f6b5ad2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd901c17c-74') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:33:12 user nova-compute[72820]: DEBUG os_vif [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:e5:4a,bridge_name='br-int',has_traffic_filtering=True,id=d901c17c-746e-41ac-8066-cb1d4c4b0d69,network=Network(8741024c-a257-4a16-b983-d6ac4f6b5ad2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd901c17c-74') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:33:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd901c17c-74, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:33:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:33:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:12 user nova-compute[72820]: INFO os_vif [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:e5:4a,bridge_name='br-int',has_traffic_filtering=True,id=d901c17c-746e-41ac-8066-cb1d4c4b0d69,network=Network(8741024c-a257-4a16-b983-d6ac4f6b5ad2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd901c17c-74')
Aug 27 02:33:12 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Deleting instance files /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5_del
Aug 27 02:33:12 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Deletion of /opt/stack/data/nova/instances/7c42c4ae-0f80-4295-a64e-b426225b94c5_del complete
Aug 27 02:33:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:33:12 user nova-compute[72820]: INFO nova.compute.manager [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 27 02:33:12 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:33:12 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:33:12 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:33:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:13 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:33:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:33:13 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:33:13 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Took 1.03 seconds to deallocate network for instance.
Aug 27 02:33:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-82731ead-6861-4e73-9f85-70742b9c32a8 req-29bd3189-da2a-4f6d-9bb6-eff09c5c4fd3 service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Received event network-vif-plugged-d901c17c-746e-41ac-8066-cb1d4c4b0d69 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:33:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-82731ead-6861-4e73-9f85-70742b9c32a8 req-29bd3189-da2a-4f6d-9bb6-eff09c5c4fd3 service nova] Acquiring lock "7c42c4ae-0f80-4295-a64e-b426225b94c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-82731ead-6861-4e73-9f85-70742b9c32a8 req-29bd3189-da2a-4f6d-9bb6-eff09c5c4fd3 service nova] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-82731ead-6861-4e73-9f85-70742b9c32a8 req-29bd3189-da2a-4f6d-9bb6-eff09c5c4fd3 service nova] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-82731ead-6861-4e73-9f85-70742b9c32a8 req-29bd3189-da2a-4f6d-9bb6-eff09c5c4fd3 service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] No waiting events found dispatching network-vif-plugged-d901c17c-746e-41ac-8066-cb1d4c4b0d69 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:33:13 user nova-compute[72820]: WARNING nova.compute.manager [req-82731ead-6861-4e73-9f85-70742b9c32a8 req-29bd3189-da2a-4f6d-9bb6-eff09c5c4fd3 service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Received unexpected event network-vif-plugged-d901c17c-746e-41ac-8066-cb1d4c4b0d69 for instance with vm_state deleted and task_state None.
Aug 27 02:33:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-82731ead-6861-4e73-9f85-70742b9c32a8 req-29bd3189-da2a-4f6d-9bb6-eff09c5c4fd3 service nova] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Received event network-vif-deleted-d901c17c-746e-41ac-8066-cb1d4c4b0d69 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:33:13 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:33:13 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:33:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:13 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Deleted allocations for instance 7c42c4ae-0f80-4295-a64e-b426225b94c5
Aug 27 02:33:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-659dccb8-672d-46e8-892e-a4bf387d7a08 tempest-VolumesAdminNegativeTest-1861523875 tempest-VolumesAdminNegativeTest-1861523875-project-member] Lock "7c42c4ae-0f80-4295-a64e-b426225b94c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.705s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:14 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:33:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:14 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:33:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:33:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:33:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:33:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:33:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:33:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:19 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:33:19 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=6869MB free_disk=25.11026382446289GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 26581695-c4b9-40b8-ab7a-34c99db0dadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f8f612f3-41c9-4dae-8d49-218d61720b15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 050e0c2b-9244-4987-b07d-e4712e46f936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1591319d-3d15-4c46-b823-4edddf018b5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 89b66e95-2333-403b-b338-6096717ca20d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 4becc265-4f3d-4f83-a9ac-c99100a870ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance ac2f6797-8b7c-47d3-836d-fc1c617e23dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 94323d83-f8fe-4814-82af-f860a20071bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 85c8fa72-19be-49a0-975f-d6a0d30d011f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 15a1062a-ecfb-42b7-b8e5-03adbd6b8056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:33:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:21 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:33:21 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:33:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:33:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-1591319d-3d15-4c46-b823-4edddf018b5f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:33:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-1591319d-3d15-4c46-b823-4edddf018b5f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:33:21 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:33:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:22 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Updating instance_info_cache with network_info: [{"id": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "address": "fa:16:3e:05:00:70", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb04bdd2-29", "ovs_interfaceid": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:33:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-1591319d-3d15-4c46-b823-4edddf018b5f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:33:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:33:22 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:33:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:25 user nova-compute[72820]: DEBUG nova.compute.manager [req-17c00d15-6c9b-4ba9-b0b2-8bb2e3380935 req-129fc1e1-84db-4a12-b09b-9db8bb06c814 service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received event network-changed-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:33:25 user nova-compute[72820]: DEBUG nova.compute.manager [req-17c00d15-6c9b-4ba9-b0b2-8bb2e3380935 req-129fc1e1-84db-4a12-b09b-9db8bb06c814 service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Refreshing instance network info cache due to event network-changed-03bf65d2-99ae-4eea-863b-3edc35e19dd4. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:33:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-17c00d15-6c9b-4ba9-b0b2-8bb2e3380935 req-129fc1e1-84db-4a12-b09b-9db8bb06c814 service nova] Acquiring lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:33:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-17c00d15-6c9b-4ba9-b0b2-8bb2e3380935 req-129fc1e1-84db-4a12-b09b-9db8bb06c814 service nova] Acquired lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:33:25 user nova-compute[72820]: DEBUG nova.network.neutron [req-17c00d15-6c9b-4ba9-b0b2-8bb2e3380935 req-129fc1e1-84db-4a12-b09b-9db8bb06c814 service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Refreshing network info cache for port 03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:33:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "94323d83-f8fe-4814-82af-f860a20071bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "94323d83-f8fe-4814-82af-f860a20071bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "94323d83-f8fe-4814-82af-f860a20071bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "94323d83-f8fe-4814-82af-f860a20071bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "94323d83-f8fe-4814-82af-f860a20071bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:25 user nova-compute[72820]: INFO nova.compute.manager [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Terminating instance
Aug 27 02:33:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:33:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG nova.network.neutron [req-17c00d15-6c9b-4ba9-b0b2-8bb2e3380935 req-129fc1e1-84db-4a12-b09b-9db8bb06c814 service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Updated VIF entry in instance network info cache for port 03bf65d2-99ae-4eea-863b-3edc35e19dd4. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG nova.network.neutron [req-17c00d15-6c9b-4ba9-b0b2-8bb2e3380935 req-129fc1e1-84db-4a12-b09b-9db8bb06c814 service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Updating instance_info_cache with network_info: [{"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-17c00d15-6c9b-4ba9-b0b2-8bb2e3380935 req-129fc1e1-84db-4a12-b09b-9db8bb06c814 service nova] Releasing lock "refresh_cache-94323d83-f8fe-4814-82af-f860a20071bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:33:26 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Instance destroyed successfully.
Aug 27 02:33:26 user nova-compute[72820]: DEBUG nova.objects.instance [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lazy-loading 'resources' on Instance uuid 94323d83-f8fe-4814-82af-f860a20071bf {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T02:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1937387142',display_name='tempest-TestShelveInstance-server-1937387142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1937387142',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTe/Ws++PTjVd38AijjMR1+3JeXnwOZ3a2pV/iawjQkNYhlRUt5WM3DtBBg+vTai/JuZmVSemEe8iX7whVOhmmkcL7ICmzX59GN2erKSMY/1YIdlhzg0vy84VQcjCbfyw==',key_name='tempest-TestShelveInstance-1669796109',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:31:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbf36cee8a5645d5950878c914bf1f85',ramdisk_id='',reservation_id='r-u2u632ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1813275073',owner_user_name='tempest-TestShelveInstance-1813275073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:31:55Z,user_data=None,user_id='4863de7cf43b4c8599cfc292b3308f56',uuid=94323d83-f8fe-4814-82af-f860a20071bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Converting VIF {"id": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "address": "fa:16:3e:bb:1b:59", "network": {"id": "36de333f-9660-4657-89e8-fd4409b55471", "bridge": "br-int", "label": "tempest-TestShelveInstance-2098459723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbf36cee8a5645d5950878c914bf1f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf65d2-99", "ovs_interfaceid": "03bf65d2-99ae-4eea-863b-3edc35e19dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:59,bridge_name='br-int',has_traffic_filtering=True,id=03bf65d2-99ae-4eea-863b-3edc35e19dd4,network=Network(36de333f-9660-4657-89e8-fd4409b55471),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf65d2-99') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_vif [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:59,bridge_name='br-int',has_traffic_filtering=True,id=03bf65d2-99ae-4eea-863b-3edc35e19dd4,network=Network(36de333f-9660-4657-89e8-fd4409b55471),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf65d2-99') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03bf65d2-99, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:26 user nova-compute[72820]: INFO os_vif [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:59,bridge_name='br-int',has_traffic_filtering=True,id=03bf65d2-99ae-4eea-863b-3edc35e19dd4,network=Network(36de333f-9660-4657-89e8-fd4409b55471),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf65d2-99')
Aug 27 02:33:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIGKvAka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:33:26 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[64caa7e6-0699-4e30-99f9-666a05e1c5ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:33:26 user nova-compute[72820]: No targets found.
Aug 27 02:33:26 user nova-compute[72820]: iSNS:
Aug 27 02:33:26 user nova-compute[72820]: No targets found.
Aug 27 02:33:26 user nova-compute[72820]: STATIC:
Aug 27 02:33:26 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37
Aug 27 02:33:26 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:33:26 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:33:26 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1
Aug 27 02:33:26 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:33:26 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:33:26 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:33:26 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:33:26 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:33:26 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf
Aug 27 02:33:26 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:33:26 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:33:26 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e
Aug 27 02:33:26 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:33:26 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:33:26 user nova-compute[72820]: FIRMWARE:
Aug 27 02:33:26 user nova-compute[72820]: No targets found.
Aug 27 02:33:26 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:33:26 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:33:26 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[558bc68e-71e2-4080-999a-4c28170d67f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[235a29f4-8da1-4563-8580-0545f5a9eeba]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:33:26 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:33:26 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:33:26 user nova-compute[72820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:33:26 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:33:26 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:33:26 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:33:26 user nova-compute[72820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 (non-flash)
Aug 27 02:33:26 user nova-compute[72820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:33:26 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:33:26 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75cd959cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37'): ({'sdc'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Removing single pathed devices sdc {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09a8722-8a1c-4071-aa30-e91dbd9aea9e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[14611208-fa63-46bc-9659-237c79557700]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Flushing IO for device /dev/sdc {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[905dc8cd-ac52-4b5a-8f24-f503489cee37]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fe9339-cf96-449e-85fd-88db90600601]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_94b70586', '/dev/disk/by-id/scsi-1SCST_BIO94b70586-98f10c1d1464487e', '/dev/disk/by-id/scsi-23938663130633164') {{(pid=84057) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddffab0-1f9d-4f5e-be33-308185de6841]: (4, None) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb79fc0c-a0b0-430d-b345-dc4efce54c3d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d4709e-7070-40bc-8c54-498d593ce85a]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37, portal: 172.16.0.220,3260]
Aug 27 02:33:26 user nova-compute[72820]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37, portal: 172.16.0.220,3260] successful.
Aug 27 02:33:26 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497c2055-ee13-45f0-8652-3ac5ba9b8c37 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[756f895c-a147-4f38-97b2-3fe738d1edaa]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] <== disconnect_volume: return (309ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:33:26 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Deleting instance files /opt/stack/data/nova/instances/94323d83-f8fe-4814-82af-f860a20071bf_del
Aug 27 02:33:26 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Deletion of /opt/stack/data/nova/instances/94323d83-f8fe-4814-82af-f860a20071bf_del complete
Aug 27 02:33:26 user nova-compute[72820]: INFO nova.compute.manager [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 27 02:33:26 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:33:26 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:33:27 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103592.2144911, 7c42c4ae-0f80-4295-a64e-b426225b94c5 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:33:27 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] VM Stopped (Lifecycle Event)
Aug 27 02:33:27 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ecc84b75-df6f-465d-8dae-818363618f85 None None] [instance: 7c42c4ae-0f80-4295-a64e-b426225b94c5] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:33:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:27 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:33:27 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Took 0.57 seconds to deallocate network for instance.
Aug 27 02:33:27 user nova-compute[72820]: DEBUG nova.compute.manager [req-ac0aec0f-a33b-4b34-a998-4e5014caa038 req-37b4343c-ab55-4109-9c26-87fe91ffaa97 service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received event network-vif-deleted-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:33:27 user nova-compute[72820]: DEBUG nova.compute.manager [req-6420c3f8-44dc-4b64-aac1-2a46bc5040bc req-eed7da66-2f86-4cf5-b2d1-4c4170cb431b service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received event network-vif-unplugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:33:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6420c3f8-44dc-4b64-aac1-2a46bc5040bc req-eed7da66-2f86-4cf5-b2d1-4c4170cb431b service nova] Acquiring lock "94323d83-f8fe-4814-82af-f860a20071bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6420c3f8-44dc-4b64-aac1-2a46bc5040bc req-eed7da66-2f86-4cf5-b2d1-4c4170cb431b service nova] Lock "94323d83-f8fe-4814-82af-f860a20071bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6420c3f8-44dc-4b64-aac1-2a46bc5040bc req-eed7da66-2f86-4cf5-b2d1-4c4170cb431b service nova] Lock "94323d83-f8fe-4814-82af-f860a20071bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:27 user nova-compute[72820]: DEBUG nova.compute.manager [req-6420c3f8-44dc-4b64-aac1-2a46bc5040bc req-eed7da66-2f86-4cf5-b2d1-4c4170cb431b service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] No waiting events found dispatching network-vif-unplugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:33:27 user nova-compute[72820]: DEBUG nova.compute.manager [req-6420c3f8-44dc-4b64-aac1-2a46bc5040bc req-eed7da66-2f86-4cf5-b2d1-4c4170cb431b service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received event network-vif-unplugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:33:27 user nova-compute[72820]: DEBUG nova.compute.manager [req-6420c3f8-44dc-4b64-aac1-2a46bc5040bc req-eed7da66-2f86-4cf5-b2d1-4c4170cb431b service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received event network-vif-plugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:33:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6420c3f8-44dc-4b64-aac1-2a46bc5040bc req-eed7da66-2f86-4cf5-b2d1-4c4170cb431b service nova] Acquiring lock "94323d83-f8fe-4814-82af-f860a20071bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6420c3f8-44dc-4b64-aac1-2a46bc5040bc req-eed7da66-2f86-4cf5-b2d1-4c4170cb431b service nova] Lock "94323d83-f8fe-4814-82af-f860a20071bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6420c3f8-44dc-4b64-aac1-2a46bc5040bc req-eed7da66-2f86-4cf5-b2d1-4c4170cb431b service nova] Lock "94323d83-f8fe-4814-82af-f860a20071bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:27 user nova-compute[72820]: DEBUG nova.compute.manager [req-6420c3f8-44dc-4b64-aac1-2a46bc5040bc req-eed7da66-2f86-4cf5-b2d1-4c4170cb431b service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] No waiting events found dispatching network-vif-plugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:33:27 user nova-compute[72820]: WARNING nova.compute.manager [req-6420c3f8-44dc-4b64-aac1-2a46bc5040bc req-eed7da66-2f86-4cf5-b2d1-4c4170cb431b service nova] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Received unexpected event network-vif-plugged-03bf65d2-99ae-4eea-863b-3edc35e19dd4 for instance with vm_state active and task_state deleting.
Aug 27 02:33:28 user nova-compute[72820]: INFO nova.compute.manager [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Took 0.76 seconds to detach 1 volumes for instance.
Aug 27 02:33:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Deleting volume: 497c2055-ee13-45f0-8652-3ac5ba9b8c37 {{(pid=72820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 02:33:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:28 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:33:28 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:33:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:28 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Deleted allocations for instance 94323d83-f8fe-4814-82af-f860a20071bf
Aug 27 02:33:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-41f44944-c1a3-493c-8bc4-de2b1043bc3b tempest-TestShelveInstance-1813275073 tempest-TestShelveInstance-1813275073-project-member] Lock "94323d83-f8fe-4814-82af-f860a20071bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.114s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG nova.objects.instance [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'flavor' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "refresh_cache-050e0c2b-9244-4987-b07d-e4712e46f936" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquired lock "refresh_cache-050e0c2b-9244-4987-b07d-e4712e46f936" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG nova.objects.instance [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'info_cache' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG nova.objects.base [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Object Instance<050e0c2b-9244-4987-b07d-e4712e46f936> lazy-loaded attributes: flavor,info_cache {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG nova.network.neutron [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Updating instance_info_cache with network_info: [{"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Releasing lock "refresh_cache-050e0c2b-9244-4987-b07d-e4712e46f936" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:33:36 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Instance destroyed successfully.
Aug 27 02:33:36 user nova-compute[72820]: DEBUG nova.objects.instance [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'resources' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG nova.objects.base [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Object Instance<050e0c2b-9244-4987-b07d-e4712e46f936> lazy-loaded attributes: flavor,info_cache,resources {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1528827756',display_name='tempest-AttachVolumeTestJSON-server-1528827756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1528827756',id=14,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnSgUcneqrQT+fSR64ZBXTU7w6gH3FRUC28AIjZT1OTuPJeA2iK/PRvmUdcnaeRQRx9F2cfuohCq3KKKqoUGjjYwRrOZbZ+RipxFTfAfbkjmPR9pHpU0nOexJ+36eDqvA==',key_name='tempest-keypair-290646663',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a70199cb55f74880a86a7f4d2342054e',ramdisk_id='',reservation_id='r-iy5ykdf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-316094052',owner_user_name='tempest-AttachVolumeTestJSON-316094052-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbbf87fbd76543bab71f44d664bec48c',uuid=050e0c2b-9244-4987-b07d-e4712e46f936,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converting VIF {"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG os_vif [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6c019c8-6c, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:33:36 user nova-compute[72820]: INFO os_vif [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c')
Aug 27 02:33:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Start _get_guest_xml network_info=[{"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:33:36 user nova-compute[72820]: DEBUG nova.objects.instance [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'numa_topology' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.objects.base [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Object Instance<050e0c2b-9244-4987-b07d-e4712e46f936> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:33:37 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:33:37 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.objects.instance [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'vcpu_model' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.objects.base [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Object Instance<050e0c2b-9244-4987-b07d-e4712e46f936> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1528827756',display_name='tempest-AttachVolumeTestJSON-server-1528827756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1528827756',id=14,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnSgUcneqrQT+fSR64ZBXTU7w6gH3FRUC28AIjZT1OTuPJeA2iK/PRvmUdcnaeRQRx9F2cfuohCq3KKKqoUGjjYwRrOZbZ+RipxFTfAfbkjmPR9pHpU0nOexJ+36eDqvA==',key_name='tempest-keypair-290646663',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a70199cb55f74880a86a7f4d2342054e',ramdisk_id='',reservation_id='r-iy5ykdf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-316094052',owner_user_name='tempest-AttachVolumeTestJSON-316094052-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbbf87fbd76543bab71f44d664bec48c',uuid=050e0c2b-9244-4987-b07d-e4712e46f936,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converting VIF {"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.objects.instance [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'pci_devices' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.objects.base [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Object Instance<050e0c2b-9244-4987-b07d-e4712e46f936> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:33:37 user nova-compute[72820]:   <uuid>050e0c2b-9244-4987-b07d-e4712e46f936</uuid>
Aug 27 02:33:37 user nova-compute[72820]:   <name>instance-0000000e</name>
Aug 27 02:33:37 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:33:37 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:33:37 user nova-compute[72820]:   <metadata>
Aug 27 02:33:37 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:33:37 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:33:37 user nova-compute[72820]:       <nova:name>tempest-AttachVolumeTestJSON-server-1528827756</nova:name>
Aug 27 02:33:37 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:33:37</nova:creationTime>
Aug 27 02:33:37 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:33:37 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:33:37 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:33:37 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:33:37 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:33:37 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:33:37 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:33:37 user nova-compute[72820]:       <nova:owner>
Aug 27 02:33:37 user nova-compute[72820]:         <nova:user uuid="bbbf87fbd76543bab71f44d664bec48c">tempest-AttachVolumeTestJSON-316094052-project-member</nova:user>
Aug 27 02:33:37 user nova-compute[72820]:         <nova:project uuid="a70199cb55f74880a86a7f4d2342054e">tempest-AttachVolumeTestJSON-316094052</nova:project>
Aug 27 02:33:37 user nova-compute[72820]:       </nova:owner>
Aug 27 02:33:37 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:33:37 user nova-compute[72820]:       <nova:ports>
Aug 27 02:33:37 user nova-compute[72820]:         <nova:port uuid="a6c019c8-6c53-44fd-a6f0-004d2f9b5a55">
Aug 27 02:33:37 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 02:33:37 user nova-compute[72820]:         </nova:port>
Aug 27 02:33:37 user nova-compute[72820]:       </nova:ports>
Aug 27 02:33:37 user nova-compute[72820]:     </nova:instance>
Aug 27 02:33:37 user nova-compute[72820]:   </metadata>
Aug 27 02:33:37 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:33:37 user nova-compute[72820]:     <system>
Aug 27 02:33:37 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:33:37 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:33:37 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:33:37 user nova-compute[72820]:       <entry name="serial">050e0c2b-9244-4987-b07d-e4712e46f936</entry>
Aug 27 02:33:37 user nova-compute[72820]:       <entry name="uuid">050e0c2b-9244-4987-b07d-e4712e46f936</entry>
Aug 27 02:33:37 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:33:37 user nova-compute[72820]:     </system>
Aug 27 02:33:37 user nova-compute[72820]:   </sysinfo>
Aug 27 02:33:37 user nova-compute[72820]:   <os>
Aug 27 02:33:37 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:33:37 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:33:37 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:33:37 user nova-compute[72820]:   </os>
Aug 27 02:33:37 user nova-compute[72820]:   <features>
Aug 27 02:33:37 user nova-compute[72820]:     <acpi/>
Aug 27 02:33:37 user nova-compute[72820]:     <apic/>
Aug 27 02:33:37 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:33:37 user nova-compute[72820]:   </features>
Aug 27 02:33:37 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:33:37 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:33:37 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:33:37 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:33:37 user nova-compute[72820]:   </clock>
Aug 27 02:33:37 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:33:37 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:33:37 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:33:37 user nova-compute[72820]:   </cpu>
Aug 27 02:33:37 user nova-compute[72820]:   <devices>
Aug 27 02:33:37 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:33:37 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:33:37 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk"/>
Aug 27 02:33:37 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:33:37 user nova-compute[72820]:     </disk>
Aug 27 02:33:37 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:33:37 user nova-compute[72820]:       <mac address="fa:16:3e:a4:94:7e"/>
Aug 27 02:33:37 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:33:37 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:33:37 user nova-compute[72820]:       <target dev="tapa6c019c8-6c"/>
Aug 27 02:33:37 user nova-compute[72820]:     </interface>
Aug 27 02:33:37 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:33:37 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/console.log" append="off"/>
Aug 27 02:33:37 user nova-compute[72820]:     </serial>
Aug 27 02:33:37 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:33:37 user nova-compute[72820]:     <video>
Aug 27 02:33:37 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:33:37 user nova-compute[72820]:     </video>
Aug 27 02:33:37 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:33:37 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:33:37 user nova-compute[72820]:     </rng>
Aug 27 02:33:37 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:33:37 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:33:37 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:33:37 user nova-compute[72820]:     </memballoon>
Aug 27 02:33:37 user nova-compute[72820]:   </devices>
Aug 27 02:33:37 user nova-compute[72820]: </domain>
Aug 27 02:33:37 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.objects.instance [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'trusted_certs' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.objects.base [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Object Instance<050e0c2b-9244-4987-b07d-e4712e46f936> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.181s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Checking if we can resize image /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Cannot resize image /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.objects.instance [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'migration_context' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.objects.base [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Object Instance<050e0c2b-9244-4987-b07d-e4712e46f936> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1528827756',display_name='tempest-AttachVolumeTestJSON-server-1528827756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1528827756',id=14,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnSgUcneqrQT+fSR64ZBXTU7w6gH3FRUC28AIjZT1OTuPJeA2iK/PRvmUdcnaeRQRx9F2cfuohCq3KKKqoUGjjYwRrOZbZ+RipxFTfAfbkjmPR9pHpU0nOexJ+36eDqvA==',key_name='tempest-keypair-290646663',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a70199cb55f74880a86a7f4d2342054e',ramdisk_id='',reservation_id='r-iy5ykdf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-316094052',owner_user_name='tempest-AttachVolumeTestJSON-316094052-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbbf87fbd76543bab71f44d664bec48c',uuid=050e0c2b-9244-4987-b07d-e4712e46f936,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converting VIF {"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG os_vif [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6c019c8-6c, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa6c019c8-6c, col_values=(('external_ids', {'iface-id': 'a6c019c8-6c53-44fd-a6f0-004d2f9b5a55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:94:7e', 'vm-uuid': '050e0c2b-9244-4987-b07d-e4712e46f936'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:33:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:37 user nova-compute[72820]: INFO os_vif [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c')
Aug 27 02:33:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-3c6ee6ba-ac70-42e8-8c49-8d249cde5cf9 req-4724cf3d-d5dc-4b42-9b83-0791890dcc9a service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received event network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:33:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3c6ee6ba-ac70-42e8-8c49-8d249cde5cf9 req-4724cf3d-d5dc-4b42-9b83-0791890dcc9a service nova] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3c6ee6ba-ac70-42e8-8c49-8d249cde5cf9 req-4724cf3d-d5dc-4b42-9b83-0791890dcc9a service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3c6ee6ba-ac70-42e8-8c49-8d249cde5cf9 req-4724cf3d-d5dc-4b42-9b83-0791890dcc9a service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-3c6ee6ba-ac70-42e8-8c49-8d249cde5cf9 req-4724cf3d-d5dc-4b42-9b83-0791890dcc9a service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] No waiting events found dispatching network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:33:39 user nova-compute[72820]: WARNING nova.compute.manager [req-3c6ee6ba-ac70-42e8-8c49-8d249cde5cf9 req-4724cf3d-d5dc-4b42-9b83-0791890dcc9a service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received unexpected event network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 for instance with vm_state stopped and task_state powering-on.
Aug 27 02:33:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:41 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103621.4357765, 050e0c2b-9244-4987-b07d-e4712e46f936 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:33:41 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] VM Resumed (Lifecycle Event)
Aug 27 02:33:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:33:41 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Instance rebooted successfully.
Aug 27 02:33:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3277e4aa-e808-44e6-aa11-b9a964e03975 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:33:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:33:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:33:41 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 27 02:33:41 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103621.4407878, 050e0c2b-9244-4987-b07d-e4712e46f936 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:33:41 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] VM Started (Lifecycle Event)
Aug 27 02:33:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:33:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:33:41 user nova-compute[72820]: DEBUG nova.compute.manager [req-b419d20c-41ec-4a12-b62e-ba79bb60b5a5 req-6146bac1-626e-4723-906b-b268c2291b28 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received event network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:33:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b419d20c-41ec-4a12-b62e-ba79bb60b5a5 req-6146bac1-626e-4723-906b-b268c2291b28 service nova] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b419d20c-41ec-4a12-b62e-ba79bb60b5a5 req-6146bac1-626e-4723-906b-b268c2291b28 service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b419d20c-41ec-4a12-b62e-ba79bb60b5a5 req-6146bac1-626e-4723-906b-b268c2291b28 service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:41 user nova-compute[72820]: DEBUG nova.compute.manager [req-b419d20c-41ec-4a12-b62e-ba79bb60b5a5 req-6146bac1-626e-4723-906b-b268c2291b28 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] No waiting events found dispatching network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:33:41 user nova-compute[72820]: WARNING nova.compute.manager [req-b419d20c-41ec-4a12-b62e-ba79bb60b5a5 req-6146bac1-626e-4723-906b-b268c2291b28 service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received unexpected event network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 for instance with vm_state stopped and task_state powering-on.
Aug 27 02:33:41 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103606.524575, 94323d83-f8fe-4814-82af-f860a20071bf => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:33:41 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] VM Stopped (Lifecycle Event)
Aug 27 02:33:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-9d988c3a-04c9-4b53-a05a-31139e0c7139 None None] [instance: 94323d83-f8fe-4814-82af-f860a20071bf] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:33:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "4becc265-4f3d-4f83-a9ac-c99100a870ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:44 user nova-compute[72820]: INFO nova.compute.manager [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Terminating instance
Aug 27 02:33:44 user nova-compute[72820]: DEBUG nova.compute.manager [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:33:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:44 user nova-compute[72820]: DEBUG nova.compute.manager [req-207d20f4-b6a7-4a79-80ac-8a9ba575a053 req-983c70e7-945b-45e5-aee8-7449d8bb298a service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Received event network-vif-unplugged-bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:33:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-207d20f4-b6a7-4a79-80ac-8a9ba575a053 req-983c70e7-945b-45e5-aee8-7449d8bb298a service nova] Acquiring lock "4becc265-4f3d-4f83-a9ac-c99100a870ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-207d20f4-b6a7-4a79-80ac-8a9ba575a053 req-983c70e7-945b-45e5-aee8-7449d8bb298a service nova] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-207d20f4-b6a7-4a79-80ac-8a9ba575a053 req-983c70e7-945b-45e5-aee8-7449d8bb298a service nova] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:44 user nova-compute[72820]: DEBUG nova.compute.manager [req-207d20f4-b6a7-4a79-80ac-8a9ba575a053 req-983c70e7-945b-45e5-aee8-7449d8bb298a service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] No waiting events found dispatching network-vif-unplugged-bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:33:44 user nova-compute[72820]: DEBUG nova.compute.manager [req-207d20f4-b6a7-4a79-80ac-8a9ba575a053 req-983c70e7-945b-45e5-aee8-7449d8bb298a service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Received event network-vif-unplugged-bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:33:45 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Instance destroyed successfully.
Aug 27 02:33:45 user nova-compute[72820]: DEBUG nova.objects.instance [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lazy-loading 'resources' on Instance uuid 4becc265-4f3d-4f83-a9ac-c99100a870ff {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:33:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:29:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1898566739',display_name='tempest-TestServerVolumeAttachmentScenario-server-1898566739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1898566739',id=22,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFP+coPRpBylk52REDP+mkyumO81JyK+gqbVexAR60ZJzkXK961Oj38U8NDVNnz8Nuit1ORYLVX1+y2o06cai7IE0yKpBLBL/lVlto4q0eWPd7vHwECBdpQJ0dam/5dV9g==',key_name='tempest-keypair-1781491230',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:29:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf987dacdf44dc4807c74d4aa283357',ramdisk_id='',reservation_id='r-xbt4xpy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1979275595',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1979275595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:29:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e735f5da8264ad3aff41701162c4d48',uuid=4becc265-4f3d-4f83-a9ac-c99100a870ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "address": "fa:16:3e:ec:8f:95", "network": {"id": "39de3116-51df-478a-bead-efb89526d4d2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-127107834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf987dacdf44dc4807c74d4aa283357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcc2e999-9d", "ovs_interfaceid": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:33:45 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Converting VIF {"id": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "address": "fa:16:3e:ec:8f:95", "network": {"id": "39de3116-51df-478a-bead-efb89526d4d2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-127107834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf987dacdf44dc4807c74d4aa283357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcc2e999-9d", "ovs_interfaceid": "bcc2e999-9d21-4d4c-84b8-b29ffddfedb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:33:45 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:8f:95,bridge_name='br-int',has_traffic_filtering=True,id=bcc2e999-9d21-4d4c-84b8-b29ffddfedb9,network=Network(39de3116-51df-478a-bead-efb89526d4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcc2e999-9d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:33:45 user nova-compute[72820]: DEBUG os_vif [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:8f:95,bridge_name='br-int',has_traffic_filtering=True,id=bcc2e999-9d21-4d4c-84b8-b29ffddfedb9,network=Network(39de3116-51df-478a-bead-efb89526d4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcc2e999-9d') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:33:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcc2e999-9d, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:33:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:33:45 user nova-compute[72820]: INFO os_vif [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:8f:95,bridge_name='br-int',has_traffic_filtering=True,id=bcc2e999-9d21-4d4c-84b8-b29ffddfedb9,network=Network(39de3116-51df-478a-bead-efb89526d4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcc2e999-9d')
Aug 27 02:33:45 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Deleting instance files /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff_del
Aug 27 02:33:45 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Deletion of /opt/stack/data/nova/instances/4becc265-4f3d-4f83-a9ac-c99100a870ff_del complete
Aug 27 02:33:45 user nova-compute[72820]: INFO nova.compute.manager [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 27 02:33:45 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:33:45 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:33:45 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:33:46 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:33:46 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Took 0.85 seconds to deallocate network for instance.
Aug 27 02:33:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:46 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:33:46 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:33:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:46 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Deleted allocations for instance 4becc265-4f3d-4f83-a9ac-c99100a870ff
Aug 27 02:33:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-33d125e4-d00e-4829-8047-7b052e6f66a6 tempest-TestServerVolumeAttachmentScenario-1979275595 tempest-TestServerVolumeAttachmentScenario-1979275595-project-member] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.273s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:46 user nova-compute[72820]: DEBUG nova.compute.manager [req-8f5e1173-4626-43bf-9b1a-b07256f5ea81 req-3d495ef1-74bb-4b8f-b206-3db5d5fa94dd service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Received event network-vif-plugged-bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:33:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8f5e1173-4626-43bf-9b1a-b07256f5ea81 req-3d495ef1-74bb-4b8f-b206-3db5d5fa94dd service nova] Acquiring lock "4becc265-4f3d-4f83-a9ac-c99100a870ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:33:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8f5e1173-4626-43bf-9b1a-b07256f5ea81 req-3d495ef1-74bb-4b8f-b206-3db5d5fa94dd service nova] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:33:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8f5e1173-4626-43bf-9b1a-b07256f5ea81 req-3d495ef1-74bb-4b8f-b206-3db5d5fa94dd service nova] Lock "4becc265-4f3d-4f83-a9ac-c99100a870ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:33:46 user nova-compute[72820]: DEBUG nova.compute.manager [req-8f5e1173-4626-43bf-9b1a-b07256f5ea81 req-3d495ef1-74bb-4b8f-b206-3db5d5fa94dd service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] No waiting events found dispatching network-vif-plugged-bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:33:46 user nova-compute[72820]: WARNING nova.compute.manager [req-8f5e1173-4626-43bf-9b1a-b07256f5ea81 req-3d495ef1-74bb-4b8f-b206-3db5d5fa94dd service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Received unexpected event network-vif-plugged-bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 for instance with vm_state deleted and task_state None.
Aug 27 02:33:46 user nova-compute[72820]: DEBUG nova.compute.manager [req-8f5e1173-4626-43bf-9b1a-b07256f5ea81 req-3d495ef1-74bb-4b8f-b206-3db5d5fa94dd service nova] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Received event network-vif-deleted-bcc2e999-9d21-4d4c-84b8-b29ffddfedb9 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:33:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:33:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:33:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:00 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103625.1237903, 4becc265-4f3d-4f83-a9ac-c99100a870ff => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:34:00 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] VM Stopped (Lifecycle Event)
Aug 27 02:34:00 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2e3c8d1c-c640-40d4-ab43-2e5b03c4e48f None None] [instance: 4becc265-4f3d-4f83-a9ac-c99100a870ff] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:34:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-969dfae4-ad1e-4391-8330-ca94e74c152d req-c3803202-4b77-4f89-87c8-ff7c3dd1a562 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Received event network-changed-a0280116-060c-4078-b415-7abd9005c221 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:34:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-969dfae4-ad1e-4391-8330-ca94e74c152d req-c3803202-4b77-4f89-87c8-ff7c3dd1a562 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Refreshing instance network info cache due to event network-changed-a0280116-060c-4078-b415-7abd9005c221. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:34:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-969dfae4-ad1e-4391-8330-ca94e74c152d req-c3803202-4b77-4f89-87c8-ff7c3dd1a562 service nova] Acquiring lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:34:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-969dfae4-ad1e-4391-8330-ca94e74c152d req-c3803202-4b77-4f89-87c8-ff7c3dd1a562 service nova] Acquired lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:34:01 user nova-compute[72820]: DEBUG nova.network.neutron [req-969dfae4-ad1e-4391-8330-ca94e74c152d req-c3803202-4b77-4f89-87c8-ff7c3dd1a562 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Refreshing network info cache for port a0280116-060c-4078-b415-7abd9005c221 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:34:01 user nova-compute[72820]: DEBUG nova.network.neutron [req-969dfae4-ad1e-4391-8330-ca94e74c152d req-c3803202-4b77-4f89-87c8-ff7c3dd1a562 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Updated VIF entry in instance network info cache for port a0280116-060c-4078-b415-7abd9005c221. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:34:01 user nova-compute[72820]: DEBUG nova.network.neutron [req-969dfae4-ad1e-4391-8330-ca94e74c152d req-c3803202-4b77-4f89-87c8-ff7c3dd1a562 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Updating instance_info_cache with network_info: [{"id": "a0280116-060c-4078-b415-7abd9005c221", "address": "fa:16:3e:dc:2f:1b", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0280116-06", "ovs_interfaceid": "a0280116-060c-4078-b415-7abd9005c221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:34:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-969dfae4-ad1e-4391-8330-ca94e74c152d req-c3803202-4b77-4f89-87c8-ff7c3dd1a562 service nova] Releasing lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:34:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:03 user nova-compute[72820]: DEBUG nova.compute.manager [req-f75bc980-cf61-4c3a-a1cd-2b1a7b6680ea req-856adfb4-5861-4521-b51a-c6dc070759f4 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received event network-changed-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:34:03 user nova-compute[72820]: DEBUG nova.compute.manager [req-f75bc980-cf61-4c3a-a1cd-2b1a7b6680ea req-856adfb4-5861-4521-b51a-c6dc070759f4 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Refreshing instance network info cache due to event network-changed-b1cbacdf-27a3-48f2-8c08-e77c49f40d81. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:34:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f75bc980-cf61-4c3a-a1cd-2b1a7b6680ea req-856adfb4-5861-4521-b51a-c6dc070759f4 service nova] Acquiring lock "refresh_cache-85c8fa72-19be-49a0-975f-d6a0d30d011f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:34:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f75bc980-cf61-4c3a-a1cd-2b1a7b6680ea req-856adfb4-5861-4521-b51a-c6dc070759f4 service nova] Acquired lock "refresh_cache-85c8fa72-19be-49a0-975f-d6a0d30d011f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:34:03 user nova-compute[72820]: DEBUG nova.network.neutron [req-f75bc980-cf61-4c3a-a1cd-2b1a7b6680ea req-856adfb4-5861-4521-b51a-c6dc070759f4 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Refreshing network info cache for port b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:34:03 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Stashing vm_state: active {{(pid=72820) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 27 02:34:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:34:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:34:03 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:34:03 user nova-compute[72820]: INFO nova.compute.claims [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Claim successful on node user
Aug 27 02:34:03 user nova-compute[72820]: INFO nova.compute.resource_tracker [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Updating resource usage from migration 01c10d77-2a8d-4c0d-ade7-6dff4d4e8b27
Aug 27 02:34:04 user nova-compute[72820]: DEBUG nova.network.neutron [req-f75bc980-cf61-4c3a-a1cd-2b1a7b6680ea req-856adfb4-5861-4521-b51a-c6dc070759f4 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Updated VIF entry in instance network info cache for port b1cbacdf-27a3-48f2-8c08-e77c49f40d81. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:34:04 user nova-compute[72820]: DEBUG nova.network.neutron [req-f75bc980-cf61-4c3a-a1cd-2b1a7b6680ea req-856adfb4-5861-4521-b51a-c6dc070759f4 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Updating instance_info_cache with network_info: [{"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:34:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f75bc980-cf61-4c3a-a1cd-2b1a7b6680ea req-856adfb4-5861-4521-b51a-c6dc070759f4 service nova] Releasing lock "refresh_cache-85c8fa72-19be-49a0-975f-d6a0d30d011f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:34:04 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:34:04 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:34:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.453s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:34:04 user nova-compute[72820]: INFO nova.compute.manager [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Migrating
Aug 27 02:34:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "refresh_cache-85c8fa72-19be-49a0-975f-d6a0d30d011f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:34:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquired lock "refresh_cache-85c8fa72-19be-49a0-975f-d6a0d30d011f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:34:04 user nova-compute[72820]: DEBUG nova.network.neutron [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:34:04 user nova-compute[72820]: DEBUG nova.network.neutron [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Updating instance_info_cache with network_info: [{"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:34:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Releasing lock "refresh_cache-85c8fa72-19be-49a0-975f-d6a0d30d011f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:34:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Starting migrate_disk_and_power_off {{(pid=72820) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG nova.compute.manager [req-1506fdde-3715-486c-bdb1-ef2d9129668c req-95c6fd92-0f93-4be1-bf19-74b79c975597 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received event network-vif-unplugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1506fdde-3715-486c-bdb1-ef2d9129668c req-95c6fd92-0f93-4be1-bf19-74b79c975597 service nova] Acquiring lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1506fdde-3715-486c-bdb1-ef2d9129668c req-95c6fd92-0f93-4be1-bf19-74b79c975597 service nova] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1506fdde-3715-486c-bdb1-ef2d9129668c req-95c6fd92-0f93-4be1-bf19-74b79c975597 service nova] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG nova.compute.manager [req-1506fdde-3715-486c-bdb1-ef2d9129668c req-95c6fd92-0f93-4be1-bf19-74b79c975597 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] No waiting events found dispatching network-vif-unplugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:34:05 user nova-compute[72820]: WARNING nova.compute.manager [req-1506fdde-3715-486c-bdb1-ef2d9129668c req-95c6fd92-0f93-4be1-bf19-74b79c975597 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received unexpected event network-vif-unplugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 for instance with vm_state active and task_state resize_migrating.
Aug 27 02:34:05 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Instance destroyed successfully.
Aug 27 02:34:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-831814397',display_name='tempest-ServerActionsTestOtherA-server-831814397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-831814397',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuMDNJccFoG9J2MvjXPhebjkkaCvYt2BV0fWoVRWE0WGnLVqeM0TmypkIBpwP+aIP0dc17AS8ytt0zxz7hB47f2I8lo+2akMvc3UtIkl7mLDLkN7AXVg520jT6ETK7MXw==',key_name='tempest-keypair-1957607282',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:32:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7797569db44f40f193483e6e6933a0d0',ramdisk_id='',reservation_id='r-ggl9724x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-892102693',owner_user_name='tempest-ServerActionsTestOtherA-892102693-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='275f713edfd042d4b4fa32620956484a',uuid=85c8fa72-19be-49a0-975f-d6a0d30d011f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1493967525-network", "vif_mac": "fa:16:3e:52:bd:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converting VIF {"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1493967525-network", "vif_mac": "fa:16:3e:52:bd:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:bd:22,bridge_name='br-int',has_traffic_filtering=True,id=b1cbacdf-27a3-48f2-8c08-e77c49f40d81,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cbacdf-27') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG os_vif [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:bd:22,bridge_name='br-int',has_traffic_filtering=True,id=b1cbacdf-27a3-48f2-8c08-e77c49f40d81,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cbacdf-27') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1cbacdf-27, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:05 user nova-compute[72820]: INFO os_vif [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:bd:22,bridge_name='br-int',has_traffic_filtering=True,id=b1cbacdf-27a3-48f2-8c08-e77c49f40d81,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cbacdf-27')
Aug 27 02:34:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bWCZxFLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:34:05 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:34:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3e949c-3347-431f-8468-693262d1f6a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:34:05 user nova-compute[72820]: No targets found.
Aug 27 02:34:05 user nova-compute[72820]: iSNS:
Aug 27 02:34:05 user nova-compute[72820]: No targets found.
Aug 27 02:34:05 user nova-compute[72820]: STATIC:
Aug 27 02:34:05 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1
Aug 27 02:34:05 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:34:05 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:34:05 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:34:05 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:34:05 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:34:05 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf
Aug 27 02:34:05 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:34:05 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:34:05 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e
Aug 27 02:34:05 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:34:05 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:34:05 user nova-compute[72820]: FIRMWARE:
Aug 27 02:34:05 user nova-compute[72820]: No targets found.
Aug 27 02:34:05 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:34:05 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:34:05 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d84150-b1c5-4d25-8ba4-09fde1da6193]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e149a3-af1b-400a-bfb2-c9b948c4b3a4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:34:05 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:34:05 user nova-compute[72820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:34:05 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:34:05 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:34:05 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:34:05 user nova-compute[72820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:34:05 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:34:05 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c4c4cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e'): ({'sdg'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Removing single pathed devices sdg {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e27c1de-4fa6-497f-9b76-a77d14d3ecd9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.037s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb571f5-1095-4cc2-ba78-3003bb88db0a]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Flushing IO for device /dev/sdg {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a30890-fc8e-4182-980f-e7c8b7ddf204]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:34:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cf6eae-3c34-4ba4-97b9-a3cad39b4825]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] SCSI volumes sdg have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf7141e12-631bc6a2dca92746', '/dev/disk/by-id/scsi-23633316263366132', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f7141e12') {{(pid=84057) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[229bb50e-1e91-42ba-a832-cbe9377991d2]: (4, None) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[91905020-f383-4322-b2f2-85c9ef67722c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4223189-62e0-442f-804e-611f371e9cae]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e, portal: 172.16.0.220,3260]
Aug 27 02:34:06 user nova-compute[72820]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e, portal: 172.16.0.220,3260] successful.
Aug 27 02:34:06 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad4b957-f8b8-46f0-a6d8-54c9ac912f3c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] <== disconnect_volume: return (414ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:34:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:07 user nova-compute[72820]: DEBUG nova.network.neutron [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Port b1cbacdf-27a3-48f2-8c08-e77c49f40d81 binding to destination host user is already ACTIVE {{(pid=72820) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 27 02:34:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:34:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:34:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:34:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "refresh_cache-85c8fa72-19be-49a0-975f-d6a0d30d011f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:34:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquired lock "refresh_cache-85c8fa72-19be-49a0-975f-d6a0d30d011f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:34:07 user nova-compute[72820]: DEBUG nova.network.neutron [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:34:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-6dfa7215-82db-4f8c-ad7a-3d310b4e4c6c req-8f9190c8-1faa-480c-9126-982497574bf5 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received event network-vif-plugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:34:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6dfa7215-82db-4f8c-ad7a-3d310b4e4c6c req-8f9190c8-1faa-480c-9126-982497574bf5 service nova] Acquiring lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:34:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6dfa7215-82db-4f8c-ad7a-3d310b4e4c6c req-8f9190c8-1faa-480c-9126-982497574bf5 service nova] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:34:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6dfa7215-82db-4f8c-ad7a-3d310b4e4c6c req-8f9190c8-1faa-480c-9126-982497574bf5 service nova] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:34:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-6dfa7215-82db-4f8c-ad7a-3d310b4e4c6c req-8f9190c8-1faa-480c-9126-982497574bf5 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] No waiting events found dispatching network-vif-plugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:34:07 user nova-compute[72820]: WARNING nova.compute.manager [req-6dfa7215-82db-4f8c-ad7a-3d310b4e4c6c req-8f9190c8-1faa-480c-9126-982497574bf5 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received unexpected event network-vif-plugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 for instance with vm_state active and task_state resize_migrated.
Aug 27 02:34:08 user nova-compute[72820]: DEBUG nova.network.neutron [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Updating instance_info_cache with network_info: [{"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Releasing lock "refresh_cache-85c8fa72-19be-49a0-975f-d6a0d30d011f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG os_brick.utils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca12df98-198e-4032-bb5f-c00884bbc9e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c169c70-2a41-4857-9815-0e000997c03d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9897645b-bb22-4019-bb29-13df147c418f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c704e8-1134-4d78-8d4e-dff3720b6106]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:34:08 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:34:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f9050d-b322-48c7-8ab4-1b463240a240]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:34:08 user nova-compute[72820]: DEBUG os_brick.utils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:34:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:34:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:34:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:34:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:12 user nova-compute[72820]: DEBUG nova.compute.manager [req-c236b7dd-863e-4017-ac04-fff7760980dd req-d38e5cdd-f797-40b7-beb0-91258a0238b5 service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Received event network-changed-af8b1ee6-b3bb-4e30-b36d-3be720fa1130 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:34:12 user nova-compute[72820]: DEBUG nova.compute.manager [req-c236b7dd-863e-4017-ac04-fff7760980dd req-d38e5cdd-f797-40b7-beb0-91258a0238b5 service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Refreshing instance network info cache due to event network-changed-af8b1ee6-b3bb-4e30-b36d-3be720fa1130. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:34:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c236b7dd-863e-4017-ac04-fff7760980dd req-d38e5cdd-f797-40b7-beb0-91258a0238b5 service nova] Acquiring lock "refresh_cache-6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:34:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c236b7dd-863e-4017-ac04-fff7760980dd req-d38e5cdd-f797-40b7-beb0-91258a0238b5 service nova] Acquired lock "refresh_cache-6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:34:12 user nova-compute[72820]: DEBUG nova.network.neutron [req-c236b7dd-863e-4017-ac04-fff7760980dd req-d38e5cdd-f797-40b7-beb0-91258a0238b5 service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Refreshing network info cache for port af8b1ee6-b3bb-4e30-b36d-3be720fa1130 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:34:13 user nova-compute[72820]: DEBUG nova.network.neutron [req-c236b7dd-863e-4017-ac04-fff7760980dd req-d38e5cdd-f797-40b7-beb0-91258a0238b5 service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Updated VIF entry in instance network info cache for port af8b1ee6-b3bb-4e30-b36d-3be720fa1130. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:34:13 user nova-compute[72820]: DEBUG nova.network.neutron [req-c236b7dd-863e-4017-ac04-fff7760980dd req-d38e5cdd-f797-40b7-beb0-91258a0238b5 service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Updating instance_info_cache with network_info: [{"id": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "address": "fa:16:3e:a4:f0:b7", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b1ee6-b3", "ovs_interfaceid": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:34:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c236b7dd-863e-4017-ac04-fff7760980dd req-d38e5cdd-f797-40b7-beb0-91258a0238b5 service nova] Releasing lock "refresh_cache-6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:34:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:34:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:34:13 user nova-compute[72820]: DEBUG nova.objects.instance [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lazy-loading 'flavor' on Instance uuid 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:34:13 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Ignoring supplied device name: /dev/vdb
Aug 27 02:34:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:34:14 user nova-compute[72820]: INFO nova.compute.manager [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Attaching volume 47b91c92-8293-442a-a854-781a624c8c0a to /dev/vdb
Aug 27 02:34:14 user nova-compute[72820]: DEBUG os_brick.utils [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dc99bd-c04a-4260-8da1-cd43d7a5331f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cdbea1-b142-44e4-9bd7-04297090cf5b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e396d4-deff-4907-b726-74b3391990af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[37561f9f-0843-43f3-883b-7ccecd21f9c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:34:14 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:34:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[607ae026-6d80-4ac5-833c-e397f0936f14]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG os_brick.utils [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:34:14 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Updating existing volume attachment record: ee0d06a0-7aeb-4123-b4af-018465ffa382 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:34:15 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:34:15 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:34:15 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:34:15 user nova-compute[72820]: INFO nova.compute.manager [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] instance snapshotting
Aug 27 02:34:15 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Beginning live snapshot process
Aug 27 02:34:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json -f qcow2 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json -f qcow2 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:16 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:34:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.270s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp19wag5dh/35cd045587944cc9869535ec84408936.delta 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:34:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:34:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:34:16 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:34:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp19wag5dh/35cd045587944cc9869535ec84408936.delta 1073741824" returned: 0 in 0.068s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:16 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 02:34:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:34:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] COPY block job progress, current cursor: 12976128 final cursor: 75497472 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:34:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 02:34:18 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 02:34:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:18 user nova-compute[72820]: DEBUG nova.privsep.utils [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 02:34:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp19wag5dh/35cd045587944cc9869535ec84408936.delta /opt/stack/data/nova/instances/snapshots/tmp19wag5dh/35cd045587944cc9869535ec84408936 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:34:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp19wag5dh/35cd045587944cc9869535ec84408936.delta /opt/stack/data/nova/instances/snapshots/tmp19wag5dh/35cd045587944cc9869535ec84408936" returned: 0 in 0.738s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:19 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Snapshot extracted, beginning image upload
Aug 27 02:34:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:34:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:20 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103645.7309546, 85c8fa72-19be-49a0-975f-d6a0d30d011f => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:34:20 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] VM Stopped (Lifecycle Event)
Aug 27 02:34:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:20 user nova-compute[72820]: DEBUG nova.compute.manager [None req-796c3290-be6c-4f58-b030-1a5df66c848b None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:34:20 user nova-compute[72820]: DEBUG nova.compute.manager [None req-796c3290-be6c-4f58-b030-1a5df66c848b None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:34:20 user nova-compute[72820]: INFO nova.compute.manager [None req-796c3290-be6c-4f58-b030-1a5df66c848b None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 02:34:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:34:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Starting finish_migration {{(pid=72820) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Instance directory exists: not creating {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 02:34:21 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Creating image(s)
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Did not create local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Ensure instance console log exists: /opt/stack/data/nova/instances/85c8fa72-19be-49a0-975f-d6a0d30d011f/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Start _get_guest_xml network_info=[{"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1493967525-network", "vif_mac": "fa:16:3e:52:bd:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '66d59955-daaf-42e6-a32a-54e77aea80d6', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bWCZxFLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '85c8fa72-19be-49a0-975f-d6a0d30d011f', 'attached_at': '2023-08-27T02:34:21.000000', 'detached_at': '', 'volume_id': '4265fa4c-ed31-4423-83e2-100c129caa8e', 'serial': '4265fa4c-ed31-4423-83e2-100c129caa8e'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:34:21 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:34:21 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bWCZxFLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:34:21 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:34:21 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:34:21 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:34:21 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:34:21 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5b8233-6528-45c3-af66-24dc6aa27e93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:34:21 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f840a1e-41d5-4dce-91b3-902f84cbf33a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e] added
Aug 27 02:34:21 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2c987a-3995-4626-bfca-368f332cb761]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe9a1f8-55eb-4716-baac-20333ccc88b6]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bWCZxFLy {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bWCZxFLy" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07eed20-9c15-4301-8b39-0e249a5ad082]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bWCZxFLy'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4e9664-a7dd-4d27-b167-9f02cd9bf760]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f18582-b9ba-4181-a395-11ed0edba9fe]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:34:21 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:34:21 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:34:21 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:34:21 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:34:21 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:34:21 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:34:21 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Snapshot image upload complete
Aug 27 02:34:21 user nova-compute[72820]: INFO nova.compute.manager [None req-a904061b-51cc-43ee-9ff8-3a3068888a33 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Took 6.40 seconds to snapshot the instance on the hypervisor.
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4c6e30-5b3e-4bfc-a392-1f71f792d41d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e, portal: 172.16.0.220,3260]
Aug 27 02:34:21 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e, portal: 172.16.0.220,3260] successful.
Aug 27 02:34:21 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ecb157-4009-4d2e-a036-931cd308baaf]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f54f72-7e79-4f9d-8ac2-7929f69f8cda]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:34:22 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:34:22 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:34:22 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:34:22 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:34:22 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:34:22 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:34:22 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:34:22 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[057cd123-18bf-4b6c-b0dd-d1fd3507872c]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: None {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:22 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:34:22 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:34:22 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7221MB free_disk=25.126602172851562GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Applying migration context for instance 85c8fa72-19be-49a0-975f-d6a0d30d011f as it has an incoming, in-progress migration 01c10d77-2a8d-4c0d-ade7-6dff4d4e8b27. Migration status is post-migrating {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 02:34:22 user nova-compute[72820]: INFO nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Updating resource usage from migration 01c10d77-2a8d-4c0d-ade7-6dff4d4e8b27
Aug 27 02:34:22 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 26581695-c4b9-40b8-ab7a-34c99db0dadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f8f612f3-41c9-4dae-8d49-218d61720b15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 050e0c2b-9244-4987-b07d-e4712e46f936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1591319d-3d15-4c46-b823-4edddf018b5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 89b66e95-2333-403b-b338-6096717ca20d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance ac2f6797-8b7c-47d3-836d-fc1c617e23dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 15a1062a-ecfb-42b7-b8e5-03adbd6b8056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Migration 01c10d77-2a8d-4c0d-ade7-6dff4d4e8b27 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 85c8fa72-19be-49a0-975f-d6a0d30d011f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:34:22 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bWCZxFLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23633316263366132', 'path': '/dev/sdc'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633316263366132', 'path': '/dev/sdc'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-831814397',display_name='tempest-ServerActionsTestOtherA-server-831814397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-831814397',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuMDNJccFoG9J2MvjXPhebjkkaCvYt2BV0fWoVRWE0WGnLVqeM0TmypkIBpwP+aIP0dc17AS8ytt0zxz7hB47f2I8lo+2akMvc3UtIkl7mLDLkN7AXVg520jT6ETK7MXw==',key_name='tempest-keypair-1957607282',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:32:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7797569db44f40f193483e6e6933a0d0',ramdisk_id='',reservation_id='r-ggl9724x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-892102693',owner_user_name='tempest-ServerActionsTestOtherA-892102693-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='275f713edfd042d4b4fa32620956484a',uuid=85c8fa72-19be-49a0-975f-d6a0d30d011f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1493967525-network", "vif_mac": "fa:16:3e:52:bd:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converting VIF {"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1493967525-network", "vif_mac": "fa:16:3e:52:bd:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:bd:22,bridge_name='br-int',has_traffic_filtering=True,id=b1cbacdf-27a3-48f2-8c08-e77c49f40d81,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cbacdf-27') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:34:23 user nova-compute[72820]:   <uuid>85c8fa72-19be-49a0-975f-d6a0d30d011f</uuid>
Aug 27 02:34:23 user nova-compute[72820]:   <name>instance-00000019</name>
Aug 27 02:34:23 user nova-compute[72820]:   <memory>2097152</memory>
Aug 27 02:34:23 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:34:23 user nova-compute[72820]:   <metadata>
Aug 27 02:34:23 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:34:23 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:34:23 user nova-compute[72820]:       <nova:name>tempest-ServerActionsTestOtherA-server-831814397</nova:name>
Aug 27 02:34:23 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:34:21</nova:creationTime>
Aug 27 02:34:23 user nova-compute[72820]:       <nova:flavor name="m1.small">
Aug 27 02:34:23 user nova-compute[72820]:         <nova:memory>2048</nova:memory>
Aug 27 02:34:23 user nova-compute[72820]:         <nova:disk>20</nova:disk>
Aug 27 02:34:23 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:34:23 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:34:23 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:34:23 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:34:23 user nova-compute[72820]:       <nova:owner>
Aug 27 02:34:23 user nova-compute[72820]:         <nova:user uuid="275f713edfd042d4b4fa32620956484a">tempest-ServerActionsTestOtherA-892102693-project-member</nova:user>
Aug 27 02:34:23 user nova-compute[72820]:         <nova:project uuid="7797569db44f40f193483e6e6933a0d0">tempest-ServerActionsTestOtherA-892102693</nova:project>
Aug 27 02:34:23 user nova-compute[72820]:       </nova:owner>
Aug 27 02:34:23 user nova-compute[72820]:       <nova:ports>
Aug 27 02:34:23 user nova-compute[72820]:         <nova:port uuid="b1cbacdf-27a3-48f2-8c08-e77c49f40d81">
Aug 27 02:34:23 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 02:34:23 user nova-compute[72820]:         </nova:port>
Aug 27 02:34:23 user nova-compute[72820]:       </nova:ports>
Aug 27 02:34:23 user nova-compute[72820]:     </nova:instance>
Aug 27 02:34:23 user nova-compute[72820]:   </metadata>
Aug 27 02:34:23 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:34:23 user nova-compute[72820]:     <system>
Aug 27 02:34:23 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:34:23 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:34:23 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:34:23 user nova-compute[72820]:       <entry name="serial">85c8fa72-19be-49a0-975f-d6a0d30d011f</entry>
Aug 27 02:34:23 user nova-compute[72820]:       <entry name="uuid">85c8fa72-19be-49a0-975f-d6a0d30d011f</entry>
Aug 27 02:34:23 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:34:23 user nova-compute[72820]:     </system>
Aug 27 02:34:23 user nova-compute[72820]:   </sysinfo>
Aug 27 02:34:23 user nova-compute[72820]:   <os>
Aug 27 02:34:23 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:34:23 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:34:23 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:34:23 user nova-compute[72820]:   </os>
Aug 27 02:34:23 user nova-compute[72820]:   <features>
Aug 27 02:34:23 user nova-compute[72820]:     <acpi/>
Aug 27 02:34:23 user nova-compute[72820]:     <apic/>
Aug 27 02:34:23 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:34:23 user nova-compute[72820]:   </features>
Aug 27 02:34:23 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:34:23 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:34:23 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:34:23 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:34:23 user nova-compute[72820]:   </clock>
Aug 27 02:34:23 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:34:23 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:34:23 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:34:23 user nova-compute[72820]:   </cpu>
Aug 27 02:34:23 user nova-compute[72820]:   <devices>
Aug 27 02:34:23 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:34:23 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:34:23 user nova-compute[72820]:       <source dev="/dev/sdc"/>
Aug 27 02:34:23 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:34:23 user nova-compute[72820]:       <serial>4265fa4c-ed31-4423-83e2-100c129caa8e</serial>
Aug 27 02:34:23 user nova-compute[72820]:     </disk>
Aug 27 02:34:23 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:34:23 user nova-compute[72820]:       <mac address="fa:16:3e:52:bd:22"/>
Aug 27 02:34:23 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:34:23 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:34:23 user nova-compute[72820]:       <target dev="tapb1cbacdf-27"/>
Aug 27 02:34:23 user nova-compute[72820]:     </interface>
Aug 27 02:34:23 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:34:23 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/85c8fa72-19be-49a0-975f-d6a0d30d011f/console.log" append="off"/>
Aug 27 02:34:23 user nova-compute[72820]:     </serial>
Aug 27 02:34:23 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:34:23 user nova-compute[72820]:     <video>
Aug 27 02:34:23 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:34:23 user nova-compute[72820]:     </video>
Aug 27 02:34:23 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:34:23 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:34:23 user nova-compute[72820]:     </rng>
Aug 27 02:34:23 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:34:23 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:34:23 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:34:23 user nova-compute[72820]:     </memballoon>
Aug 27 02:34:23 user nova-compute[72820]:   </devices>
Aug 27 02:34:23 user nova-compute[72820]: </domain>
Aug 27 02:34:23 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-831814397',display_name='tempest-ServerActionsTestOtherA-server-831814397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-831814397',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuMDNJccFoG9J2MvjXPhebjkkaCvYt2BV0fWoVRWE0WGnLVqeM0TmypkIBpwP+aIP0dc17AS8ytt0zxz7hB47f2I8lo+2akMvc3UtIkl7mLDLkN7AXVg520jT6ETK7MXw==',key_name='tempest-keypair-1957607282',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:32:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7797569db44f40f193483e6e6933a0d0',ramdisk_id='',reservation_id='r-ggl9724x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-892102693',owner_user_name='tempest-ServerActionsTestOtherA-892102693-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='275f713edfd042d4b4fa32620956484a',uuid=85c8fa72-19be-49a0-975f-d6a0d30d011f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1493967525-network", "vif_mac": "fa:16:3e:52:bd:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converting VIF {"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1493967525-network", "vif_mac": "fa:16:3e:52:bd:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:bd:22,bridge_name='br-int',has_traffic_filtering=True,id=b1cbacdf-27a3-48f2-8c08-e77c49f40d81,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cbacdf-27') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG os_vif [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:bd:22,bridge_name='br-int',has_traffic_filtering=True,id=b1cbacdf-27a3-48f2-8c08-e77c49f40d81,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cbacdf-27') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1cbacdf-27, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1cbacdf-27, col_values=(('external_ids', {'iface-id': 'b1cbacdf-27a3-48f2-8c08-e77c49f40d81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:bd:22', 'vm-uuid': '85c8fa72-19be-49a0-975f-d6a0d30d011f'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:23 user nova-compute[72820]: INFO os_vif [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:bd:22,bridge_name='br-int',has_traffic_filtering=True,id=b1cbacdf-27a3-48f2-8c08-e77c49f40d81,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cbacdf-27')
Aug 27 02:34:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] No VIF found with MAC fa:16:3e:52:bd:22, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:34:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.616s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:34:24 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:34:24 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:34:24 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:34:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:34:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Didn't find any instances for network info cache update. {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 02:34:24 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:34:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-70485add-4b53-4157-bb51-ce351bdf4a41 req-7742b494-10cc-4cd8-a06d-ac431a958a40 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received event network-vif-plugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:34:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-70485add-4b53-4157-bb51-ce351bdf4a41 req-7742b494-10cc-4cd8-a06d-ac431a958a40 service nova] Acquiring lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:34:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-70485add-4b53-4157-bb51-ce351bdf4a41 req-7742b494-10cc-4cd8-a06d-ac431a958a40 service nova] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:34:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-70485add-4b53-4157-bb51-ce351bdf4a41 req-7742b494-10cc-4cd8-a06d-ac431a958a40 service nova] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:34:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-70485add-4b53-4157-bb51-ce351bdf4a41 req-7742b494-10cc-4cd8-a06d-ac431a958a40 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] No waiting events found dispatching network-vif-plugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:34:24 user nova-compute[72820]: WARNING nova.compute.manager [req-70485add-4b53-4157-bb51-ce351bdf4a41 req-7742b494-10cc-4cd8-a06d-ac431a958a40 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received unexpected event network-vif-plugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 for instance with vm_state active and task_state resize_finish.
Aug 27 02:34:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:26 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103666.8515046, 85c8fa72-19be-49a0-975f-d6a0d30d011f => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:34:26 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] VM Resumed (Lifecycle Event)
Aug 27 02:34:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:34:26 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Instance running successfully.
Aug 27 02:34:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Failed to set time: agent not configured {{(pid=72820) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 27 02:34:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b2bef50-c308-4f2e-ba91-9967b5162d3b tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] finish_migration finished successfully. {{(pid=72820) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 27 02:34:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:34:26 user nova-compute[72820]: DEBUG nova.compute.manager [req-b9005f93-2b9b-4a50-8449-14da30f94941 req-68aa9070-0d09-47f3-b01f-543419408868 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received event network-vif-plugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:34:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b9005f93-2b9b-4a50-8449-14da30f94941 req-68aa9070-0d09-47f3-b01f-543419408868 service nova] Acquiring lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:34:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b9005f93-2b9b-4a50-8449-14da30f94941 req-68aa9070-0d09-47f3-b01f-543419408868 service nova] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:34:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b9005f93-2b9b-4a50-8449-14da30f94941 req-68aa9070-0d09-47f3-b01f-543419408868 service nova] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:34:26 user nova-compute[72820]: DEBUG nova.compute.manager [req-b9005f93-2b9b-4a50-8449-14da30f94941 req-68aa9070-0d09-47f3-b01f-543419408868 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] No waiting events found dispatching network-vif-plugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:34:26 user nova-compute[72820]: WARNING nova.compute.manager [req-b9005f93-2b9b-4a50-8449-14da30f94941 req-68aa9070-0d09-47f3-b01f-543419408868 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received unexpected event network-vif-plugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 for instance with vm_state active and task_state resize_finish.
Aug 27 02:34:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:34:26 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 02:34:26 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103666.85474, 85c8fa72-19be-49a0-975f-d6a0d30d011f => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:34:26 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] VM Started (Lifecycle Event)
Aug 27 02:34:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:34:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:34:26 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 02:34:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZoaJlkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:34:27 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:34:27 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:34:27 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79e0506-a457-475b-a738-76ab93e9ceee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:34:27 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fc0b9d-f78e-4685-88d6-e5ced9e82642]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a] added
Aug 27 02:34:27 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81f7d9a-b4c1-48d8-85ad-522a545d46bf]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2ce0d2-7d60-4289-8e2f-14f797852b76]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZoaJlkx {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZoaJlkx" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dd0d0b-8efe-42e0-971b-78052cc8b471]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dZoaJlkx'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b774f236-c1ba-4a4a-951a-fbf70ed9f75c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1586d2d1-38ad-45ee-9e7f-8ced91956422]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:34:27 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:34:27 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:34:27 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:34:27 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:34:27 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:34:27 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:34:27 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:34:27 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17e607f-9ba8-4739-8117-5fb84891ab30]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a, portal: 172.16.0.220,3260]
Aug 27 02:34:27 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a, portal: 172.16.0.220,3260] successful.
Aug 27 02:34:27 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a639673-8cd0-4575-be6d-f412e98fb819]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a2baf2-0b26-4716-86b5-bad95636d150]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:34:27 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:34:27 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:34:27 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:34:27 user nova-compute[72820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a (non-flash)
Aug 27 02:34:27 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:34:27 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:34:27 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:34:27 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:34:27 user nova-compute[72820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a (non-flash)
Aug 27 02:34:27 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d8296e-7e7e-4af9-8ee1-e37791b26c2c]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:34:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZoaJlkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:34:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:34:28 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23736356461376166', 'path': '/dev/sde'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:34:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736356461376166', 'path': '/dev/sde'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:34:28 user nova-compute[72820]: DEBUG nova.objects.instance [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lazy-loading 'flavor' on Instance uuid 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:34:29 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:34:29 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:34:29 user nova-compute[72820]:   <source dev="/dev/sde"/>
Aug 27 02:34:29 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:34:29 user nova-compute[72820]:   <serial>47b91c92-8293-442a-a854-781a624c8c0a</serial>
Aug 27 02:34:29 user nova-compute[72820]: </disk>
Aug 27 02:34:29 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:34:29 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:34:29 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:34:29 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] No VIF found with MAC fa:16:3e:a4:f0:b7, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:34:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3d2b0c92-8967-44c7-95a6-b2ee82cdefb3 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.610s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:34:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:34:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:34:39 user nova-compute[72820]: INFO nova.compute.manager [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Unshelving
Aug 27 02:34:40 user nova-compute[72820]: INFO nova.virt.block_device [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Booting with volume 97b9bbd7-d01d-46c9-a337-24f231acef23 at /dev/vdc
Aug 27 02:34:40 user nova-compute[72820]: DEBUG os_brick.utils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a75c52-8aa2-414f-acbc-fdc195c34a7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f68a24-4593-40dc-87ae-4d324987e31e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d28ebb9-e261-4740-84b0-ca07cc7abf08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02a5e29-3722-4278-9ec3-833f10ce3861]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:34:40 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:34:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac506d9f-6ab3-4003-9eb6-76c42d79d8d4]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG os_brick.utils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:34:40 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Updating existing volume attachment record: 1266f067-593f-4fd0-8a68-520d834d5acf {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:34:41 user nova-compute[72820]: DEBUG nova.compute.manager [req-92dee488-2b33-43fb-9450-a475a0434d37 req-e65cb24a-502d-484b-b1a4-ec111e908596 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-changed-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:34:41 user nova-compute[72820]: DEBUG nova.compute.manager [req-92dee488-2b33-43fb-9450-a475a0434d37 req-e65cb24a-502d-484b-b1a4-ec111e908596 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Refreshing instance network info cache due to event network-changed-91356c13-2f8e-4c32-993c-98aa52345f86. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:34:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-92dee488-2b33-43fb-9450-a475a0434d37 req-e65cb24a-502d-484b-b1a4-ec111e908596 service nova] Acquiring lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:34:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-92dee488-2b33-43fb-9450-a475a0434d37 req-e65cb24a-502d-484b-b1a4-ec111e908596 service nova] Acquired lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:34:41 user nova-compute[72820]: DEBUG nova.network.neutron [req-92dee488-2b33-43fb-9450-a475a0434d37 req-e65cb24a-502d-484b-b1a4-ec111e908596 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Refreshing network info cache for port 91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:34:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:34:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "89b66e95-2333-403b-b338-6096717ca20d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:34:41 user nova-compute[72820]: INFO nova.compute.manager [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Detaching volume 8adf12ba-21ce-457c-92da-d954fc8907cf
Aug 27 02:34:41 user nova-compute[72820]: INFO nova.virt.block_device [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Attempting to driver detach volume 8adf12ba-21ce-457c-92da-d954fc8907cf from mountpoint /dev/vdb
Aug 27 02:34:41 user nova-compute[72820]: DEBUG nova.network.neutron [req-92dee488-2b33-43fb-9450-a475a0434d37 req-e65cb24a-502d-484b-b1a4-ec111e908596 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Updated VIF entry in instance network info cache for port 91356c13-2f8e-4c32-993c-98aa52345f86. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:34:41 user nova-compute[72820]: DEBUG nova.network.neutron [req-92dee488-2b33-43fb-9450-a475a0434d37 req-e65cb24a-502d-484b-b1a4-ec111e908596 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Updating instance_info_cache with network_info: [{"id": "91356c13-2f8e-4c32-993c-98aa52345f86", "address": "fa:16:3e:d1:90:a2", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91356c13-2f", "ovs_interfaceid": "91356c13-2f8e-4c32-993c-98aa52345f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:34:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Attempting to detach device vdb from instance 89b66e95-2333-403b-b338-6096717ca20d from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:34:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:34:41 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:34:41 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:34:41 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:34:41 user nova-compute[72820]:   <serial>8adf12ba-21ce-457c-92da-d954fc8907cf</serial>
Aug 27 02:34:41 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:34:41 user nova-compute[72820]: </disk>
Aug 27 02:34:41 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-92dee488-2b33-43fb-9450-a475a0434d37 req-e65cb24a-502d-484b-b1a4-ec111e908596 service nova] Releasing lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:34:42 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Successfully detached device vdb from instance 89b66e95-2333-403b-b338-6096717ca20d from the persistent domain config.
Aug 27 02:34:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 89b66e95-2333-403b-b338-6096717ca20d from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:34:42 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:34:42 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:34:42 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:34:42 user nova-compute[72820]:   <serial>8adf12ba-21ce-457c-92da-d954fc8907cf</serial>
Aug 27 02:34:42 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:34:42 user nova-compute[72820]: </disk>
Aug 27 02:34:42 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693103682.5053544, 89b66e95-2333-403b-b338-6096717ca20d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 89b66e95-2333-403b-b338-6096717ca20d {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:34:42 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Successfully detached device vdb from instance 89b66e95-2333-403b-b338-6096717ca20d from the live domain config.
Aug 27 02:34:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQzVeyCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:34:42 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda0ed58-5a48-4545-ba4e-c560c7c458c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:34:42 user nova-compute[72820]: No targets found.
Aug 27 02:34:42 user nova-compute[72820]: iSNS:
Aug 27 02:34:42 user nova-compute[72820]: No targets found.
Aug 27 02:34:42 user nova-compute[72820]: STATIC:
Aug 27 02:34:42 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a
Aug 27 02:34:42 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:34:42 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:34:42 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1
Aug 27 02:34:42 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:34:42 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:34:42 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:34:42 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:34:42 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:34:42 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf
Aug 27 02:34:42 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:34:42 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:34:42 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e
Aug 27 02:34:42 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:34:42 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:34:42 user nova-compute[72820]: FIRMWARE:
Aug 27 02:34:42 user nova-compute[72820]: No targets found.
Aug 27 02:34:42 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:34:42 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:34:42 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef25497-5be9-44e1-9d24-780802aee720]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[50640be4-78fa-421a-9814-44776596a90d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:34:42 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:34:42 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:34:42 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:34:42 user nova-compute[72820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a (non-flash)
Aug 27 02:34:42 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:34:42 user nova-compute[72820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf (non-flash)
Aug 27 02:34:42 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:34:42 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:34:42 user nova-compute[72820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a (non-flash)
Aug 27 02:34:42 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c0371360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf'): ({'sdb'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Removing single pathed devices sdb {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b020e18-0011-43dc-bdc2-674ffde3a0cb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f8f959-4768-40ee-9769-4fbc2ed42f89]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Flushing IO for device /dev/sdb {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc43e59f-f306-4d6f-a5b9-ceb71c860037]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce71ad3-b16d-4975-9be8-eef539e950fa]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6c9a04-9897-4a42-987f-3db6205dab47]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7edf2ca-c812-4de4-9a45-aa4c9784b437]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf, portal: 172.16.0.220,3260]
Aug 27 02:34:42 user nova-compute[72820]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf, portal: 172.16.0.220,3260] successful.
Aug 27 02:34:42 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adf12ba-21ce-457c-92da-d954fc8907cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d817e8b-38ec-41e3-b605-c91fb19dd875]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] <== disconnect_volume: return (334ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:34:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:34:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:43 user nova-compute[72820]: DEBUG nova.compute.manager [req-3a1e5b92-cb84-42c4-8d22-e15a0250ceb3 req-ad885a67-9cf3-4fc2-9e5f-47d564869170 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-changed-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:34:43 user nova-compute[72820]: DEBUG nova.compute.manager [req-3a1e5b92-cb84-42c4-8d22-e15a0250ceb3 req-ad885a67-9cf3-4fc2-9e5f-47d564869170 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Refreshing instance network info cache due to event network-changed-91356c13-2f8e-4c32-993c-98aa52345f86. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:34:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3a1e5b92-cb84-42c4-8d22-e15a0250ceb3 req-ad885a67-9cf3-4fc2-9e5f-47d564869170 service nova] Acquiring lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:34:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3a1e5b92-cb84-42c4-8d22-e15a0250ceb3 req-ad885a67-9cf3-4fc2-9e5f-47d564869170 service nova] Acquired lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:34:43 user nova-compute[72820]: DEBUG nova.network.neutron [req-3a1e5b92-cb84-42c4-8d22-e15a0250ceb3 req-ad885a67-9cf3-4fc2-9e5f-47d564869170 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Refreshing network info cache for port 91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:34:43 user nova-compute[72820]: DEBUG nova.objects.instance [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'flavor' on Instance uuid 89b66e95-2333-403b-b338-6096717ca20d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:34:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ae4d0e00-ece5-49eb-bb06-360b25fb5003 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "89b66e95-2333-403b-b338-6096717ca20d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.947s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:34:44 user nova-compute[72820]: DEBUG nova.network.neutron [req-3a1e5b92-cb84-42c4-8d22-e15a0250ceb3 req-ad885a67-9cf3-4fc2-9e5f-47d564869170 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Updated VIF entry in instance network info cache for port 91356c13-2f8e-4c32-993c-98aa52345f86. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:34:44 user nova-compute[72820]: DEBUG nova.network.neutron [req-3a1e5b92-cb84-42c4-8d22-e15a0250ceb3 req-ad885a67-9cf3-4fc2-9e5f-47d564869170 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Updating instance_info_cache with network_info: [{"id": "91356c13-2f8e-4c32-993c-98aa52345f86", "address": "fa:16:3e:d1:90:a2", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91356c13-2f", "ovs_interfaceid": "91356c13-2f8e-4c32-993c-98aa52345f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:34:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3a1e5b92-cb84-42c4-8d22-e15a0250ceb3 req-ad885a67-9cf3-4fc2-9e5f-47d564869170 service nova] Releasing lock "refresh_cache-89b66e95-2333-403b-b338-6096717ca20d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:34:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:34:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:34:54 user nova-compute[72820]: DEBUG nova.objects.instance [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'pci_requests' on Instance uuid a67eea06-dabf-4115-9650-ea4098f80bd7 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:34:54 user nova-compute[72820]: DEBUG nova.objects.instance [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'numa_topology' on Instance uuid a67eea06-dabf-4115-9650-ea4098f80bd7 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:34:54 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:34:54 user nova-compute[72820]: INFO nova.compute.claims [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Claim successful on node user
Aug 27 02:34:54 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:34:54 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:34:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:34:54 user nova-compute[72820]: INFO nova.network.neutron [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Updating port 8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 27 02:34:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:34:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquired lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:34:55 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:34:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-d3d44f4f-f125-4e17-b945-642a9a1ee74d req-3344fb4e-5f78-4359-a78e-f5b940c5af02 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-changed-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:34:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-d3d44f4f-f125-4e17-b945-642a9a1ee74d req-3344fb4e-5f78-4359-a78e-f5b940c5af02 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Refreshing instance network info cache due to event network-changed-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:34:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d3d44f4f-f125-4e17-b945-642a9a1ee74d req-3344fb4e-5f78-4359-a78e-f5b940c5af02 service nova] Acquiring lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:34:56 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Updating instance_info_cache with network_info: [{"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:34:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Releasing lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:34:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:34:56 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Creating image(s)
Aug 27 02:34:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "/opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:34:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "/opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:34:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "/opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:34:56 user nova-compute[72820]: DEBUG nova.objects.instance [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'trusted_certs' on Instance uuid a67eea06-dabf-4115-9650-ea4098f80bd7 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:34:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d3d44f4f-f125-4e17-b945-642a9a1ee74d req-3344fb4e-5f78-4359-a78e-f5b940c5af02 service nova] Acquired lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:34:56 user nova-compute[72820]: DEBUG nova.network.neutron [req-d3d44f4f-f125-4e17-b945-642a9a1ee74d req-3344fb4e-5f78-4359-a78e-f5b940c5af02 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Refreshing network info cache for port 8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:34:56 user nova-compute[72820]: DEBUG nova.objects.base [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Object Instance<a67eea06-dabf-4115-9650-ea4098f80bd7> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:34:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "be1bfee436cb12031a9639f24434737b151279e5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:34:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "be1bfee436cb12031a9639f24434737b151279e5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:34:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5.part --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5.part --force-share --output=json" returned: 0 in 0.209s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:57 user nova-compute[72820]: DEBUG nova.virt.images [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] 1d35110d-4c15-47da-9f05-1cfc67773675 was qcow2, converting to raw {{(pid=72820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 02:34:57 user nova-compute[72820]: DEBUG nova.privsep.utils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 02:34:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5.part /opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5.converted {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5.part /opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5.converted" returned: 0 in 0.325s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5.converted --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG nova.network.neutron [req-d3d44f4f-f125-4e17-b945-642a9a1ee74d req-3344fb4e-5f78-4359-a78e-f5b940c5af02 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Updated VIF entry in instance network info cache for port 8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG nova.network.neutron [req-d3d44f4f-f125-4e17-b945-642a9a1ee74d req-3344fb4e-5f78-4359-a78e-f5b940c5af02 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Updating instance_info_cache with network_info: [{"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d3d44f4f-f125-4e17-b945-642a9a1ee74d req-3344fb4e-5f78-4359-a78e-f5b940c5af02 service nova] Releasing lock "refresh_cache-a67eea06-dabf-4115-9650-ea4098f80bd7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "be1bfee436cb12031a9639f24434737b151279e5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.739s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5 --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5 --force-share --output=json" returned: 0 in 0.204s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "be1bfee436cb12031a9639f24434737b151279e5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "be1bfee436cb12031a9639f24434737b151279e5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5 --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5 --force-share --output=json" returned: 0 in 0.171s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5,backing_fmt=raw /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5,backing_fmt=raw /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk 1073741824" returned: 0 in 0.062s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "be1bfee436cb12031a9639f24434737b151279e5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5 --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5 --force-share --output=json" returned: 0 in 0.187s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG nova.objects.instance [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'migration_context' on Instance uuid a67eea06-dabf-4115-9650-ea4098f80bd7 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG nova.objects.base [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Object Instance<a67eea06-dabf-4115-9650-ea4098f80bd7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:34:58 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Rebasing disk image.
Aug 27 02:34:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.200s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:34:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d -F raw /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d -F raw /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk" returned: 0 in 2.672s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Ensure instance console log exists: /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Start _get_guest_xml network_info=[{"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='102a89965dcca27c99de0cb27b572b0d',container_format='bare',created_at=2023-08-27T02:32:47Z,direct_url=<?>,disk_format='qcow2',id=1d35110d-4c15-47da-9f05-1cfc67773675,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-992417993-shelved',owner='5387e67178b141ae94025b9fd61f0124',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T02:32:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1266f067-593f-4fd0-8a68-520d834d5acf', 'mount_device': '/dev/vdc', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OnlrpZPv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'a67eea06-dabf-4115-9650-ea4098f80bd7', 'attached_at': '', 'detached_at': '', 'volume_id': '97b9bbd7-d01d-46c9-a337-24f231acef23', 'serial': '97b9bbd7-d01d-46c9-a337-24f231acef23'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:35:01 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:35:01 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='102a89965dcca27c99de0cb27b572b0d',container_format='bare',created_at=2023-08-27T02:32:47Z,direct_url=<?>,disk_format='qcow2',id=1d35110d-4c15-47da-9f05-1cfc67773675,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-992417993-shelved',owner='5387e67178b141ae94025b9fd61f0124',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T02:32:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.objects.instance [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'vcpu_model' on Instance uuid a67eea06-dabf-4115-9650-ea4098f80bd7 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.objects.base [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Object Instance<a67eea06-dabf-4115-9650-ea4098f80bd7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OnlrpZPv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:35:01 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:35:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:35:01 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:35:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:35:01 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260" returned: 21 in 0.058s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0029eb-2e50-46e8-b85e-b1c4dcae69e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:35:01 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a30439-5006-46c2-86d8-5b553c259e19]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23] added
Aug 27 02:35:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[753214ff-32d0-4d17-a22d-2a98c0feaa22]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52e80e9-7d53-4223-9c18-bf4c4ae546cb]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OnlrpZPv {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OnlrpZPv" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adb5223-7ea0-4f28-a239-b8f3bdd8baeb]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OnlrpZPv'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9374551a-24a6-4398-b6b9-845b4dcf2bd2]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[797354fc-b451-4de4-ba8b-4c170702f7c6]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:35:02 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:35:02 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:35:02 user nova-compute[72820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a (non-flash)
Aug 27 02:35:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:35:02 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:35:02 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:35:02 user nova-compute[72820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a (non-flash)
Aug 27 02:35:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddfc47b-23ba-498a-9cf0-9b04484d7b2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23, portal: 172.16.0.220,3260]
Aug 27 02:35:02 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23, portal: 172.16.0.220,3260] successful.
Aug 27 02:35:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a3a3ec-6240-4dcb-9dbd-20a8fb70e31e]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a66566f-bcd3-4d89-bf22-a1330de4f5d3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:35:02 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:35:02 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:35:02 user nova-compute[72820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a (non-flash)
Aug 27 02:35:02 user nova-compute[72820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)
Aug 27 02:35:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:35:02 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:35:02 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:35:02 user nova-compute[72820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a (non-flash)
Aug 27 02:35:02 user nova-compute[72820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)
Aug 27 02:35:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef425f6-5d84-45a2-8e0f-de66e5f7ee6a]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:02 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: None {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OnlrpZPv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23332613866396630', 'path': '/dev/sdb'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332613866396630', 'path': '/dev/sdb'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T02:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-992417993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-992417993',id=24,image_ref='1d35110d-4c15-47da-9f05-1cfc67773675',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-398704580',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:30:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5387e67178b141ae94025b9fd61f0124',ramdisk_id='',reservation_id='r-kyve7ptf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1913674887',owner_user_name='tempest-AttachVolumeShelveTestJSON-1913674887-project-member',shelved_at='2023-08-27T02:32:51.185216',shelved_host='user',shelved_image_id='1d35110d-4c15-47da-9f05-1cfc67773675'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:34:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6dbf37c8dec47aebcdc9c93ad1f3d69',uuid=a67eea06-dabf-4115-9650-ea4098f80bd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converting VIF {"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:b5,bridge_name='br-int',has_traffic_filtering=True,id=8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e251de1-2d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG nova.objects.instance [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'pci_devices' on Instance uuid a67eea06-dabf-4115-9650-ea4098f80bd7 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG nova.objects.base [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Object Instance<a67eea06-dabf-4115-9650-ea4098f80bd7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:35:03 user nova-compute[72820]:   <uuid>a67eea06-dabf-4115-9650-ea4098f80bd7</uuid>
Aug 27 02:35:03 user nova-compute[72820]:   <name>instance-00000018</name>
Aug 27 02:35:03 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:35:03 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:35:03 user nova-compute[72820]:   <metadata>
Aug 27 02:35:03 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:35:03 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:35:03 user nova-compute[72820]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-992417993</nova:name>
Aug 27 02:35:03 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:35:01</nova:creationTime>
Aug 27 02:35:03 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:35:03 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:35:03 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:35:03 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:35:03 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:35:03 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:35:03 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:35:03 user nova-compute[72820]:       <nova:owner>
Aug 27 02:35:03 user nova-compute[72820]:         <nova:user uuid="e6dbf37c8dec47aebcdc9c93ad1f3d69">tempest-AttachVolumeShelveTestJSON-1913674887-project-member</nova:user>
Aug 27 02:35:03 user nova-compute[72820]:         <nova:project uuid="5387e67178b141ae94025b9fd61f0124">tempest-AttachVolumeShelveTestJSON-1913674887</nova:project>
Aug 27 02:35:03 user nova-compute[72820]:       </nova:owner>
Aug 27 02:35:03 user nova-compute[72820]:       <nova:root type="image" uuid="1d35110d-4c15-47da-9f05-1cfc67773675"/>
Aug 27 02:35:03 user nova-compute[72820]:       <nova:ports>
Aug 27 02:35:03 user nova-compute[72820]:         <nova:port uuid="8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8">
Aug 27 02:35:03 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 02:35:03 user nova-compute[72820]:         </nova:port>
Aug 27 02:35:03 user nova-compute[72820]:       </nova:ports>
Aug 27 02:35:03 user nova-compute[72820]:     </nova:instance>
Aug 27 02:35:03 user nova-compute[72820]:   </metadata>
Aug 27 02:35:03 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:35:03 user nova-compute[72820]:     <system>
Aug 27 02:35:03 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:35:03 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:35:03 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:35:03 user nova-compute[72820]:       <entry name="serial">a67eea06-dabf-4115-9650-ea4098f80bd7</entry>
Aug 27 02:35:03 user nova-compute[72820]:       <entry name="uuid">a67eea06-dabf-4115-9650-ea4098f80bd7</entry>
Aug 27 02:35:03 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:35:03 user nova-compute[72820]:     </system>
Aug 27 02:35:03 user nova-compute[72820]:   </sysinfo>
Aug 27 02:35:03 user nova-compute[72820]:   <os>
Aug 27 02:35:03 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:35:03 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:35:03 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:35:03 user nova-compute[72820]:   </os>
Aug 27 02:35:03 user nova-compute[72820]:   <features>
Aug 27 02:35:03 user nova-compute[72820]:     <acpi/>
Aug 27 02:35:03 user nova-compute[72820]:     <apic/>
Aug 27 02:35:03 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:35:03 user nova-compute[72820]:   </features>
Aug 27 02:35:03 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:35:03 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:35:03 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:35:03 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:35:03 user nova-compute[72820]:   </clock>
Aug 27 02:35:03 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:35:03 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:35:03 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:35:03 user nova-compute[72820]:   </cpu>
Aug 27 02:35:03 user nova-compute[72820]:   <devices>
Aug 27 02:35:03 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:35:03 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:35:03 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk"/>
Aug 27 02:35:03 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:35:03 user nova-compute[72820]:     </disk>
Aug 27 02:35:03 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:35:03 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:35:03 user nova-compute[72820]:       <source dev="/dev/sdb"/>
Aug 27 02:35:03 user nova-compute[72820]:       <target dev="vdc" bus="virtio"/>
Aug 27 02:35:03 user nova-compute[72820]:       <serial>97b9bbd7-d01d-46c9-a337-24f231acef23</serial>
Aug 27 02:35:03 user nova-compute[72820]:     </disk>
Aug 27 02:35:03 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:35:03 user nova-compute[72820]:       <mac address="fa:16:3e:12:b9:b5"/>
Aug 27 02:35:03 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:35:03 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:35:03 user nova-compute[72820]:       <target dev="tap8e251de1-2d"/>
Aug 27 02:35:03 user nova-compute[72820]:     </interface>
Aug 27 02:35:03 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:35:03 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/console.log" append="off"/>
Aug 27 02:35:03 user nova-compute[72820]:     </serial>
Aug 27 02:35:03 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:35:03 user nova-compute[72820]:     <video>
Aug 27 02:35:03 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:35:03 user nova-compute[72820]:     </video>
Aug 27 02:35:03 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:35:03 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:35:03 user nova-compute[72820]:     </rng>
Aug 27 02:35:03 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:35:03 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:35:03 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:35:03 user nova-compute[72820]:     </memballoon>
Aug 27 02:35:03 user nova-compute[72820]:   </devices>
Aug 27 02:35:03 user nova-compute[72820]: </domain>
Aug 27 02:35:03 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T02:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-992417993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-992417993',id=24,image_ref='1d35110d-4c15-47da-9f05-1cfc67773675',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-398704580',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:30:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5387e67178b141ae94025b9fd61f0124',ramdisk_id='',reservation_id='r-kyve7ptf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1913674887',owner_user_name='tempest-AttachVolumeShelveTestJSON-1913674887-project-member',shelved_at='2023-08-27T02:32:51.185216',shelved_host='user',shelved_image_id='1d35110d-4c15-47da-9f05-1cfc67773675'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:34:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6dbf37c8dec47aebcdc9c93ad1f3d69',uuid=a67eea06-dabf-4115-9650-ea4098f80bd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converting VIF {"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:b5,bridge_name='br-int',has_traffic_filtering=True,id=8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e251de1-2d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG os_vif [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:b5,bridge_name='br-int',has_traffic_filtering=True,id=8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e251de1-2d') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e251de1-2d, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e251de1-2d, col_values=(('external_ids', {'iface-id': '8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:b9:b5', 'vm-uuid': 'a67eea06-dabf-4115-9650-ea4098f80bd7'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:03 user nova-compute[72820]: INFO os_vif [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:b5,bridge_name='br-int',has_traffic_filtering=True,id=8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e251de1-2d')
Aug 27 02:35:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:35:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] No VIF found with MAC fa:16:3e:12:b9:b5, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:35:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-444f837a-6338-49b7-879d-3ac3f99c1559 req-4f948338-c541-46be-8016-850d1be06433 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-444f837a-6338-49b7-879d-3ac3f99c1559 req-4f948338-c541-46be-8016-850d1be06433 service nova] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-444f837a-6338-49b7-879d-3ac3f99c1559 req-4f948338-c541-46be-8016-850d1be06433 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-444f837a-6338-49b7-879d-3ac3f99c1559 req-4f948338-c541-46be-8016-850d1be06433 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-444f837a-6338-49b7-879d-3ac3f99c1559 req-4f948338-c541-46be-8016-850d1be06433 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] No waiting events found dispatching network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:35:06 user nova-compute[72820]: WARNING nova.compute.manager [req-444f837a-6338-49b7-879d-3ac3f99c1559 req-4f948338-c541-46be-8016-850d1be06433 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received unexpected event network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 02:35:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:07 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103707.923418, a67eea06-dabf-4115-9650-ea4098f80bd7 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:35:07 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] VM Resumed (Lifecycle Event)
Aug 27 02:35:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:35:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:35:07 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Instance spawned successfully.
Aug 27 02:35:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:35:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:35:07 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:35:07 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103707.926242, a67eea06-dabf-4115-9650-ea4098f80bd7 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:35:07 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] VM Started (Lifecycle Event)
Aug 27 02:35:08 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:35:08 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:35:08 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:35:08 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:35:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2d95186-fd16-4ae1-88dd-82f71cd493d5 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.419s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-ab6ca6dc-2e0d-424f-b4db-dfece528bdba req-4a1fe71c-288d-4208-9a73-d89244388f9d service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ab6ca6dc-2e0d-424f-b4db-dfece528bdba req-4a1fe71c-288d-4208-9a73-d89244388f9d service nova] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ab6ca6dc-2e0d-424f-b4db-dfece528bdba req-4a1fe71c-288d-4208-9a73-d89244388f9d service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ab6ca6dc-2e0d-424f-b4db-dfece528bdba req-4a1fe71c-288d-4208-9a73-d89244388f9d service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-ab6ca6dc-2e0d-424f-b4db-dfece528bdba req-4a1fe71c-288d-4208-9a73-d89244388f9d service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] No waiting events found dispatching network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:35:08 user nova-compute[72820]: WARNING nova.compute.manager [req-ab6ca6dc-2e0d-424f-b4db-dfece528bdba req-4a1fe71c-288d-4208-9a73-d89244388f9d service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received unexpected event network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 for instance with vm_state active and task_state None.
Aug 27 02:35:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:35:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:35:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:35:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:35:12 user nova-compute[72820]: INFO nova.compute.claims [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Claim successful on node user
Aug 27 02:35:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:12 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:35:12 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:35:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.671s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:35:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:35:13 user nova-compute[72820]: DEBUG nova.network.neutron [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:35:13 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:35:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:35:13 user nova-compute[72820]: INFO nova.virt.block_device [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Booting with volume snapshot 2f6a4705-da98-4c99-92e2-88103b07a263 at /dev/vda
Aug 27 02:35:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:13 user nova-compute[72820]: DEBUG nova.policy [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '878038feacda4094b5d2c9e3814c8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f02ddcfa2b4571a4d7cacf1287aebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:35:14 user nova-compute[72820]: DEBUG nova.network.neutron [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Successfully created port: fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:35:14 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:35:15 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:35:15 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:35:15 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:35:15 user nova-compute[72820]: DEBUG nova.network.neutron [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Successfully updated port: fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:35:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "refresh_cache-c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:35:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquired lock "refresh_cache-c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:35:15 user nova-compute[72820]: DEBUG nova.network.neutron [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:35:15 user nova-compute[72820]: DEBUG nova.compute.manager [req-aad7ac35-6af0-485a-ba14-5bd95039e54b req-2a83fe74-28a7-47f3-850a-3d5cb9d016ba service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Received event network-changed-fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:15 user nova-compute[72820]: DEBUG nova.compute.manager [req-aad7ac35-6af0-485a-ba14-5bd95039e54b req-2a83fe74-28a7-47f3-850a-3d5cb9d016ba service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Refreshing instance network info cache due to event network-changed-fb5553d4-177e-48d6-ba60-3de8b50c03da. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:35:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-aad7ac35-6af0-485a-ba14-5bd95039e54b req-2a83fe74-28a7-47f3-850a-3d5cb9d016ba service nova] Acquiring lock "refresh_cache-c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:35:15 user nova-compute[72820]: DEBUG nova.network.neutron [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:35:15 user nova-compute[72820]: DEBUG nova.network.neutron [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Updating instance_info_cache with network_info: [{"id": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "address": "fa:16:3e:2d:6d:79", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5553d4-17", "ovs_interfaceid": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:35:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Releasing lock "refresh_cache-c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:35:15 user nova-compute[72820]: DEBUG nova.compute.manager [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Instance network_info: |[{"id": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "address": "fa:16:3e:2d:6d:79", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5553d4-17", "ovs_interfaceid": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:35:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-aad7ac35-6af0-485a-ba14-5bd95039e54b req-2a83fe74-28a7-47f3-850a-3d5cb9d016ba service nova] Acquired lock "refresh_cache-c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:35:15 user nova-compute[72820]: DEBUG nova.network.neutron [req-aad7ac35-6af0-485a-ba14-5bd95039e54b req-2a83fe74-28a7-47f3-850a-3d5cb9d016ba service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Refreshing network info cache for port fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:35:17 user nova-compute[72820]: DEBUG nova.network.neutron [req-aad7ac35-6af0-485a-ba14-5bd95039e54b req-2a83fe74-28a7-47f3-850a-3d5cb9d016ba service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Updated VIF entry in instance network info cache for port fb5553d4-177e-48d6-ba60-3de8b50c03da. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:35:17 user nova-compute[72820]: DEBUG nova.network.neutron [req-aad7ac35-6af0-485a-ba14-5bd95039e54b req-2a83fe74-28a7-47f3-850a-3d5cb9d016ba service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Updating instance_info_cache with network_info: [{"id": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "address": "fa:16:3e:2d:6d:79", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5553d4-17", "ovs_interfaceid": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:35:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-aad7ac35-6af0-485a-ba14-5bd95039e54b req-2a83fe74-28a7-47f3-850a-3d5cb9d016ba service nova] Releasing lock "refresh_cache-c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:35:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:18 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:35:18 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:35:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:18 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:35:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk --force-share --output=json" returned: 0 in 0.328s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:35:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:35:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:35:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:35:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:35:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:23 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:35:23 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:35:23 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7092MB free_disk=25.037967681884766GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:35:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Applying migration context for instance 85c8fa72-19be-49a0-975f-d6a0d30d011f as it has an incoming, in-progress migration 01c10d77-2a8d-4c0d-ade7-6dff4d4e8b27. Migration status is finished {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 02:35:24 user nova-compute[72820]: INFO nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Updating resource usage from migration 01c10d77-2a8d-4c0d-ade7-6dff4d4e8b27
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 26581695-c4b9-40b8-ab7a-34c99db0dadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f8f612f3-41c9-4dae-8d49-218d61720b15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 050e0c2b-9244-4987-b07d-e4712e46f936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1591319d-3d15-4c46-b823-4edddf018b5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 89b66e95-2333-403b-b338-6096717ca20d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance ac2f6797-8b7c-47d3-836d-fc1c617e23dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 15a1062a-ecfb-42b7-b8e5-03adbd6b8056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Migration 01c10d77-2a8d-4c0d-ade7-6dff4d4e8b27 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 85c8fa72-19be-49a0-975f-d6a0d30d011f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance a67eea06-dabf-4115-9650-ea4098f80bd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:24 user nova-compute[72820]: INFO nova.compute.manager [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Terminating instance
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-14a87f47-5a80-4e5f-8f83-533f768861fe req-ecf1b7b2-9b8a-4813-ac93-9e25bb8a2236 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received event network-vif-unplugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-14a87f47-5a80-4e5f-8f83-533f768861fe req-ecf1b7b2-9b8a-4813-ac93-9e25bb8a2236 service nova] Acquiring lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-14a87f47-5a80-4e5f-8f83-533f768861fe req-ecf1b7b2-9b8a-4813-ac93-9e25bb8a2236 service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-14a87f47-5a80-4e5f-8f83-533f768861fe req-ecf1b7b2-9b8a-4813-ac93-9e25bb8a2236 service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-14a87f47-5a80-4e5f-8f83-533f768861fe req-ecf1b7b2-9b8a-4813-ac93-9e25bb8a2236 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] No waiting events found dispatching network-vif-unplugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-14a87f47-5a80-4e5f-8f83-533f768861fe req-ecf1b7b2-9b8a-4813-ac93-9e25bb8a2236 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received event network-vif-unplugged-553b0551-3051-4ed5-9c80-27d77670620d for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.854s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:35:25 user nova-compute[72820]: INFO nova.compute.claims [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Claim successful on node user
Aug 27 02:35:25 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Instance destroyed successfully.
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.objects.instance [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lazy-loading 'resources' on Instance uuid ac2f6797-8b7c-47d3-836d-fc1c617e23dd {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:26:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-75697122',display_name='tempest-ServerActionsTestOtherB-server-75697122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-75697122',id=16,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp3hR8w9f7AOU3wBlGjx2QgjVCzjqvm+j+8m+weDqKoVqafaUie8myGeBPk3f9wFUM+nLfm1AWiPS+cjE0rgULgjP5MomAJch5aNo42dwR8Sd4aT6HChhwUBzyy0SaiOg==',key_name='tempest-keypair-1915839179',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:32:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb32c350e1a44044bc5b19942df53d05',ramdisk_id='',reservation_id='r-gmwi89nk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-657110753',owner_user_name='tempest-ServerActionsTestOtherB-657110753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='555eff4f50e9450aac65344bec772685',uuid=ac2f6797-8b7c-47d3-836d-fc1c617e23dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Converting VIF {"id": "553b0551-3051-4ed5-9c80-27d77670620d", "address": "fa:16:3e:b6:ef:6b", "network": {"id": "46452a93-d113-4ca9-806c-313cc26ca38a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588087841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb32c350e1a44044bc5b19942df53d05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553b0551-30", "ovs_interfaceid": "553b0551-3051-4ed5-9c80-27d77670620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_vif [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap553b0551-30, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:35:25 user nova-compute[72820]: INFO os_vif [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:6b,bridge_name='br-int',has_traffic_filtering=True,id=553b0551-3051-4ed5-9c80-27d77670620d,network=Network(46452a93-d113-4ca9-806c-313cc26ca38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553b0551-30')
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hATvUwtH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:35:25 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed2d2c6-a9a6-4ed8-addb-b0a25c5c69aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:35:25 user nova-compute[72820]: No targets found.
Aug 27 02:35:25 user nova-compute[72820]: iSNS:
Aug 27 02:35:25 user nova-compute[72820]: No targets found.
Aug 27 02:35:25 user nova-compute[72820]: STATIC:
Aug 27 02:35:25 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23
Aug 27 02:35:25 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:35:25 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:35:25 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a
Aug 27 02:35:25 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:35:25 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:35:25 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1
Aug 27 02:35:25 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:35:25 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:35:25 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:35:25 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:35:25 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:35:25 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e
Aug 27 02:35:25 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:35:25 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:35:25 user nova-compute[72820]: FIRMWARE:
Aug 27 02:35:25 user nova-compute[72820]: No targets found.
Aug 27 02:35:25 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:35:25 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:35:25 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19c90ad-7c68-4cab-bc39-ce84065f151e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[799186ca-f5a1-4925-be23-3d5eb350ee13]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:35:25 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:35:25 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:35:25 user nova-compute[72820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a (non-flash)
Aug 27 02:35:25 user nova-compute[72820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)
Aug 27 02:35:25 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:35:25 user nova-compute[72820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 (non-flash)
Aug 27 02:35:25 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:35:25 user nova-compute[72820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a (non-flash)
Aug 27 02:35:25 user nova-compute[72820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)
Aug 27 02:35:25 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a0423760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1'): ({'sdd'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Removing single pathed devices sdd {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a650940-15eb-4433-b357-5f1137cc2f6e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adff708-3578-453e-9ba3-697f163790a8]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Flushing IO for device /dev/sdd {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae2eb85-198e-4111-8bd9-c61e0c8a9c43]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddc8b51-f582-4f53-9eb4-401d0f9098ea]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db3f4e7-b89b-4ffe-942a-11833baada38]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fff7fb-6f54-4d4c-9dbe-dd6a8bd74c43]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260]
Aug 27 02:35:25 user nova-compute[72820]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1, portal: 172.16.0.220,3260] successful.
Aug 27 02:35:25 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27cad7eb-b82b-4588-b153-48d86f4da1a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dc3631-66ff-463a-8917-c90582ea503d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] <== disconnect_volume: return (377ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:35:25 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Deleting instance files /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd_del
Aug 27 02:35:25 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Deletion of /opt/stack/data/nova/instances/ac2f6797-8b7c-47d3-836d-fc1c617e23dd_del complete
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:35:25 user nova-compute[72820]: INFO nova.compute.manager [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Took 1.44 seconds to destroy the instance on the hypervisor.
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.network.neutron [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:35:25 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 02:35:25 user nova-compute[72820]: INFO nova.virt.block_device [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Booting with volume-backed-image 68b7ab8d-6942-4500-ab2d-968640e48617 at /dev/vda
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Skipping network cache update for instance because it is Building. {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Skipping network cache update for instance because it is Building. {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Skipping network cache update for instance because it is being deleted. {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.policy [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb67e11ecdd648a89dd58b4bf416060a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f023daf1767f4088bf0a23524587e662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:35:25 user nova-compute[72820]: DEBUG nova.objects.instance [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lazy-loading 'info_cache' on Instance uuid 26581695-c4b9-40b8-ab7a-34c99db0dadb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:35:26 user nova-compute[72820]: DEBUG nova.network.neutron [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Successfully created port: 4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:35:26 user nova-compute[72820]: DEBUG nova.compute.manager [req-45a1ac23-ddc1-451e-83b8-6f2d9dd1f364 req-8d51dbe9-cdf4-45da-a4f6-876da6c8e88f service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received event network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-45a1ac23-ddc1-451e-83b8-6f2d9dd1f364 req-8d51dbe9-cdf4-45da-a4f6-876da6c8e88f service nova] Acquiring lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-45a1ac23-ddc1-451e-83b8-6f2d9dd1f364 req-8d51dbe9-cdf4-45da-a4f6-876da6c8e88f service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-45a1ac23-ddc1-451e-83b8-6f2d9dd1f364 req-8d51dbe9-cdf4-45da-a4f6-876da6c8e88f service nova] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:26 user nova-compute[72820]: DEBUG nova.compute.manager [req-45a1ac23-ddc1-451e-83b8-6f2d9dd1f364 req-8d51dbe9-cdf4-45da-a4f6-876da6c8e88f service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] No waiting events found dispatching network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:35:26 user nova-compute[72820]: WARNING nova.compute.manager [req-45a1ac23-ddc1-451e-83b8-6f2d9dd1f364 req-8d51dbe9-cdf4-45da-a4f6-876da6c8e88f service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received unexpected event network-vif-plugged-553b0551-3051-4ed5-9c80-27d77670620d for instance with vm_state active and task_state deleting.
Aug 27 02:35:26 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Updating instance_info_cache with network_info: [{"id": "4a579280-0dce-49fb-861a-4577ba1d70a3", "address": "fa:16:3e:37:4e:12", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a579280-0d", "ovs_interfaceid": "4a579280-0dce-49fb-861a-4577ba1d70a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:35:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-26581695-c4b9-40b8-ab7a-34c99db0dadb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:35:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:35:27 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:35:27 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Took 1.56 seconds to deallocate network for instance.
Aug 27 02:35:27 user nova-compute[72820]: DEBUG nova.compute.manager [req-5f39d34a-2fb2-4609-be2e-e4cc7e2f3109 req-22166e6b-e25a-4b04-8bac-13acc0b499e8 service nova] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Received event network-vif-deleted-553b0551-3051-4ed5-9c80-27d77670620d {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "050e0c2b-9244-4987-b07d-e4712e46f936" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:27 user nova-compute[72820]: INFO nova.compute.manager [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Terminating instance
Aug 27 02:35:27 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:35:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:27 user nova-compute[72820]: DEBUG nova.network.neutron [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Successfully updated port: 4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:35:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "refresh_cache-53ce05c7-91a9-46f5-b4de-3c2c43642ef3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:35:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquired lock "refresh_cache-53ce05c7-91a9-46f5-b4de-3c2c43642ef3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:35:27 user nova-compute[72820]: DEBUG nova.network.neutron [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:35:27 user nova-compute[72820]: DEBUG nova.network.neutron [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:35:28 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Instance destroyed successfully.
Aug 27 02:35:28 user nova-compute[72820]: DEBUG nova.objects.instance [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'resources' on Instance uuid 050e0c2b-9244-4987-b07d-e4712e46f936 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1528827756',display_name='tempest-AttachVolumeTestJSON-server-1528827756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1528827756',id=14,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnSgUcneqrQT+fSR64ZBXTU7w6gH3FRUC28AIjZT1OTuPJeA2iK/PRvmUdcnaeRQRx9F2cfuohCq3KKKqoUGjjYwRrOZbZ+RipxFTfAfbkjmPR9pHpU0nOexJ+36eDqvA==',key_name='tempest-keypair-290646663',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a70199cb55f74880a86a7f4d2342054e',ramdisk_id='',reservation_id='r-iy5ykdf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-316094052',owner_user_name='tempest-AttachVolumeTestJSON-316094052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:33:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbbf87fbd76543bab71f44d664bec48c',uuid=050e0c2b-9244-4987-b07d-e4712e46f936,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converting VIF {"id": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "address": "fa:16:3e:a4:94:7e", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c019c8-6c", "ovs_interfaceid": "a6c019c8-6c53-44fd-a6f0-004d2f9b5a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG os_vif [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6c019c8-6c, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:35:28 user nova-compute[72820]: INFO os_vif [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:94:7e,bridge_name='br-int',has_traffic_filtering=True,id=a6c019c8-6c53-44fd-a6f0-004d2f9b5a55,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c019c8-6c')
Aug 27 02:35:28 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Deleting instance files /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936_del
Aug 27 02:35:28 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Deletion of /opt/stack/data/nova/instances/050e0c2b-9244-4987-b07d-e4712e46f936_del complete
Aug 27 02:35:28 user nova-compute[72820]: INFO nova.compute.manager [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 27 02:35:28 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:35:28 user nova-compute[72820]: INFO nova.compute.manager [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Took 0.98 seconds to detach 1 volumes for instance.
Aug 27 02:35:28 user nova-compute[72820]: DEBUG nova.network.neutron [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Updating instance_info_cache with network_info: [{"id": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "address": "fa:16:3e:41:f5:3b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6fbe4-05", "ovs_interfaceid": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Releasing lock "refresh_cache-53ce05c7-91a9-46f5-b4de-3c2c43642ef3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Instance network_info: |[{"id": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "address": "fa:16:3e:41:f5:3b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6fbe4-05", "ovs_interfaceid": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:28 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Deleted allocations for instance ac2f6797-8b7c-47d3-836d-fc1c617e23dd
Aug 27 02:35:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-429217f3-e0ce-407c-a978-d1182a46e620 tempest-ServerActionsTestOtherB-657110753 tempest-ServerActionsTestOtherB-657110753-project-member] Lock "ac2f6797-8b7c-47d3-836d-fc1c617e23dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.640s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG nova.compute.manager [req-d657747e-8ed3-4519-bc90-5e5abb617af2 req-c9ed0e67-c9af-4927-ac15-26302d231e5c service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received event network-changed-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG nova.compute.manager [req-d657747e-8ed3-4519-bc90-5e5abb617af2 req-c9ed0e67-c9af-4927-ac15-26302d231e5c service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Refreshing instance network info cache due to event network-changed-4aa6fbe4-05de-4a07-929c-868b2f949f09. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d657747e-8ed3-4519-bc90-5e5abb617af2 req-c9ed0e67-c9af-4927-ac15-26302d231e5c service nova] Acquiring lock "refresh_cache-53ce05c7-91a9-46f5-b4de-3c2c43642ef3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d657747e-8ed3-4519-bc90-5e5abb617af2 req-c9ed0e67-c9af-4927-ac15-26302d231e5c service nova] Acquired lock "refresh_cache-53ce05c7-91a9-46f5-b4de-3c2c43642ef3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:35:28 user nova-compute[72820]: DEBUG nova.network.neutron [req-d657747e-8ed3-4519-bc90-5e5abb617af2 req-c9ed0e67-c9af-4927-ac15-26302d231e5c service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Refreshing network info cache for port 4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:35:29 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Took 0.99 seconds to deallocate network for instance.
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG nova.compute.manager [req-2515ee45-0e7b-45b0-a97f-3d00288cbc77 req-c1367a77-81ef-49dd-b37d-7df76ac622fe service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received event network-vif-unplugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2515ee45-0e7b-45b0-a97f-3d00288cbc77 req-c1367a77-81ef-49dd-b37d-7df76ac622fe service nova] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2515ee45-0e7b-45b0-a97f-3d00288cbc77 req-c1367a77-81ef-49dd-b37d-7df76ac622fe service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2515ee45-0e7b-45b0-a97f-3d00288cbc77 req-c1367a77-81ef-49dd-b37d-7df76ac622fe service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG nova.compute.manager [req-2515ee45-0e7b-45b0-a97f-3d00288cbc77 req-c1367a77-81ef-49dd-b37d-7df76ac622fe service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] No waiting events found dispatching network-vif-unplugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:35:29 user nova-compute[72820]: WARNING nova.compute.manager [req-2515ee45-0e7b-45b0-a97f-3d00288cbc77 req-c1367a77-81ef-49dd-b37d-7df76ac622fe service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received unexpected event network-vif-unplugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 for instance with vm_state deleted and task_state None.
Aug 27 02:35:29 user nova-compute[72820]: DEBUG nova.compute.manager [req-2515ee45-0e7b-45b0-a97f-3d00288cbc77 req-c1367a77-81ef-49dd-b37d-7df76ac622fe service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received event network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2515ee45-0e7b-45b0-a97f-3d00288cbc77 req-c1367a77-81ef-49dd-b37d-7df76ac622fe service nova] Acquiring lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2515ee45-0e7b-45b0-a97f-3d00288cbc77 req-c1367a77-81ef-49dd-b37d-7df76ac622fe service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2515ee45-0e7b-45b0-a97f-3d00288cbc77 req-c1367a77-81ef-49dd-b37d-7df76ac622fe service nova] Lock "050e0c2b-9244-4987-b07d-e4712e46f936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG nova.compute.manager [req-2515ee45-0e7b-45b0-a97f-3d00288cbc77 req-c1367a77-81ef-49dd-b37d-7df76ac622fe service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] No waiting events found dispatching network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:35:29 user nova-compute[72820]: WARNING nova.compute.manager [req-2515ee45-0e7b-45b0-a97f-3d00288cbc77 req-c1367a77-81ef-49dd-b37d-7df76ac622fe service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received unexpected event network-vif-plugged-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 for instance with vm_state deleted and task_state None.
Aug 27 02:35:29 user nova-compute[72820]: DEBUG nova.compute.manager [req-2515ee45-0e7b-45b0-a97f-3d00288cbc77 req-c1367a77-81ef-49dd-b37d-7df76ac622fe service nova] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Received event network-vif-deleted-a6c019c8-6c53-44fd-a6f0-004d2f9b5a55 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG os_brick.utils [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f89d432-1ca6-41ff-8c19-b427ee442646]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ff9b95-a9ab-4c89-9df0-302ca1efa59e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9909a0-1f2b-453c-ae70-d818868ada08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc6b70a-b340-44ae-bc0a-edf286b0b6d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:35:29 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[518cec42-fe92-49cf-86c4-68f9d0d1fbfe]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG os_brick.utils [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Updating existing volume attachment record: c4a1b3ec-4864-4ad4-9e16-2797d2e13aee {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:35:29 user nova-compute[72820]: INFO nova.compute.manager [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Detaching volume 47b91c92-8293-442a-a854-781a624c8c0a
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:29 user nova-compute[72820]: INFO nova.virt.block_device [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Attempting to driver detach volume 47b91c92-8293-442a-a854-781a624c8c0a from mountpoint /dev/vdb
Aug 27 02:35:29 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Attempting to detach device vdb from instance 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310 from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:35:29 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:35:29 user nova-compute[72820]:   <source dev="/dev/sde"/>
Aug 27 02:35:29 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:35:29 user nova-compute[72820]:   <serial>47b91c92-8293-442a-a854-781a624c8c0a</serial>
Aug 27 02:35:29 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:35:29 user nova-compute[72820]: </disk>
Aug 27 02:35:29 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:35:29 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Successfully detached device vdb from instance 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310 from the persistent domain config.
Aug 27 02:35:29 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310 from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:35:29 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:35:29 user nova-compute[72820]:   <source dev="/dev/sde"/>
Aug 27 02:35:29 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:35:29 user nova-compute[72820]:   <serial>47b91c92-8293-442a-a854-781a624c8c0a</serial>
Aug 27 02:35:29 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:35:29 user nova-compute[72820]: </disk>
Aug 27 02:35:29 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:35:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.612s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:29 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Deleted allocations for instance 050e0c2b-9244-4987-b07d-e4712e46f936
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7d20730c-62a8-4e0d-8319-b582aea94b05 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "050e0c2b-9244-4987-b07d-e4712e46f936" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.542s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG nova.network.neutron [req-d657747e-8ed3-4519-bc90-5e5abb617af2 req-c9ed0e67-c9af-4927-ac15-26302d231e5c service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Updated VIF entry in instance network info cache for port 4aa6fbe4-05de-4a07-929c-868b2f949f09. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG nova.network.neutron [req-d657747e-8ed3-4519-bc90-5e5abb617af2 req-c9ed0e67-c9af-4927-ac15-26302d231e5c service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Updating instance_info_cache with network_info: [{"id": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "address": "fa:16:3e:41:f5:3b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6fbe4-05", "ovs_interfaceid": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d657747e-8ed3-4519-bc90-5e5abb617af2 req-c9ed0e67-c9af-4927-ac15-26302d231e5c service nova] Releasing lock "refresh_cache-53ce05c7-91a9-46f5-b4de-3c2c43642ef3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693103730.3165765, 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310 {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:35:30 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Successfully detached device vdb from instance 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310 from the live domain config.
Aug 27 02:35:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZoaJlkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:35:30 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f5e905-5df9-4555-9a9f-1fb3acb20f0d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:35:30 user nova-compute[72820]: No targets found.
Aug 27 02:35:30 user nova-compute[72820]: iSNS:
Aug 27 02:35:30 user nova-compute[72820]: No targets found.
Aug 27 02:35:30 user nova-compute[72820]: STATIC:
Aug 27 02:35:30 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23
Aug 27 02:35:30 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:35:30 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:35:30 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a
Aug 27 02:35:30 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:35:30 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:35:30 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:35:30 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:35:30 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:35:30 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e
Aug 27 02:35:30 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:35:30 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:35:30 user nova-compute[72820]: FIRMWARE:
Aug 27 02:35:30 user nova-compute[72820]: No targets found.
Aug 27 02:35:30 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:35:30 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:35:30 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6192c369-0280-4700-8ae0-9450c3d647d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[64202bab-2cc4-4c17-9cad-73280cfbd850]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:35:30 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:35:30 user nova-compute[72820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a (non-flash)
Aug 27 02:35:30 user nova-compute[72820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)
Aug 27 02:35:30 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:35:30 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:35:30 user nova-compute[72820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a (non-flash)
Aug 27 02:35:30 user nova-compute[72820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)
Aug 27 02:35:30 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a04d8940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a'): ({'sde'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Removing single pathed devices sde {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b939801f-c3fd-4d16-9119-456a641c0424]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6c97be-8338-4ac3-850d-50cfbed620a0]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Flushing IO for device /dev/sde {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01fe3a4-3ea1-4072-a525-c0c2636da6f6]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2327e745-d06b-445f-bd3e-7184b2b8e9f1]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] SCSI volumes sde have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[05994561-83e0-4ce2-9862-6216a09d5d6a]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5c51bc-740c-4f27-ad24-aeda58efc468]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a, portal: 172.16.0.220,3260]
Aug 27 02:35:30 user nova-compute[72820]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a, portal: 172.16.0.220,3260] successful.
Aug 27 02:35:30 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19a8f8b-a287-472d-a118-092579358ec4]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] <== disconnect_volume: return (355ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:35:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:35:31 user nova-compute[72820]: DEBUG nova.objects.instance [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lazy-loading 'flavor' on Instance uuid 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:35:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9c8cedd3-cb1f-4a20-9b0c-ddb41c7ac5a2 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.068s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.990s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:31 user nova-compute[72820]: INFO nova.compute.manager [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Terminating instance
Aug 27 02:35:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:35:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-fa8fab6e-a23f-4be9-954a-9d50f9e05a82 req-30b71a48-7e99-4afa-9a37-da43fff41591 service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Received event network-vif-unplugged-af8b1ee6-b3bb-4e30-b36d-3be720fa1130 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fa8fab6e-a23f-4be9-954a-9d50f9e05a82 req-30b71a48-7e99-4afa-9a37-da43fff41591 service nova] Acquiring lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fa8fab6e-a23f-4be9-954a-9d50f9e05a82 req-30b71a48-7e99-4afa-9a37-da43fff41591 service nova] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fa8fab6e-a23f-4be9-954a-9d50f9e05a82 req-30b71a48-7e99-4afa-9a37-da43fff41591 service nova] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-fa8fab6e-a23f-4be9-954a-9d50f9e05a82 req-30b71a48-7e99-4afa-9a37-da43fff41591 service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] No waiting events found dispatching network-vif-unplugged-af8b1ee6-b3bb-4e30-b36d-3be720fa1130 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-fa8fab6e-a23f-4be9-954a-9d50f9e05a82 req-30b71a48-7e99-4afa-9a37-da43fff41591 service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Received event network-vif-unplugged-af8b1ee6-b3bb-4e30-b36d-3be720fa1130 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "89b66e95-2333-403b-b338-6096717ca20d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:32 user nova-compute[72820]: INFO nova.compute.manager [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Terminating instance
Aug 27 02:35:32 user nova-compute[72820]: DEBUG nova.compute.manager [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:32 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Instance destroyed successfully.
Aug 27 02:35:32 user nova-compute[72820]: DEBUG nova.objects.instance [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lazy-loading 'resources' on Instance uuid 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-667076212',display_name='tempest-VolumesSnapshotTestJSON-instance-667076212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-667076212',id=26,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVRVlzhEhZcnfaxsrApGIaHxPts9faYqCHhtzUdmX6E5D9toQXkqxh+fsrtmZE0MZ6DUJJTA3ZtMyxebwTTsvdC+Ud5yvWO0ZlLKgEMfIWStwbT5D4wYqueeQaTPPGSCw==',key_name='tempest-keypair-599864003',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:32:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4abfae6cab24fef92f96422628dc7e6',ramdisk_id='',reservation_id='r-k9tfhbfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-941703694',owner_user_name='tempest-VolumesSnapshotTestJSON-941703694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:32:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e58dd305ae442ca84ae955894e7a074',uuid=6a9299e0-d1dc-4cf7-948b-35d1ef6d6310,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "address": "fa:16:3e:a4:f0:b7", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b1ee6-b3", "ovs_interfaceid": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Converting VIF {"id": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "address": "fa:16:3e:a4:f0:b7", "network": {"id": "35f784f8-b045-4a19-a8e6-bbf5b06bdaa2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-293786039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4abfae6cab24fef92f96422628dc7e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b1ee6-b3", "ovs_interfaceid": "af8b1ee6-b3bb-4e30-b36d-3be720fa1130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:f0:b7,bridge_name='br-int',has_traffic_filtering=True,id=af8b1ee6-b3bb-4e30-b36d-3be720fa1130,network=Network(35f784f8-b045-4a19-a8e6-bbf5b06bdaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8b1ee6-b3') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG os_vif [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:f0:b7,bridge_name='br-int',has_traffic_filtering=True,id=af8b1ee6-b3bb-4e30-b36d-3be720fa1130,network=Network(35f784f8-b045-4a19-a8e6-bbf5b06bdaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8b1ee6-b3') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf8b1ee6-b3, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:32 user nova-compute[72820]: INFO os_vif [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:f0:b7,bridge_name='br-int',has_traffic_filtering=True,id=af8b1ee6-b3bb-4e30-b36d-3be720fa1130,network=Network(35f784f8-b045-4a19-a8e6-bbf5b06bdaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8b1ee6-b3')
Aug 27 02:35:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZoaJlkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:35:32 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:35:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6a38d0-73aa-4fb7-87d7-55c6b11cb416]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:35:32 user nova-compute[72820]: No targets found.
Aug 27 02:35:32 user nova-compute[72820]: iSNS:
Aug 27 02:35:32 user nova-compute[72820]: No targets found.
Aug 27 02:35:32 user nova-compute[72820]: STATIC:
Aug 27 02:35:32 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23
Aug 27 02:35:32 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:35:32 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:35:32 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:35:32 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:35:32 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:35:32 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e
Aug 27 02:35:32 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:35:32 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:35:32 user nova-compute[72820]: FIRMWARE:
Aug 27 02:35:32 user nova-compute[72820]: No targets found.
Aug 27 02:35:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:35:32 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:35:32 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47b91c92-8293-442a-a854-781a624c8c0a', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbef88cc-8591-46a4-b515-ab2cbd96bd0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bb91f4-5f88-45ba-9200-e2cd26fdf1af]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:35:32 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:35:32 user nova-compute[72820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)
Aug 27 02:35:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:35:32 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:35:32 user nova-compute[72820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)
Aug 27 02:35:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c0370c10>, {}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Disconnecting from: [] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] <== disconnect_volume: return (86ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:35:32 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Deleting instance files /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310_del
Aug 27 02:35:32 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Deletion of /opt/stack/data/nova/instances/6a9299e0-d1dc-4cf7-948b-35d1ef6d6310_del complete
Aug 27 02:35:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-9d5633c0-ba39-46ec-b0ea-b838d2c40b29 req-b56aa19f-9c3c-4e5e-b30f-b5e0d0ea6e6f service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-unplugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9d5633c0-ba39-46ec-b0ea-b838d2c40b29 req-b56aa19f-9c3c-4e5e-b30f-b5e0d0ea6e6f service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9d5633c0-ba39-46ec-b0ea-b838d2c40b29 req-b56aa19f-9c3c-4e5e-b30f-b5e0d0ea6e6f service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9d5633c0-ba39-46ec-b0ea-b838d2c40b29 req-b56aa19f-9c3c-4e5e-b30f-b5e0d0ea6e6f service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-9d5633c0-ba39-46ec-b0ea-b838d2c40b29 req-b56aa19f-9c3c-4e5e-b30f-b5e0d0ea6e6f service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-unplugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-9d5633c0-ba39-46ec-b0ea-b838d2c40b29 req-b56aa19f-9c3c-4e5e-b30f-b5e0d0ea6e6f service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-unplugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:35:32 user nova-compute[72820]: INFO nova.compute.manager [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 27 02:35:32 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:33 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Instance destroyed successfully.
Aug 27 02:35:33 user nova-compute[72820]: DEBUG nova.objects.instance [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'resources' on Instance uuid 89b66e95-2333-403b-b338-6096717ca20d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:35:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-355823437',display_name='tempest-ServerRescueNegativeTestJSON-server-355823437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-355823437',id=21,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz2mFD6VeJVeEVU4bU7rJ7+CBdqVCOpfH1WB5wQSUW8kAHES+nnx5GM+Ktt607QK8GYcW4ial+97ZltS3YdvZfuAyIWSeVL4sJV6+ADDwbebun0Ev2EoMYbmwQuwXYxjQ==',key_name='tempest-keypair-1667560198',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:31:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca683dd78dbf41ec8fbe3d3f76011272',ramdisk_id='',reservation_id='r-7v09jyny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1600105144',owner_user_name='tempest-ServerRescueNegativeTestJSON-1600105144-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:32:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7f59dea3a6f4315828320a9ae6c721d',uuid=89b66e95-2333-403b-b338-6096717ca20d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91356c13-2f8e-4c32-993c-98aa52345f86", "address": "fa:16:3e:d1:90:a2", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91356c13-2f", "ovs_interfaceid": "91356c13-2f8e-4c32-993c-98aa52345f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:35:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converting VIF {"id": "91356c13-2f8e-4c32-993c-98aa52345f86", "address": "fa:16:3e:d1:90:a2", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91356c13-2f", "ovs_interfaceid": "91356c13-2f8e-4c32-993c-98aa52345f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:35:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:90:a2,bridge_name='br-int',has_traffic_filtering=True,id=91356c13-2f8e-4c32-993c-98aa52345f86,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91356c13-2f') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:35:33 user nova-compute[72820]: DEBUG os_vif [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:90:a2,bridge_name='br-int',has_traffic_filtering=True,id=91356c13-2f8e-4c32-993c-98aa52345f86,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91356c13-2f') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:35:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91356c13-2f, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:35:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:33 user nova-compute[72820]: INFO os_vif [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:90:a2,bridge_name='br-int',has_traffic_filtering=True,id=91356c13-2f8e-4c32-993c-98aa52345f86,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91356c13-2f')
Aug 27 02:35:33 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Deleting instance files /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d_del
Aug 27 02:35:33 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Deletion of /opt/stack/data/nova/instances/89b66e95-2333-403b-b338-6096717ca20d_del complete
Aug 27 02:35:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:33 user nova-compute[72820]: INFO nova.compute.manager [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 27 02:35:33 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:35:33 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:35:33 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 89b66e95-2333-403b-b338-6096717ca20d] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:35:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:33 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:35:33 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Took 0.96 seconds to deallocate network for instance.
Aug 27 02:35:33 user nova-compute[72820]: WARNING nova.volume.cinder [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Attachment ee0d06a0-7aeb-4123-b4af-018465ffa382 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ee0d06a0-7aeb-4123-b4af-018465ffa382. (HTTP 404) (Request-ID: req-db14164a-5940-4c36-9270-4fc8d4fc9ab3)
Aug 27 02:35:33 user nova-compute[72820]: INFO nova.compute.manager [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Took 0.03 seconds to detach 1 volumes for instance.
Aug 27 02:35:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-e9b30c47-c11f-49a1-9cc0-812b7d78ebce req-04907275-932f-4b34-96d7-c7d258705a98 service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Received event network-vif-plugged-af8b1ee6-b3bb-4e30-b36d-3be720fa1130 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e9b30c47-c11f-49a1-9cc0-812b7d78ebce req-04907275-932f-4b34-96d7-c7d258705a98 service nova] Acquiring lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e9b30c47-c11f-49a1-9cc0-812b7d78ebce req-04907275-932f-4b34-96d7-c7d258705a98 service nova] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e9b30c47-c11f-49a1-9cc0-812b7d78ebce req-04907275-932f-4b34-96d7-c7d258705a98 service nova] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-e9b30c47-c11f-49a1-9cc0-812b7d78ebce req-04907275-932f-4b34-96d7-c7d258705a98 service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] No waiting events found dispatching network-vif-plugged-af8b1ee6-b3bb-4e30-b36d-3be720fa1130 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:35:34 user nova-compute[72820]: WARNING nova.compute.manager [req-e9b30c47-c11f-49a1-9cc0-812b7d78ebce req-04907275-932f-4b34-96d7-c7d258705a98 service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Received unexpected event network-vif-plugged-af8b1ee6-b3bb-4e30-b36d-3be720fa1130 for instance with vm_state deleted and task_state None.
Aug 27 02:35:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-e9b30c47-c11f-49a1-9cc0-812b7d78ebce req-04907275-932f-4b34-96d7-c7d258705a98 service nova] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Received event network-vif-deleted-af8b1ee6-b3bb-4e30-b36d-3be720fa1130 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:34 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Deleted allocations for instance 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310
Aug 27 02:35:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-61dc11ef-a8a4-4039-a2c8-abddc9f2a2c4 tempest-VolumesSnapshotTestJSON-941703694 tempest-VolumesSnapshotTestJSON-941703694-project-member] Lock "6a9299e0-d1dc-4cf7-948b-35d1ef6d6310" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.726s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-a6ea44e1-9959-4f2c-8873-104a1ed64a00 req-3464d158-0af7-4f24-b46e-d73c436df8b4 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a6ea44e1-9959-4f2c-8873-104a1ed64a00 req-3464d158-0af7-4f24-b46e-d73c436df8b4 service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a6ea44e1-9959-4f2c-8873-104a1ed64a00 req-3464d158-0af7-4f24-b46e-d73c436df8b4 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a6ea44e1-9959-4f2c-8873-104a1ed64a00 req-3464d158-0af7-4f24-b46e-d73c436df8b4 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-a6ea44e1-9959-4f2c-8873-104a1ed64a00 req-3464d158-0af7-4f24-b46e-d73c436df8b4 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:35:34 user nova-compute[72820]: WARNING nova.compute.manager [req-a6ea44e1-9959-4f2c-8873-104a1ed64a00 req-3464d158-0af7-4f24-b46e-d73c436df8b4 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state active and task_state deleting.
Aug 27 02:35:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-a6ea44e1-9959-4f2c-8873-104a1ed64a00 req-3464d158-0af7-4f24-b46e-d73c436df8b4 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a6ea44e1-9959-4f2c-8873-104a1ed64a00 req-3464d158-0af7-4f24-b46e-d73c436df8b4 service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a6ea44e1-9959-4f2c-8873-104a1ed64a00 req-3464d158-0af7-4f24-b46e-d73c436df8b4 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a6ea44e1-9959-4f2c-8873-104a1ed64a00 req-3464d158-0af7-4f24-b46e-d73c436df8b4 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-a6ea44e1-9959-4f2c-8873-104a1ed64a00 req-3464d158-0af7-4f24-b46e-d73c436df8b4 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:35:34 user nova-compute[72820]: WARNING nova.compute.manager [req-a6ea44e1-9959-4f2c-8873-104a1ed64a00 req-3464d158-0af7-4f24-b46e-d73c436df8b4 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state active and task_state deleting.
Aug 27 02:35:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-a6ea44e1-9959-4f2c-8873-104a1ed64a00 req-3464d158-0af7-4f24-b46e-d73c436df8b4 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a6ea44e1-9959-4f2c-8873-104a1ed64a00 req-3464d158-0af7-4f24-b46e-d73c436df8b4 service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a6ea44e1-9959-4f2c-8873-104a1ed64a00 req-3464d158-0af7-4f24-b46e-d73c436df8b4 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a6ea44e1-9959-4f2c-8873-104a1ed64a00 req-3464d158-0af7-4f24-b46e-d73c436df8b4 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-a6ea44e1-9959-4f2c-8873-104a1ed64a00 req-3464d158-0af7-4f24-b46e-d73c436df8b4 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:35:34 user nova-compute[72820]: WARNING nova.compute.manager [req-a6ea44e1-9959-4f2c-8873-104a1ed64a00 req-3464d158-0af7-4f24-b46e-d73c436df8b4 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state active and task_state deleting.
Aug 27 02:35:35 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:35:35 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Took 2.10 seconds to deallocate network for instance.
Aug 27 02:35:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:35 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:35:35 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:35:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:35 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Deleted allocations for instance 89b66e95-2333-403b-b338-6096717ca20d
Aug 27 02:35:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-47e931a0-8523-4afc-99a2-59cad2957a5b tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "89b66e95-2333-403b-b338-6096717ca20d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.682s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:36 user nova-compute[72820]: DEBUG nova.compute.manager [req-5ba92062-30ac-48fa-b207-680e8455efca req-96827334-2fe3-49d7-9dac-18ca4bf846d0 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-unplugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5ba92062-30ac-48fa-b207-680e8455efca req-96827334-2fe3-49d7-9dac-18ca4bf846d0 service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5ba92062-30ac-48fa-b207-680e8455efca req-96827334-2fe3-49d7-9dac-18ca4bf846d0 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5ba92062-30ac-48fa-b207-680e8455efca req-96827334-2fe3-49d7-9dac-18ca4bf846d0 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:36 user nova-compute[72820]: DEBUG nova.compute.manager [req-5ba92062-30ac-48fa-b207-680e8455efca req-96827334-2fe3-49d7-9dac-18ca4bf846d0 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-unplugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:35:36 user nova-compute[72820]: WARNING nova.compute.manager [req-5ba92062-30ac-48fa-b207-680e8455efca req-96827334-2fe3-49d7-9dac-18ca4bf846d0 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-unplugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state deleted and task_state None.
Aug 27 02:35:36 user nova-compute[72820]: DEBUG nova.compute.manager [req-5ba92062-30ac-48fa-b207-680e8455efca req-96827334-2fe3-49d7-9dac-18ca4bf846d0 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5ba92062-30ac-48fa-b207-680e8455efca req-96827334-2fe3-49d7-9dac-18ca4bf846d0 service nova] Acquiring lock "89b66e95-2333-403b-b338-6096717ca20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5ba92062-30ac-48fa-b207-680e8455efca req-96827334-2fe3-49d7-9dac-18ca4bf846d0 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5ba92062-30ac-48fa-b207-680e8455efca req-96827334-2fe3-49d7-9dac-18ca4bf846d0 service nova] Lock "89b66e95-2333-403b-b338-6096717ca20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:36 user nova-compute[72820]: DEBUG nova.compute.manager [req-5ba92062-30ac-48fa-b207-680e8455efca req-96827334-2fe3-49d7-9dac-18ca4bf846d0 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] No waiting events found dispatching network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:35:36 user nova-compute[72820]: WARNING nova.compute.manager [req-5ba92062-30ac-48fa-b207-680e8455efca req-96827334-2fe3-49d7-9dac-18ca4bf846d0 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received unexpected event network-vif-plugged-91356c13-2f8e-4c32-993c-98aa52345f86 for instance with vm_state deleted and task_state None.
Aug 27 02:35:36 user nova-compute[72820]: DEBUG nova.compute.manager [req-5ba92062-30ac-48fa-b207-680e8455efca req-96827334-2fe3-49d7-9dac-18ca4bf846d0 service nova] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Received event network-vif-deleted-91356c13-2f8e-4c32-993c-98aa52345f86 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:40 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103725.1328177, ac2f6797-8b7c-47d3-836d-fc1c617e23dd => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:35:40 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] VM Stopped (Lifecycle Event)
Aug 27 02:35:40 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7c86accf-6c0a-4479-ac8a-bdf21aec7a03 None None] [instance: ac2f6797-8b7c-47d3-836d-fc1c617e23dd] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG os_brick.utils [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a909c908-0204-40f1-a87f-32ff15b54d11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf981000-d12a-41f0-a177-dd2f6bff04d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a0ebaf-d106-4ca0-aa0c-3fdde52e298a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[164fc42f-05c5-4bf9-adb7-b938eef337e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:35:41 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:35:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7bbd2e-1ac4-433d-a02c-46a55b5e1edb]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG os_brick.utils [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:35:41 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Updating existing volume attachment record: f81cb5c2-1cb0-4335-ae89-4add530ba8a2 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:35:43 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103728.047505, 050e0c2b-9244-4987-b07d-e4712e46f936 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:35:43 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] VM Stopped (Lifecycle Event)
Aug 27 02:35:43 user nova-compute[72820]: DEBUG nova.compute.manager [None req-4cbbd488-ea10-41c6-a01b-590ac05e48f1 None None] [instance: 050e0c2b-9244-4987-b07d-e4712e46f936] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:35:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:47 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103732.5472147, 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:35:47 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] VM Stopped (Lifecycle Event)
Aug 27 02:35:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-effeb646-25a9-40b1-9cc9-457317c14a3c None None] [instance: 6a9299e0-d1dc-4cf7-948b-35d1ef6d6310] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:35:48 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103733.1690593, 89b66e95-2333-403b-b338-6096717ca20d => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:35:48 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 89b66e95-2333-403b-b338-6096717ca20d] VM Stopped (Lifecycle Event)
Aug 27 02:35:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-141b66f4-aaec-4ac7-8235-5f5c8f08e612 None None] [instance: 89b66e95-2333-403b-b338-6096717ca20d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:35:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:35:53 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Creating image(s)
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Did not create local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Ensure instance console log exists: /opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Start _get_guest_xml network_info=[{"id": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "address": "fa:16:3e:41:f5:3b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6fbe4-05", "ovs_interfaceid": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f81cb5c2-1cb0-4335-ae89-4add530ba8a2', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RZjWPiSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '53ce05c7-91a9-46f5-b4de-3c2c43642ef3', 'attached_at': '', 'detached_at': '', 'volume_id': '67aebe6b-380b-426e-9490-a280e9f2e1eb', 'serial': '67aebe6b-380b-426e-9490-a280e9f2e1eb'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:35:53 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:35:53 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RZjWPiSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:35:53 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:35:53 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:35:53 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[da618b6d-e518-42ae-bb88-ad5c2e60ae13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:35:53 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1b94809e-f879-482e-873c-0b68627a7da0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "85c8fa72-19be-49a0-975f-d6a0d30d011f" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1b94809e-f879-482e-873c-0b68627a7da0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG nova.compute.manager [None req-1b94809e-f879-482e-873c-0b68627a7da0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Going to confirm migration 2 {{(pid=72820) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2307a0-12a8-4e6b-af37-691d3afc74c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb] added
Aug 27 02:35:53 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98061b8-c883-4d2a-a3b9-665ede7613c4]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbda8ebb-0082-424a-a536-ab1378220b30]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RZjWPiSw {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RZjWPiSw" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e4294b-1bba-4af5-9977-a145c10ab2c3]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RZjWPiSw'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ed8642-f1d4-4c4c-a972-67ce9b013247]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6accd02-e149-46f0-8dd9-9642009baed3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:35:53 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:35:53 user nova-compute[72820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)
Aug 27 02:35:53 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:35:53 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:35:53 user nova-compute[72820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)
Aug 27 02:35:53 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed974013-b092-4fa2-9769-33b633bb0fe2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb, portal: 172.16.0.220,3260]
Aug 27 02:35:53 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb, portal: 172.16.0.220,3260] successful.
Aug 27 02:35:53 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6adc377-f371-4f08-99a1-942c1e8eba1f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4107bf-26c3-4ee4-898b-9c45b6b846c2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:35:53 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:35:53 user nova-compute[72820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)
Aug 27 02:35:53 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:35:53 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:35:53 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:35:53 user nova-compute[72820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)
Aug 27 02:35:53 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:35:53 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dd295a-c269-4ce7-a822-ab0d63d5f9b7]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:35:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RZjWPiSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:35:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1b94809e-f879-482e-873c-0b68627a7da0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "refresh_cache-85c8fa72-19be-49a0-975f-d6a0d30d011f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:35:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1b94809e-f879-482e-873c-0b68627a7da0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquired lock "refresh_cache-85c8fa72-19be-49a0-975f-d6a0d30d011f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:35:54 user nova-compute[72820]: DEBUG nova.network.neutron [None req-1b94809e-f879-482e-873c-0b68627a7da0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:35:54 user nova-compute[72820]: DEBUG nova.objects.instance [None req-1b94809e-f879-482e-873c-0b68627a7da0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lazy-loading 'info_cache' on Instance uuid 85c8fa72-19be-49a0-975f-d6a0d30d011f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:35:54 user nova-compute[72820]: DEBUG nova.network.neutron [None req-1b94809e-f879-482e-873c-0b68627a7da0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Updating instance_info_cache with network_info: [{"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:35:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1b94809e-f879-482e-873c-0b68627a7da0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Releasing lock "refresh_cache-85c8fa72-19be-49a0-975f-d6a0d30d011f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:35:54 user nova-compute[72820]: DEBUG nova.objects.instance [None req-1b94809e-f879-482e-873c-0b68627a7da0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lazy-loading 'migration_context' on Instance uuid 85c8fa72-19be-49a0-975f-d6a0d30d011f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:35:54 user nova-compute[72820]: DEBUG nova.objects.base [None req-1b94809e-f879-482e-873c-0b68627a7da0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Object Instance<85c8fa72-19be-49a0-975f-d6a0d30d011f> lazy-loaded attributes: info_cache,migration_context {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:35:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1b94809e-f879-482e-873c-0b68627a7da0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1b94809e-f879-482e-873c-0b68627a7da0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:35:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26261343164666630', 'path': '/dev/sdd'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:35:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261343164666630', 'path': '/dev/sdd'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1580800830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1580800830',id=29,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f023daf1767f4088bf0a23524587e662',ramdisk_id='',reservation_id='r-y9v8i9bg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:35:26Z,user_data=None,user_id='bb67e11ecdd648a89dd58b4bf416060a',uuid=53ce05c7-91a9-46f5-b4de-3c2c43642ef3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "address": "fa:16:3e:41:f5:3b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6fbe4-05", "ovs_interfaceid": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converting VIF {"id": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "address": "fa:16:3e:41:f5:3b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6fbe4-05", "ovs_interfaceid": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f5:3b,bridge_name='br-int',has_traffic_filtering=True,id=4aa6fbe4-05de-4a07-929c-868b2f949f09,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa6fbe4-05') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG nova.objects.instance [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'pci_devices' on Instance uuid 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:35:55 user nova-compute[72820]:   <uuid>53ce05c7-91a9-46f5-b4de-3c2c43642ef3</uuid>
Aug 27 02:35:55 user nova-compute[72820]:   <name>instance-0000001d</name>
Aug 27 02:35:55 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:35:55 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:35:55 user nova-compute[72820]:   <metadata>
Aug 27 02:35:55 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:35:55 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:35:55 user nova-compute[72820]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1580800830</nova:name>
Aug 27 02:35:55 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:35:53</nova:creationTime>
Aug 27 02:35:55 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:35:55 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:35:55 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:35:55 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:35:55 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:35:55 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:35:55 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:35:55 user nova-compute[72820]:       <nova:owner>
Aug 27 02:35:55 user nova-compute[72820]:         <nova:user uuid="bb67e11ecdd648a89dd58b4bf416060a">tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member</nova:user>
Aug 27 02:35:55 user nova-compute[72820]:         <nova:project uuid="f023daf1767f4088bf0a23524587e662">tempest-ServerBootFromVolumeStableRescueTest-2088708325</nova:project>
Aug 27 02:35:55 user nova-compute[72820]:       </nova:owner>
Aug 27 02:35:55 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:35:55 user nova-compute[72820]:       <nova:ports>
Aug 27 02:35:55 user nova-compute[72820]:         <nova:port uuid="4aa6fbe4-05de-4a07-929c-868b2f949f09">
Aug 27 02:35:55 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 02:35:55 user nova-compute[72820]:         </nova:port>
Aug 27 02:35:55 user nova-compute[72820]:       </nova:ports>
Aug 27 02:35:55 user nova-compute[72820]:     </nova:instance>
Aug 27 02:35:55 user nova-compute[72820]:   </metadata>
Aug 27 02:35:55 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:35:55 user nova-compute[72820]:     <system>
Aug 27 02:35:55 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:35:55 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:35:55 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:35:55 user nova-compute[72820]:       <entry name="serial">53ce05c7-91a9-46f5-b4de-3c2c43642ef3</entry>
Aug 27 02:35:55 user nova-compute[72820]:       <entry name="uuid">53ce05c7-91a9-46f5-b4de-3c2c43642ef3</entry>
Aug 27 02:35:55 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:35:55 user nova-compute[72820]:     </system>
Aug 27 02:35:55 user nova-compute[72820]:   </sysinfo>
Aug 27 02:35:55 user nova-compute[72820]:   <os>
Aug 27 02:35:55 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:35:55 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:35:55 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:35:55 user nova-compute[72820]:   </os>
Aug 27 02:35:55 user nova-compute[72820]:   <features>
Aug 27 02:35:55 user nova-compute[72820]:     <acpi/>
Aug 27 02:35:55 user nova-compute[72820]:     <apic/>
Aug 27 02:35:55 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:35:55 user nova-compute[72820]:   </features>
Aug 27 02:35:55 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:35:55 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:35:55 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:35:55 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:35:55 user nova-compute[72820]:   </clock>
Aug 27 02:35:55 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:35:55 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:35:55 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:35:55 user nova-compute[72820]:   </cpu>
Aug 27 02:35:55 user nova-compute[72820]:   <devices>
Aug 27 02:35:55 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:35:55 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:35:55 user nova-compute[72820]:       <source dev="/dev/sdd"/>
Aug 27 02:35:55 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:35:55 user nova-compute[72820]:       <serial>67aebe6b-380b-426e-9490-a280e9f2e1eb</serial>
Aug 27 02:35:55 user nova-compute[72820]:     </disk>
Aug 27 02:35:55 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:35:55 user nova-compute[72820]:       <mac address="fa:16:3e:41:f5:3b"/>
Aug 27 02:35:55 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:35:55 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:35:55 user nova-compute[72820]:       <target dev="tap4aa6fbe4-05"/>
Aug 27 02:35:55 user nova-compute[72820]:     </interface>
Aug 27 02:35:55 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:35:55 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3/console.log" append="off"/>
Aug 27 02:35:55 user nova-compute[72820]:     </serial>
Aug 27 02:35:55 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:35:55 user nova-compute[72820]:     <video>
Aug 27 02:35:55 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:35:55 user nova-compute[72820]:     </video>
Aug 27 02:35:55 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:35:55 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:35:55 user nova-compute[72820]:     </rng>
Aug 27 02:35:55 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:35:55 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:35:55 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:35:55 user nova-compute[72820]:     </memballoon>
Aug 27 02:35:55 user nova-compute[72820]:   </devices>
Aug 27 02:35:55 user nova-compute[72820]: </domain>
Aug 27 02:35:55 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1580800830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1580800830',id=29,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f023daf1767f4088bf0a23524587e662',ramdisk_id='',reservation_id='r-y9v8i9bg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:35:26Z,user_data=None,user_id='bb67e11ecdd648a89dd58b4bf416060a',uuid=53ce05c7-91a9-46f5-b4de-3c2c43642ef3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "address": "fa:16:3e:41:f5:3b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6fbe4-05", "ovs_interfaceid": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converting VIF {"id": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "address": "fa:16:3e:41:f5:3b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6fbe4-05", "ovs_interfaceid": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f5:3b,bridge_name='br-int',has_traffic_filtering=True,id=4aa6fbe4-05de-4a07-929c-868b2f949f09,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa6fbe4-05') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG os_vif [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f5:3b,bridge_name='br-int',has_traffic_filtering=True,id=4aa6fbe4-05de-4a07-929c-868b2f949f09,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa6fbe4-05') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4aa6fbe4-05, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4aa6fbe4-05, col_values=(('external_ids', {'iface-id': '4aa6fbe4-05de-4a07-929c-868b2f949f09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:f5:3b', 'vm-uuid': '53ce05c7-91a9-46f5-b4de-3c2c43642ef3'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:55 user nova-compute[72820]: INFO os_vif [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f5:3b,bridge_name='br-int',has_traffic_filtering=True,id=4aa6fbe4-05de-4a07-929c-868b2f949f09,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa6fbe4-05')
Aug 27 02:35:55 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-1b94809e-f879-482e-873c-0b68627a7da0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-1b94809e-f879-482e-873c-0b68627a7da0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] No VIF found with MAC fa:16:3e:41:f5:3b, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:35:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1b94809e-f879-482e-873c-0b68627a7da0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.421s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:55 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-1b94809e-f879-482e-873c-0b68627a7da0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Deleted allocation for migration 01c10d77-2a8d-4c0d-ade7-6dff4d4e8b27
Aug 27 02:35:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1b94809e-f879-482e-873c-0b68627a7da0 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.723s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:56 user nova-compute[72820]: DEBUG nova.compute.manager [req-67dc8c04-e9b5-4cb5-936e-c60bd2eb610b req-47de7520-1725-44a2-ad48-181a4a0ff88b service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received event network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-67dc8c04-e9b5-4cb5-936e-c60bd2eb610b req-47de7520-1725-44a2-ad48-181a4a0ff88b service nova] Acquiring lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-67dc8c04-e9b5-4cb5-936e-c60bd2eb610b req-47de7520-1725-44a2-ad48-181a4a0ff88b service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-67dc8c04-e9b5-4cb5-936e-c60bd2eb610b req-47de7520-1725-44a2-ad48-181a4a0ff88b service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:56 user nova-compute[72820]: DEBUG nova.compute.manager [req-67dc8c04-e9b5-4cb5-936e-c60bd2eb610b req-47de7520-1725-44a2-ad48-181a4a0ff88b service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] No waiting events found dispatching network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:35:56 user nova-compute[72820]: WARNING nova.compute.manager [req-67dc8c04-e9b5-4cb5-936e-c60bd2eb610b req-47de7520-1725-44a2-ad48-181a4a0ff88b service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received unexpected event network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 for instance with vm_state building and task_state spawning.
Aug 27 02:35:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:35:58 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103758.6195574, 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:35:58 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] VM Resumed (Lifecycle Event)
Aug 27 02:35:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:35:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:35:58 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Instance spawned successfully.
Aug 27 02:35:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:35:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:35:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:35:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:35:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:35:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:35:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:35:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:35:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:35:58 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:35:58 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103758.6210275, 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:35:58 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] VM Started (Lifecycle Event)
Aug 27 02:35:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:35:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:35:58 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:35:58 user nova-compute[72820]: INFO nova.compute.manager [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Took 5.21 seconds to spawn the instance on the hypervisor.
Aug 27 02:35:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:35:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-4f74b885-adb5-4a97-935d-8ac5c58733b0 req-afcc83c5-7d6c-4d8e-adbe-bd6320253835 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received event network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:35:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4f74b885-adb5-4a97-935d-8ac5c58733b0 req-afcc83c5-7d6c-4d8e-adbe-bd6320253835 service nova] Acquiring lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:35:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4f74b885-adb5-4a97-935d-8ac5c58733b0 req-afcc83c5-7d6c-4d8e-adbe-bd6320253835 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:35:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4f74b885-adb5-4a97-935d-8ac5c58733b0 req-afcc83c5-7d6c-4d8e-adbe-bd6320253835 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:35:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-4f74b885-adb5-4a97-935d-8ac5c58733b0 req-afcc83c5-7d6c-4d8e-adbe-bd6320253835 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] No waiting events found dispatching network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:35:58 user nova-compute[72820]: WARNING nova.compute.manager [req-4f74b885-adb5-4a97-935d-8ac5c58733b0 req-afcc83c5-7d6c-4d8e-adbe-bd6320253835 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received unexpected event network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 for instance with vm_state building and task_state spawning.
Aug 27 02:35:58 user nova-compute[72820]: INFO nova.compute.manager [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Took 33.83 seconds to build instance.
Aug 27 02:35:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ba636a3-5b59-4c4f-afd7-3f18e4cab9a7 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.962s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.compute.manager [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:36:05 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Creating image(s)
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Did not create local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Ensure instance console log exists: /opt/stack/data/nova/instances/c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Start _get_guest_xml network_info=[{"id": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "address": "fa:16:3e:2d:6d:79", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5553d4-17", "ovs_interfaceid": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c4a1b3ec-4864-4ad4-9e16-2797d2e13aee', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WUhymrpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6', 'attached_at': '', 'detached_at': '', 'volume_id': '9d857c5a-4c65-48a3-a0e5-c3a71170f60b', 'serial': '9d857c5a-4c65-48a3-a0e5-c3a71170f60b'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:36:05 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:36:05 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WUhymrpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:36:05 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:36:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:36:05 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:36:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:36:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:36:05 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:36:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea61aab5-605d-44e8-ae9a-87f632a4de42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:36:06 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53b2584-e331-4437-a673-610a53b6174f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b] added
Aug 27 02:36:06 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f36220-4812-4ce1-8d15-c8d74379d7cd]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf26b3c3-0618-42e2-8342-a200e0e3327b]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WUhymrpw {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WUhymrpw" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15c3d6f-b78b-4b9e-b2dd-8dba73c19252]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WUhymrpw'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45cee87-1eee-4f7c-abef-872a891bdc95]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e761a726-b867-45df-b5c5-2d624c3f6f08]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:36:06 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:36:06 user nova-compute[72820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)
Aug 27 02:36:06 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:36:06 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:36:06 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:36:06 user nova-compute[72820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)
Aug 27 02:36:06 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:36:06 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde3358e-aa03-453a-ae2d-911400f2a694]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b, portal: 172.16.0.220,3260]
Aug 27 02:36:06 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b, portal: 172.16.0.220,3260] successful.
Aug 27 02:36:06 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaae295-75c9-400d-92ec-633fe5db6387]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bd4c6d-4241-4387-8964-cdceb6d9f632]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:36:06 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:36:06 user nova-compute[72820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)
Aug 27 02:36:06 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:36:06 user nova-compute[72820]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b (non-flash)
Aug 27 02:36:06 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:36:06 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:36:06 user nova-compute[72820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)
Aug 27 02:36:06 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:36:06 user nova-compute[72820]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b (non-flash)
Aug 27 02:36:06 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5109abd6-d8e7-4c03-a60c-323a64fc09af]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:36:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WUhymrpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26632393166333136', 'path': '/dev/sde'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632393166333136', 'path': '/dev/sde'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1060042085',display_name='tempest-TestVolumeBootPattern-server-1060042085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1060042085',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84f02ddcfa2b4571a4d7cacf1287aebd',ramdisk_id='',reservation_id='r-pbnxvdyw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-631676638',owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:35:13Z,user_data=None,user_id='878038feacda4094b5d2c9e3814c8bf0',uuid=c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "address": "fa:16:3e:2d:6d:79", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5553d4-17", "ovs_interfaceid": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converting VIF {"id": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "address": "fa:16:3e:2d:6d:79", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5553d4-17", "ovs_interfaceid": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=fb5553d4-177e-48d6-ba60-3de8b50c03da,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5553d4-17') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG nova.objects.instance [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lazy-loading 'pci_devices' on Instance uuid c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:36:07 user nova-compute[72820]:   <uuid>c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6</uuid>
Aug 27 02:36:07 user nova-compute[72820]:   <name>instance-0000001c</name>
Aug 27 02:36:07 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:36:07 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:36:07 user nova-compute[72820]:   <metadata>
Aug 27 02:36:07 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:36:07 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:36:07 user nova-compute[72820]:       <nova:name>tempest-TestVolumeBootPattern-server-1060042085</nova:name>
Aug 27 02:36:07 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:36:05</nova:creationTime>
Aug 27 02:36:07 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:36:07 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:36:07 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:36:07 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:36:07 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:36:07 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:36:07 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:36:07 user nova-compute[72820]:       <nova:owner>
Aug 27 02:36:07 user nova-compute[72820]:         <nova:user uuid="878038feacda4094b5d2c9e3814c8bf0">tempest-TestVolumeBootPattern-631676638-project-member</nova:user>
Aug 27 02:36:07 user nova-compute[72820]:         <nova:project uuid="84f02ddcfa2b4571a4d7cacf1287aebd">tempest-TestVolumeBootPattern-631676638</nova:project>
Aug 27 02:36:07 user nova-compute[72820]:       </nova:owner>
Aug 27 02:36:07 user nova-compute[72820]:       <nova:ports>
Aug 27 02:36:07 user nova-compute[72820]:         <nova:port uuid="fb5553d4-177e-48d6-ba60-3de8b50c03da">
Aug 27 02:36:07 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 02:36:07 user nova-compute[72820]:         </nova:port>
Aug 27 02:36:07 user nova-compute[72820]:       </nova:ports>
Aug 27 02:36:07 user nova-compute[72820]:     </nova:instance>
Aug 27 02:36:07 user nova-compute[72820]:   </metadata>
Aug 27 02:36:07 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:36:07 user nova-compute[72820]:     <system>
Aug 27 02:36:07 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:36:07 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:36:07 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:36:07 user nova-compute[72820]:       <entry name="serial">c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6</entry>
Aug 27 02:36:07 user nova-compute[72820]:       <entry name="uuid">c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6</entry>
Aug 27 02:36:07 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:36:07 user nova-compute[72820]:     </system>
Aug 27 02:36:07 user nova-compute[72820]:   </sysinfo>
Aug 27 02:36:07 user nova-compute[72820]:   <os>
Aug 27 02:36:07 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:36:07 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:36:07 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:36:07 user nova-compute[72820]:   </os>
Aug 27 02:36:07 user nova-compute[72820]:   <features>
Aug 27 02:36:07 user nova-compute[72820]:     <acpi/>
Aug 27 02:36:07 user nova-compute[72820]:     <apic/>
Aug 27 02:36:07 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:36:07 user nova-compute[72820]:   </features>
Aug 27 02:36:07 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:36:07 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:36:07 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:36:07 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:36:07 user nova-compute[72820]:   </clock>
Aug 27 02:36:07 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:36:07 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:36:07 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:36:07 user nova-compute[72820]:   </cpu>
Aug 27 02:36:07 user nova-compute[72820]:   <devices>
Aug 27 02:36:07 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:36:07 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:36:07 user nova-compute[72820]:       <source dev="/dev/sde"/>
Aug 27 02:36:07 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:36:07 user nova-compute[72820]:       <serial>9d857c5a-4c65-48a3-a0e5-c3a71170f60b</serial>
Aug 27 02:36:07 user nova-compute[72820]:     </disk>
Aug 27 02:36:07 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:36:07 user nova-compute[72820]:       <mac address="fa:16:3e:2d:6d:79"/>
Aug 27 02:36:07 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:36:07 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:36:07 user nova-compute[72820]:       <target dev="tapfb5553d4-17"/>
Aug 27 02:36:07 user nova-compute[72820]:     </interface>
Aug 27 02:36:07 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:36:07 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6/console.log" append="off"/>
Aug 27 02:36:07 user nova-compute[72820]:     </serial>
Aug 27 02:36:07 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:36:07 user nova-compute[72820]:     <video>
Aug 27 02:36:07 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:36:07 user nova-compute[72820]:     </video>
Aug 27 02:36:07 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:36:07 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:36:07 user nova-compute[72820]:     </rng>
Aug 27 02:36:07 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:36:07 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:36:07 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:36:07 user nova-compute[72820]:     </memballoon>
Aug 27 02:36:07 user nova-compute[72820]:   </devices>
Aug 27 02:36:07 user nova-compute[72820]: </domain>
Aug 27 02:36:07 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1060042085',display_name='tempest-TestVolumeBootPattern-server-1060042085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1060042085',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84f02ddcfa2b4571a4d7cacf1287aebd',ramdisk_id='',reservation_id='r-pbnxvdyw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-631676638',owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:35:13Z,user_data=None,user_id='878038feacda4094b5d2c9e3814c8bf0',uuid=c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "address": "fa:16:3e:2d:6d:79", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5553d4-17", "ovs_interfaceid": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converting VIF {"id": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "address": "fa:16:3e:2d:6d:79", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5553d4-17", "ovs_interfaceid": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=fb5553d4-177e-48d6-ba60-3de8b50c03da,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5553d4-17') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG os_vif [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=fb5553d4-177e-48d6-ba60-3de8b50c03da,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5553d4-17') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb5553d4-17, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb5553d4-17, col_values=(('external_ids', {'iface-id': 'fb5553d4-177e-48d6-ba60-3de8b50c03da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:6d:79', 'vm-uuid': 'c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:07 user nova-compute[72820]: INFO os_vif [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=fb5553d4-177e-48d6-ba60-3de8b50c03da,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5553d4-17')
Aug 27 02:36:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:36:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] No VIF found with MAC fa:16:3e:2d:6d:79, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:36:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:09 user nova-compute[72820]: DEBUG nova.compute.manager [req-fe96fddd-8f9e-4470-abf1-0f1fc5d445f8 req-7aa0c00a-eb9a-4ecb-8d80-3d224c49d2ec service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Received event network-vif-plugged-fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:36:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fe96fddd-8f9e-4470-abf1-0f1fc5d445f8 req-7aa0c00a-eb9a-4ecb-8d80-3d224c49d2ec service nova] Acquiring lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fe96fddd-8f9e-4470-abf1-0f1fc5d445f8 req-7aa0c00a-eb9a-4ecb-8d80-3d224c49d2ec service nova] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fe96fddd-8f9e-4470-abf1-0f1fc5d445f8 req-7aa0c00a-eb9a-4ecb-8d80-3d224c49d2ec service nova] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:09 user nova-compute[72820]: DEBUG nova.compute.manager [req-fe96fddd-8f9e-4470-abf1-0f1fc5d445f8 req-7aa0c00a-eb9a-4ecb-8d80-3d224c49d2ec service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] No waiting events found dispatching network-vif-plugged-fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:36:09 user nova-compute[72820]: WARNING nova.compute.manager [req-fe96fddd-8f9e-4470-abf1-0f1fc5d445f8 req-7aa0c00a-eb9a-4ecb-8d80-3d224c49d2ec service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Received unexpected event network-vif-plugged-fb5553d4-177e-48d6-ba60-3de8b50c03da for instance with vm_state building and task_state spawning.
Aug 27 02:36:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:10 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103770.9050283, c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:36:10 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] VM Resumed (Lifecycle Event)
Aug 27 02:36:10 user nova-compute[72820]: DEBUG nova.compute.manager [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:36:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:36:10 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Instance spawned successfully.
Aug 27 02:36:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:36:10 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:36:10 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:36:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:36:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:36:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:36:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:36:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:36:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:36:10 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:36:10 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103770.906464, c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:36:10 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] VM Started (Lifecycle Event)
Aug 27 02:36:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:36:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:36:11 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:36:11 user nova-compute[72820]: INFO nova.compute.manager [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Took 5.18 seconds to spawn the instance on the hypervisor.
Aug 27 02:36:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:36:11 user nova-compute[72820]: INFO nova.compute.manager [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Took 58.85 seconds to build instance.
Aug 27 02:36:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-34c4ffbf-96ed-4093-9e8d-e7721d12a1ea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 58.984s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-27a2310f-5e11-4340-8b29-49f21d778997 req-49976ee9-9768-4039-8d84-d5bbe99a8bdc service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Received event network-vif-plugged-fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:36:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-27a2310f-5e11-4340-8b29-49f21d778997 req-49976ee9-9768-4039-8d84-d5bbe99a8bdc service nova] Acquiring lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-27a2310f-5e11-4340-8b29-49f21d778997 req-49976ee9-9768-4039-8d84-d5bbe99a8bdc service nova] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-27a2310f-5e11-4340-8b29-49f21d778997 req-49976ee9-9768-4039-8d84-d5bbe99a8bdc service nova] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-27a2310f-5e11-4340-8b29-49f21d778997 req-49976ee9-9768-4039-8d84-d5bbe99a8bdc service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] No waiting events found dispatching network-vif-plugged-fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:36:11 user nova-compute[72820]: WARNING nova.compute.manager [req-27a2310f-5e11-4340-8b29-49f21d778997 req-49976ee9-9768-4039-8d84-d5bbe99a8bdc service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Received unexpected event network-vif-plugged-fb5553d4-177e-48d6-ba60-3de8b50c03da for instance with vm_state active and task_state None.
Aug 27 02:36:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:36:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:36:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:13 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:36:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 02:36:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] There are 0 instances to clean {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 02:36:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:14 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:36:15 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:36:15 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:36:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:16 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:36:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:18 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:36:19 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:36:19 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:36:19 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:36:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:19 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:36:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:36:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:36:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk.rescue --force-share --output=json" returned: 0 in 0.259s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:36:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:36:22 user nova-compute[72820]: INFO nova.compute.claims [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Claim successful on node user
Aug 27 02:36:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Refreshing inventories for resource provider a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Updating ProviderTree inventory for provider a962b30a-2750-431c-be10-075d0f991065 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Updating inventory in ProviderTree for provider a962b30a-2750-431c-be10-075d0f991065 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 02:36:22 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Refreshing aggregate associations for resource provider a962b30a-2750-431c-be10-075d0f991065, aggregates: None {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 02:36:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:23 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Refreshing trait associations for resource provider a962b30a-2750-431c-be10-075d0f991065, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 02:36:23 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:36:23 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:36:23 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7377MB free_disk=25.144207000732422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:36:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.345s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.385s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.network.neutron [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:36:24 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 26581695-c4b9-40b8-ab7a-34c99db0dadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f8f612f3-41c9-4dae-8d49-218d61720b15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1591319d-3d15-4c46-b823-4edddf018b5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 15a1062a-ecfb-42b7-b8e5-03adbd6b8056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 85c8fa72-19be-49a0-975f-d6a0d30d011f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance a67eea06-dabf-4115-9650-ea4098f80bd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.policy [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbbf87fbd76543bab71f44d664bec48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70199cb55f74880a86a7f4d2342054e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:36:24 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Creating image(s)
Aug 27 02:36:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "/opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "/opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "/opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.214s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquiring lock "59de147f-63c9-4ded-811b-c6ff7b35b374" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "59de147f-63c9-4ded-811b-c6ff7b35b374" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.247s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.944s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/disk 1073741824" returned: 0 in 0.075s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:36:25 user nova-compute[72820]: INFO nova.compute.claims [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Claim successful on node user
Aug 27 02:36:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.208s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Cannot resize image /opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Ensure instance console log exists: /opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG nova.network.neutron [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Successfully created port: 6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.713s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:36:25 user nova-compute[72820]: DEBUG nova.network.neutron [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG nova.policy [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5607a2e69fce42b7af26a8c3afdb3589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc4037270664e758e9411acbfe2d3a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:36:26 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:36:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:36:26 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Creating image(s)
Aug 27 02:36:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquiring lock "/opt/stack/data/nova/instances/59de147f-63c9-4ded-811b-c6ff7b35b374/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "/opt/stack/data/nova/instances/59de147f-63c9-4ded-811b-c6ff7b35b374/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "/opt/stack/data/nova/instances/59de147f-63c9-4ded-811b-c6ff7b35b374/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.201s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG nova.network.neutron [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Successfully updated port: 6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.224s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/59de147f-63c9-4ded-811b-c6ff7b35b374/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "refresh_cache-59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquired lock "refresh_cache-59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG nova.network.neutron [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG nova.compute.manager [req-ab08f998-78b1-460e-adae-3d111eddf6d2 req-1a80e26f-aa4d-4e2d-91e0-e5aeb7629145 service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Received event network-changed-6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG nova.compute.manager [req-ab08f998-78b1-460e-adae-3d111eddf6d2 req-1a80e26f-aa4d-4e2d-91e0-e5aeb7629145 service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Refreshing instance network info cache due to event network-changed-6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ab08f998-78b1-460e-adae-3d111eddf6d2 req-1a80e26f-aa4d-4e2d-91e0-e5aeb7629145 service nova] Acquiring lock "refresh_cache-59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG nova.network.neutron [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Successfully created port: 72a72a4b-544c-4d18-a868-40b36ff67b7c {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/59de147f-63c9-4ded-811b-c6ff7b35b374/disk 1073741824" returned: 0 in 0.085s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG nova.network.neutron [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.188s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59de147f-63c9-4ded-811b-c6ff7b35b374/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:36:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59de147f-63c9-4ded-811b-c6ff7b35b374/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59de147f-63c9-4ded-811b-c6ff7b35b374/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Cannot resize image /opt/stack/data/nova/instances/59de147f-63c9-4ded-811b-c6ff7b35b374/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Ensure instance console log exists: /opt/stack/data/nova/instances/59de147f-63c9-4ded-811b-c6ff7b35b374/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.network.neutron [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Updating instance_info_cache with network_info: [{"id": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "address": "fa:16:3e:94:19:e2", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9d1ee5-3b", "ovs_interfaceid": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Releasing lock "refresh_cache-59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.compute.manager [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Instance network_info: |[{"id": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "address": "fa:16:3e:94:19:e2", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9d1ee5-3b", "ovs_interfaceid": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ab08f998-78b1-460e-adae-3d111eddf6d2 req-1a80e26f-aa4d-4e2d-91e0-e5aeb7629145 service nova] Acquired lock "refresh_cache-59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.network.neutron [req-ab08f998-78b1-460e-adae-3d111eddf6d2 req-1a80e26f-aa4d-4e2d-91e0-e5aeb7629145 service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Refreshing network info cache for port 6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Start _get_guest_xml network_info=[{"id": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "address": "fa:16:3e:94:19:e2", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9d1ee5-3b", "ovs_interfaceid": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:36:27 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:36:27 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:36:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1653379425',display_name='tempest-AttachVolumeTestJSON-server-1653379425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1653379425',id=30,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIaoG2we2x0FMkHb430bBtSgDU8nDy+0V7PQNAxLOg4LSvEjSSDME6PPAQCeABDgSgi/r8pcqCPrZNqQ4xIfaoT2aGN15U4w5kZwBxiiQa4LRCraBzpFmSxT6KDD9DuSQ==',key_name='tempest-keypair-1719736260',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a70199cb55f74880a86a7f4d2342054e',ramdisk_id='',reservation_id='r-py41qjar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-316094052',owner_user_name='tempest-AttachVolumeTestJSON-316094052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:36:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbbf87fbd76543bab71f44d664bec48c',uuid=59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "address": "fa:16:3e:94:19:e2", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9d1ee5-3b", "ovs_interfaceid": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converting VIF {"id": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "address": "fa:16:3e:94:19:e2", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9d1ee5-3b", "ovs_interfaceid": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9d1ee5-3b') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.objects.instance [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'pci_devices' on Instance uuid 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:36:27 user nova-compute[72820]:   <uuid>59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0</uuid>
Aug 27 02:36:27 user nova-compute[72820]:   <name>instance-0000001e</name>
Aug 27 02:36:27 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:36:27 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:36:27 user nova-compute[72820]:   <metadata>
Aug 27 02:36:27 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:36:27 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:36:27 user nova-compute[72820]:       <nova:name>tempest-AttachVolumeTestJSON-server-1653379425</nova:name>
Aug 27 02:36:27 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:36:27</nova:creationTime>
Aug 27 02:36:27 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:36:27 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:36:27 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:36:27 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:36:27 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:36:27 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:36:27 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:36:27 user nova-compute[72820]:       <nova:owner>
Aug 27 02:36:27 user nova-compute[72820]:         <nova:user uuid="bbbf87fbd76543bab71f44d664bec48c">tempest-AttachVolumeTestJSON-316094052-project-member</nova:user>
Aug 27 02:36:27 user nova-compute[72820]:         <nova:project uuid="a70199cb55f74880a86a7f4d2342054e">tempest-AttachVolumeTestJSON-316094052</nova:project>
Aug 27 02:36:27 user nova-compute[72820]:       </nova:owner>
Aug 27 02:36:27 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:36:27 user nova-compute[72820]:       <nova:ports>
Aug 27 02:36:27 user nova-compute[72820]:         <nova:port uuid="6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7">
Aug 27 02:36:27 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 02:36:27 user nova-compute[72820]:         </nova:port>
Aug 27 02:36:27 user nova-compute[72820]:       </nova:ports>
Aug 27 02:36:27 user nova-compute[72820]:     </nova:instance>
Aug 27 02:36:27 user nova-compute[72820]:   </metadata>
Aug 27 02:36:27 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:36:27 user nova-compute[72820]:     <system>
Aug 27 02:36:27 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:36:27 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:36:27 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:36:27 user nova-compute[72820]:       <entry name="serial">59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0</entry>
Aug 27 02:36:27 user nova-compute[72820]:       <entry name="uuid">59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0</entry>
Aug 27 02:36:27 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:36:27 user nova-compute[72820]:     </system>
Aug 27 02:36:27 user nova-compute[72820]:   </sysinfo>
Aug 27 02:36:27 user nova-compute[72820]:   <os>
Aug 27 02:36:27 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:36:27 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:36:27 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:36:27 user nova-compute[72820]:   </os>
Aug 27 02:36:27 user nova-compute[72820]:   <features>
Aug 27 02:36:27 user nova-compute[72820]:     <acpi/>
Aug 27 02:36:27 user nova-compute[72820]:     <apic/>
Aug 27 02:36:27 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:36:27 user nova-compute[72820]:   </features>
Aug 27 02:36:27 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:36:27 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:36:27 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:36:27 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:36:27 user nova-compute[72820]:   </clock>
Aug 27 02:36:27 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:36:27 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:36:27 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:36:27 user nova-compute[72820]:   </cpu>
Aug 27 02:36:27 user nova-compute[72820]:   <devices>
Aug 27 02:36:27 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:36:27 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:36:27 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/disk"/>
Aug 27 02:36:27 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:36:27 user nova-compute[72820]:     </disk>
Aug 27 02:36:27 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:36:27 user nova-compute[72820]:       <mac address="fa:16:3e:94:19:e2"/>
Aug 27 02:36:27 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:36:27 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:36:27 user nova-compute[72820]:       <target dev="tap6e9d1ee5-3b"/>
Aug 27 02:36:27 user nova-compute[72820]:     </interface>
Aug 27 02:36:27 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:36:27 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/console.log" append="off"/>
Aug 27 02:36:27 user nova-compute[72820]:     </serial>
Aug 27 02:36:27 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:36:27 user nova-compute[72820]:     <video>
Aug 27 02:36:27 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:36:27 user nova-compute[72820]:     </video>
Aug 27 02:36:27 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:36:27 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:36:27 user nova-compute[72820]:     </rng>
Aug 27 02:36:27 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:36:27 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:36:27 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:36:27 user nova-compute[72820]:     </memballoon>
Aug 27 02:36:27 user nova-compute[72820]:   </devices>
Aug 27 02:36:27 user nova-compute[72820]: </domain>
Aug 27 02:36:27 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:36:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1653379425',display_name='tempest-AttachVolumeTestJSON-server-1653379425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1653379425',id=30,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIaoG2we2x0FMkHb430bBtSgDU8nDy+0V7PQNAxLOg4LSvEjSSDME6PPAQCeABDgSgi/r8pcqCPrZNqQ4xIfaoT2aGN15U4w5kZwBxiiQa4LRCraBzpFmSxT6KDD9DuSQ==',key_name='tempest-keypair-1719736260',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a70199cb55f74880a86a7f4d2342054e',ramdisk_id='',reservation_id='r-py41qjar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-316094052',owner_user_name='tempest-AttachVolumeTestJSON-316094052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:36:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbbf87fbd76543bab71f44d664bec48c',uuid=59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "address": "fa:16:3e:94:19:e2", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9d1ee5-3b", "ovs_interfaceid": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converting VIF {"id": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "address": "fa:16:3e:94:19:e2", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9d1ee5-3b", "ovs_interfaceid": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9d1ee5-3b') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG os_vif [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9d1ee5-3b') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e9d1ee5-3b, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e9d1ee5-3b, col_values=(('external_ids', {'iface-id': '6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:19:e2', 'vm-uuid': '59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:27 user nova-compute[72820]: INFO os_vif [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9d1ee5-3b')
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] No VIF found with MAC fa:16:3e:94:19:e2, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:36:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.network.neutron [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Successfully updated port: 72a72a4b-544c-4d18-a868-40b36ff67b7c {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquiring lock "refresh_cache-59de147f-63c9-4ded-811b-c6ff7b35b374" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquired lock "refresh_cache-59de147f-63c9-4ded-811b-c6ff7b35b374" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.network.neutron [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.compute.manager [req-647680f1-3afe-484e-9e94-2bcb50e707a8 req-dfe3d553-603a-41c8-bf40-a6a4aab73783 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Received event network-changed-72a72a4b-544c-4d18-a868-40b36ff67b7c {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.compute.manager [req-647680f1-3afe-484e-9e94-2bcb50e707a8 req-dfe3d553-603a-41c8-bf40-a6a4aab73783 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Refreshing instance network info cache due to event network-changed-72a72a4b-544c-4d18-a868-40b36ff67b7c. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-647680f1-3afe-484e-9e94-2bcb50e707a8 req-dfe3d553-603a-41c8-bf40-a6a4aab73783 service nova] Acquiring lock "refresh_cache-59de147f-63c9-4ded-811b-c6ff7b35b374" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.network.neutron [req-ab08f998-78b1-460e-adae-3d111eddf6d2 req-1a80e26f-aa4d-4e2d-91e0-e5aeb7629145 service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Updated VIF entry in instance network info cache for port 6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.network.neutron [req-ab08f998-78b1-460e-adae-3d111eddf6d2 req-1a80e26f-aa4d-4e2d-91e0-e5aeb7629145 service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Updating instance_info_cache with network_info: [{"id": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "address": "fa:16:3e:94:19:e2", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9d1ee5-3b", "ovs_interfaceid": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.network.neutron [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ab08f998-78b1-460e-adae-3d111eddf6d2 req-1a80e26f-aa4d-4e2d-91e0-e5aeb7629145 service nova] Releasing lock "refresh_cache-59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-f8f612f3-41c9-4dae-8d49-218d61720b15" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-f8f612f3-41c9-4dae-8d49-218d61720b15" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.network.neutron [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Updating instance_info_cache with network_info: [{"id": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "address": "fa:16:3e:c6:e7:26", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a72a4b-54", "ovs_interfaceid": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Releasing lock "refresh_cache-59de147f-63c9-4ded-811b-c6ff7b35b374" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Instance network_info: |[{"id": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "address": "fa:16:3e:c6:e7:26", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a72a4b-54", "ovs_interfaceid": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-647680f1-3afe-484e-9e94-2bcb50e707a8 req-dfe3d553-603a-41c8-bf40-a6a4aab73783 service nova] Acquired lock "refresh_cache-59de147f-63c9-4ded-811b-c6ff7b35b374" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.network.neutron [req-647680f1-3afe-484e-9e94-2bcb50e707a8 req-dfe3d553-603a-41c8-bf40-a6a4aab73783 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Refreshing network info cache for port 72a72a4b-544c-4d18-a868-40b36ff67b7c {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Start _get_guest_xml network_info=[{"id": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "address": "fa:16:3e:c6:e7:26", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a72a4b-54", "ovs_interfaceid": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:36:28 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:36:28 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1331150882',display_name='tempest-VolumesActionsTest-instance-1331150882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1331150882',id=31,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bc4037270664e758e9411acbfe2d3a3',ramdisk_id='',reservation_id='r-9dkulls4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1595890573',owner_user_name='tempest-VolumesActionsTest-1595890573-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:36:26Z,user_data=None,user_id='5607a2e69fce42b7af26a8c3afdb3589',uuid=59de147f-63c9-4ded-811b-c6ff7b35b374,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "address": "fa:16:3e:c6:e7:26", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a72a4b-54", "ovs_interfaceid": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Converting VIF {"id": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "address": "fa:16:3e:c6:e7:26", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a72a4b-54", "ovs_interfaceid": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:e7:26,bridge_name='br-int',has_traffic_filtering=True,id=72a72a4b-544c-4d18-a868-40b36ff67b7c,network=Network(ae065ae6-bfe7-4b57-81fc-8cd4df52cec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a72a4b-54') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.objects.instance [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lazy-loading 'pci_devices' on Instance uuid 59de147f-63c9-4ded-811b-c6ff7b35b374 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:36:28 user nova-compute[72820]:   <uuid>59de147f-63c9-4ded-811b-c6ff7b35b374</uuid>
Aug 27 02:36:28 user nova-compute[72820]:   <name>instance-0000001f</name>
Aug 27 02:36:28 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:36:28 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:36:28 user nova-compute[72820]:   <metadata>
Aug 27 02:36:28 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:36:28 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:36:28 user nova-compute[72820]:       <nova:name>tempest-VolumesActionsTest-instance-1331150882</nova:name>
Aug 27 02:36:28 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:36:28</nova:creationTime>
Aug 27 02:36:28 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:36:28 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:36:28 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:36:28 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:36:28 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:36:28 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:36:28 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:36:28 user nova-compute[72820]:       <nova:owner>
Aug 27 02:36:28 user nova-compute[72820]:         <nova:user uuid="5607a2e69fce42b7af26a8c3afdb3589">tempest-VolumesActionsTest-1595890573-project-member</nova:user>
Aug 27 02:36:28 user nova-compute[72820]:         <nova:project uuid="4bc4037270664e758e9411acbfe2d3a3">tempest-VolumesActionsTest-1595890573</nova:project>
Aug 27 02:36:28 user nova-compute[72820]:       </nova:owner>
Aug 27 02:36:28 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:36:28 user nova-compute[72820]:       <nova:ports>
Aug 27 02:36:28 user nova-compute[72820]:         <nova:port uuid="72a72a4b-544c-4d18-a868-40b36ff67b7c">
Aug 27 02:36:28 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 02:36:28 user nova-compute[72820]:         </nova:port>
Aug 27 02:36:28 user nova-compute[72820]:       </nova:ports>
Aug 27 02:36:28 user nova-compute[72820]:     </nova:instance>
Aug 27 02:36:28 user nova-compute[72820]:   </metadata>
Aug 27 02:36:28 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:36:28 user nova-compute[72820]:     <system>
Aug 27 02:36:28 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:36:28 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:36:28 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:36:28 user nova-compute[72820]:       <entry name="serial">59de147f-63c9-4ded-811b-c6ff7b35b374</entry>
Aug 27 02:36:28 user nova-compute[72820]:       <entry name="uuid">59de147f-63c9-4ded-811b-c6ff7b35b374</entry>
Aug 27 02:36:28 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:36:28 user nova-compute[72820]:     </system>
Aug 27 02:36:28 user nova-compute[72820]:   </sysinfo>
Aug 27 02:36:28 user nova-compute[72820]:   <os>
Aug 27 02:36:28 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:36:28 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:36:28 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:36:28 user nova-compute[72820]:   </os>
Aug 27 02:36:28 user nova-compute[72820]:   <features>
Aug 27 02:36:28 user nova-compute[72820]:     <acpi/>
Aug 27 02:36:28 user nova-compute[72820]:     <apic/>
Aug 27 02:36:28 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:36:28 user nova-compute[72820]:   </features>
Aug 27 02:36:28 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:36:28 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:36:28 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:36:28 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:36:28 user nova-compute[72820]:   </clock>
Aug 27 02:36:28 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:36:28 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:36:28 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:36:28 user nova-compute[72820]:   </cpu>
Aug 27 02:36:28 user nova-compute[72820]:   <devices>
Aug 27 02:36:28 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:36:28 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:36:28 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/59de147f-63c9-4ded-811b-c6ff7b35b374/disk"/>
Aug 27 02:36:28 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:36:28 user nova-compute[72820]:     </disk>
Aug 27 02:36:28 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:36:28 user nova-compute[72820]:       <mac address="fa:16:3e:c6:e7:26"/>
Aug 27 02:36:28 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:36:28 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:36:28 user nova-compute[72820]:       <target dev="tap72a72a4b-54"/>
Aug 27 02:36:28 user nova-compute[72820]:     </interface>
Aug 27 02:36:28 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:36:28 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/59de147f-63c9-4ded-811b-c6ff7b35b374/console.log" append="off"/>
Aug 27 02:36:28 user nova-compute[72820]:     </serial>
Aug 27 02:36:28 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:36:28 user nova-compute[72820]:     <video>
Aug 27 02:36:28 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:36:28 user nova-compute[72820]:     </video>
Aug 27 02:36:28 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:36:28 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:36:28 user nova-compute[72820]:     </rng>
Aug 27 02:36:28 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:36:28 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:36:28 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:36:28 user nova-compute[72820]:     </memballoon>
Aug 27 02:36:28 user nova-compute[72820]:   </devices>
Aug 27 02:36:28 user nova-compute[72820]: </domain>
Aug 27 02:36:28 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1331150882',display_name='tempest-VolumesActionsTest-instance-1331150882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1331150882',id=31,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bc4037270664e758e9411acbfe2d3a3',ramdisk_id='',reservation_id='r-9dkulls4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1595890573',owner_user_name='tempest-VolumesActionsTest-1595890573-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:36:26Z,user_data=None,user_id='5607a2e69fce42b7af26a8c3afdb3589',uuid=59de147f-63c9-4ded-811b-c6ff7b35b374,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "address": "fa:16:3e:c6:e7:26", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a72a4b-54", "ovs_interfaceid": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Converting VIF {"id": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "address": "fa:16:3e:c6:e7:26", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a72a4b-54", "ovs_interfaceid": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:e7:26,bridge_name='br-int',has_traffic_filtering=True,id=72a72a4b-544c-4d18-a868-40b36ff67b7c,network=Network(ae065ae6-bfe7-4b57-81fc-8cd4df52cec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a72a4b-54') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG os_vif [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:e7:26,bridge_name='br-int',has_traffic_filtering=True,id=72a72a4b-544c-4d18-a868-40b36ff67b7c,network=Network(ae065ae6-bfe7-4b57-81fc-8cd4df52cec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a72a4b-54') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72a72a4b-54, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72a72a4b-54, col_values=(('external_ids', {'iface-id': '72a72a4b-544c-4d18-a868-40b36ff67b7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:e7:26', 'vm-uuid': '59de147f-63c9-4ded-811b-c6ff7b35b374'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:28 user nova-compute[72820]: INFO os_vif [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:e7:26,bridge_name='br-int',has_traffic_filtering=True,id=72a72a4b-544c-4d18-a868-40b36ff67b7c,network=Network(ae065ae6-bfe7-4b57-81fc-8cd4df52cec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a72a4b-54')
Aug 27 02:36:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] No VIF found with MAC fa:16:3e:c6:e7:26, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Updating instance_info_cache with network_info: [{"id": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "address": "fa:16:3e:64:42:e4", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c62328f-29", "ovs_interfaceid": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-f8f612f3-41c9-4dae-8d49-218d61720b15" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:36:28 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:36:29 user nova-compute[72820]: DEBUG nova.compute.manager [req-88982196-e7e9-4c06-b17f-8c9e201f7352 req-1fe93f64-d3bf-4319-a574-d511b0ad1ddc service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Received event network-vif-plugged-6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:36:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-88982196-e7e9-4c06-b17f-8c9e201f7352 req-1fe93f64-d3bf-4319-a574-d511b0ad1ddc service nova] Acquiring lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-88982196-e7e9-4c06-b17f-8c9e201f7352 req-1fe93f64-d3bf-4319-a574-d511b0ad1ddc service nova] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-88982196-e7e9-4c06-b17f-8c9e201f7352 req-1fe93f64-d3bf-4319-a574-d511b0ad1ddc service nova] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:29 user nova-compute[72820]: DEBUG nova.compute.manager [req-88982196-e7e9-4c06-b17f-8c9e201f7352 req-1fe93f64-d3bf-4319-a574-d511b0ad1ddc service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] No waiting events found dispatching network-vif-plugged-6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:36:29 user nova-compute[72820]: WARNING nova.compute.manager [req-88982196-e7e9-4c06-b17f-8c9e201f7352 req-1fe93f64-d3bf-4319-a574-d511b0ad1ddc service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Received unexpected event network-vif-plugged-6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 for instance with vm_state building and task_state spawning.
Aug 27 02:36:29 user nova-compute[72820]: DEBUG nova.network.neutron [req-647680f1-3afe-484e-9e94-2bcb50e707a8 req-dfe3d553-603a-41c8-bf40-a6a4aab73783 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Updated VIF entry in instance network info cache for port 72a72a4b-544c-4d18-a868-40b36ff67b7c. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:36:29 user nova-compute[72820]: DEBUG nova.network.neutron [req-647680f1-3afe-484e-9e94-2bcb50e707a8 req-dfe3d553-603a-41c8-bf40-a6a4aab73783 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Updating instance_info_cache with network_info: [{"id": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "address": "fa:16:3e:c6:e7:26", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a72a4b-54", "ovs_interfaceid": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:36:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-647680f1-3afe-484e-9e94-2bcb50e707a8 req-dfe3d553-603a-41c8-bf40-a6a4aab73783 service nova] Releasing lock "refresh_cache-59de147f-63c9-4ded-811b-c6ff7b35b374" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:36:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.010s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:30 user nova-compute[72820]: INFO nova.compute.manager [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Detaching volume 97b9bbd7-d01d-46c9-a337-24f231acef23
Aug 27 02:36:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:30 user nova-compute[72820]: INFO nova.virt.block_device [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Attempting to driver detach volume 97b9bbd7-d01d-46c9-a337-24f231acef23 from mountpoint /dev/vdc
Aug 27 02:36:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Attempting to detach device vdc from instance a67eea06-dabf-4115-9650-ea4098f80bd7 from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:36:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:36:30 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:36:30 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:36:30 user nova-compute[72820]:   <target dev="vdc" bus="virtio"/>
Aug 27 02:36:30 user nova-compute[72820]:   <serial>97b9bbd7-d01d-46c9-a337-24f231acef23</serial>
Aug 27 02:36:30 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 02:36:30 user nova-compute[72820]: </disk>
Aug 27 02:36:30 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:36:31 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Successfully detached device vdc from instance a67eea06-dabf-4115-9650-ea4098f80bd7 from the persistent domain config.
Aug 27 02:36:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a67eea06-dabf-4115-9650-ea4098f80bd7 from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:36:31 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:36:31 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:36:31 user nova-compute[72820]:   <target dev="vdc" bus="virtio"/>
Aug 27 02:36:31 user nova-compute[72820]:   <serial>97b9bbd7-d01d-46c9-a337-24f231acef23</serial>
Aug 27 02:36:31 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 02:36:31 user nova-compute[72820]: </disk>
Aug 27 02:36:31 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-0d6db5cf-5e08-4cd6-8d3e-5a6455d933e3 req-d97d9dd2-6176-4d9c-b7d4-9bf31dff9a90 service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Received event network-vif-plugged-6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0d6db5cf-5e08-4cd6-8d3e-5a6455d933e3 req-d97d9dd2-6176-4d9c-b7d4-9bf31dff9a90 service nova] Acquiring lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0d6db5cf-5e08-4cd6-8d3e-5a6455d933e3 req-d97d9dd2-6176-4d9c-b7d4-9bf31dff9a90 service nova] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0d6db5cf-5e08-4cd6-8d3e-5a6455d933e3 req-d97d9dd2-6176-4d9c-b7d4-9bf31dff9a90 service nova] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-0d6db5cf-5e08-4cd6-8d3e-5a6455d933e3 req-d97d9dd2-6176-4d9c-b7d4-9bf31dff9a90 service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] No waiting events found dispatching network-vif-plugged-6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:36:31 user nova-compute[72820]: WARNING nova.compute.manager [req-0d6db5cf-5e08-4cd6-8d3e-5a6455d933e3 req-d97d9dd2-6176-4d9c-b7d4-9bf31dff9a90 service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Received unexpected event network-vif-plugged-6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 for instance with vm_state building and task_state spawning.
Aug 27 02:36:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693103791.5160728, a67eea06-dabf-4115-9650-ea4098f80bd7 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a67eea06-dabf-4115-9650-ea4098f80bd7 {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:36:31 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Successfully detached device vdc from instance a67eea06-dabf-4115-9650-ea4098f80bd7 from the live domain config.
Aug 27 02:36:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OnlrpZPv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:36:31 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3103dc-78f0-465b-8cd5-d949b0e7b332]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:36:31 user nova-compute[72820]: No targets found.
Aug 27 02:36:31 user nova-compute[72820]: iSNS:
Aug 27 02:36:31 user nova-compute[72820]: No targets found.
Aug 27 02:36:31 user nova-compute[72820]: STATIC:
Aug 27 02:36:31 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b
Aug 27 02:36:31 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:36:31 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:36:31 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23
Aug 27 02:36:31 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:36:31 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:36:31 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:36:31 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:36:31 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:36:31 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb
Aug 27 02:36:31 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:36:31 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:36:31 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e
Aug 27 02:36:31 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:36:31 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:36:31 user nova-compute[72820]: FIRMWARE:
Aug 27 02:36:31 user nova-compute[72820]: No targets found.
Aug 27 02:36:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:36:31 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:36:31 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f3c419-4f05-4c47-a13a-b5f4e49908a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-f9454025-627d-4d21-9444-fb9ceac7498d req-f83e48f1-7339-46f5-9fc7-ab62fdc2e173 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Received event network-vif-plugged-72a72a4b-544c-4d18-a868-40b36ff67b7c {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f9454025-627d-4d21-9444-fb9ceac7498d req-f83e48f1-7339-46f5-9fc7-ab62fdc2e173 service nova] Acquiring lock "59de147f-63c9-4ded-811b-c6ff7b35b374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f9454025-627d-4d21-9444-fb9ceac7498d req-f83e48f1-7339-46f5-9fc7-ab62fdc2e173 service nova] Lock "59de147f-63c9-4ded-811b-c6ff7b35b374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f9454025-627d-4d21-9444-fb9ceac7498d req-f83e48f1-7339-46f5-9fc7-ab62fdc2e173 service nova] Lock "59de147f-63c9-4ded-811b-c6ff7b35b374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-f9454025-627d-4d21-9444-fb9ceac7498d req-f83e48f1-7339-46f5-9fc7-ab62fdc2e173 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] No waiting events found dispatching network-vif-plugged-72a72a4b-544c-4d18-a868-40b36ff67b7c {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:36:31 user nova-compute[72820]: WARNING nova.compute.manager [req-f9454025-627d-4d21-9444-fb9ceac7498d req-f83e48f1-7339-46f5-9fc7-ab62fdc2e173 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Received unexpected event network-vif-plugged-72a72a4b-544c-4d18-a868-40b36ff67b7c for instance with vm_state building and task_state spawning.
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bab4ec-e9be-4b49-a405-2a945039d9a4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:36:31 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:36:31 user nova-compute[72820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)
Aug 27 02:36:31 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:36:31 user nova-compute[72820]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b (non-flash)
Aug 27 02:36:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:36:31 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:36:31 user nova-compute[72820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 (non-flash)
Aug 27 02:36:31 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:36:31 user nova-compute[72820]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b (non-flash)
Aug 27 02:36:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c02db520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23'): ({'sdb'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Removing single pathed devices sdb {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5531be7b-3af4-4c48-887b-0391bd35bce5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf10409-bc4e-4dfc-9946-0e93e4f09dee]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Flushing IO for device /dev/sdb {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e264120-d322-44c9-a117-566098da669e]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a97da7-8808-4518-8006-7ec559513918]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab538b5d-48fa-49a0-be7b-fcd5333b1247]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8467c571-a7bb-4999-81c1-868b3855ea25]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23, portal: 172.16.0.220,3260]
Aug 27 02:36:31 user nova-compute[72820]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23, portal: 172.16.0.220,3260] successful.
Aug 27 02:36:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b9bbd7-d01d-46c9-a337-24f231acef23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c526961-8377-40c3-a056-3f1fcd411e59]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] <== disconnect_volume: return (409ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:36:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:36:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:32 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103792.6742144, 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:36:32 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] VM Resumed (Lifecycle Event)
Aug 27 02:36:32 user nova-compute[72820]: DEBUG nova.compute.manager [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:36:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:36:32 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Instance spawned successfully.
Aug 27 02:36:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:36:32 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:36:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:36:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:36:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:36:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:36:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:36:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:36:32 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:36:32 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:36:32 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103792.6745567, 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:36:32 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] VM Started (Lifecycle Event)
Aug 27 02:36:32 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:36:32 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:36:32 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:36:32 user nova-compute[72820]: INFO nova.compute.manager [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Took 8.41 seconds to spawn the instance on the hypervisor.
Aug 27 02:36:32 user nova-compute[72820]: DEBUG nova.compute.manager [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:36:33 user nova-compute[72820]: INFO nova.compute.manager [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Took 10.37 seconds to build instance.
Aug 27 02:36:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-355671ba-4c06-472e-944b-ba73958f0914 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.530s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.objects.instance [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'flavor' on Instance uuid a67eea06-dabf-4115-9650-ea4098f80bd7 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:36:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-16bdcf42-0df0-45fa-bebc-084dfd677cba tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.443s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103793.6220703, 59de147f-63c9-4ded-811b-c6ff7b35b374 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:36:33 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] VM Resumed (Lifecycle Event)
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:36:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:33 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Instance spawned successfully.
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:36:33 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103793.624478, 59de147f-63c9-4ded-811b-c6ff7b35b374 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:36:33 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] VM Started (Lifecycle Event)
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.compute.manager [req-58443177-e038-4e76-b971-01293c289150 req-514bf7b4-4d56-4439-8dc0-d678ed10ccf8 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Received event network-vif-plugged-72a72a4b-544c-4d18-a868-40b36ff67b7c {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:36:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-58443177-e038-4e76-b971-01293c289150 req-514bf7b4-4d56-4439-8dc0-d678ed10ccf8 service nova] Acquiring lock "59de147f-63c9-4ded-811b-c6ff7b35b374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-58443177-e038-4e76-b971-01293c289150 req-514bf7b4-4d56-4439-8dc0-d678ed10ccf8 service nova] Lock "59de147f-63c9-4ded-811b-c6ff7b35b374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-58443177-e038-4e76-b971-01293c289150 req-514bf7b4-4d56-4439-8dc0-d678ed10ccf8 service nova] Lock "59de147f-63c9-4ded-811b-c6ff7b35b374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.compute.manager [req-58443177-e038-4e76-b971-01293c289150 req-514bf7b4-4d56-4439-8dc0-d678ed10ccf8 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] No waiting events found dispatching network-vif-plugged-72a72a4b-544c-4d18-a868-40b36ff67b7c {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:36:33 user nova-compute[72820]: WARNING nova.compute.manager [req-58443177-e038-4e76-b971-01293c289150 req-514bf7b4-4d56-4439-8dc0-d678ed10ccf8 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Received unexpected event network-vif-plugged-72a72a4b-544c-4d18-a868-40b36ff67b7c for instance with vm_state building and task_state spawning.
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:36:33 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:36:33 user nova-compute[72820]: INFO nova.compute.manager [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Took 7.61 seconds to spawn the instance on the hypervisor.
Aug 27 02:36:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:36:33 user nova-compute[72820]: INFO nova.compute.manager [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Took 8.92 seconds to build instance.
Aug 27 02:36:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dcb9c2a1-4a20-439d-9314-30f913324974 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "59de147f-63c9-4ded-811b-c6ff7b35b374" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.101s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "f8f612f3-41c9-4dae-8d49-218d61720b15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:47 user nova-compute[72820]: INFO nova.compute.manager [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Terminating instance
Aug 27 02:36:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:36:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-3e35f255-bec1-4bfd-9248-43aa1cfa41d3 req-83183846-1e94-433b-bdca-5b2c899018db service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Received event network-vif-unplugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3e35f255-bec1-4bfd-9248-43aa1cfa41d3 req-83183846-1e94-433b-bdca-5b2c899018db service nova] Acquiring lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3e35f255-bec1-4bfd-9248-43aa1cfa41d3 req-83183846-1e94-433b-bdca-5b2c899018db service nova] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3e35f255-bec1-4bfd-9248-43aa1cfa41d3 req-83183846-1e94-433b-bdca-5b2c899018db service nova] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-3e35f255-bec1-4bfd-9248-43aa1cfa41d3 req-83183846-1e94-433b-bdca-5b2c899018db service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] No waiting events found dispatching network-vif-unplugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-3e35f255-bec1-4bfd-9248-43aa1cfa41d3 req-83183846-1e94-433b-bdca-5b2c899018db service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Received event network-vif-unplugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:48 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Instance destroyed successfully.
Aug 27 02:36:48 user nova-compute[72820]: DEBUG nova.objects.instance [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'resources' on Instance uuid f8f612f3-41c9-4dae-8d49-218d61720b15 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-402850353',display_name='tempest-ServerRescueNegativeTestJSON-server-402850353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-402850353',id=3,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:22:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca683dd78dbf41ec8fbe3d3f76011272',ramdisk_id='',reservation_id='r-g4u7ta58',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1600105144',owner_user_name='tempest-ServerRescueNegativeTestJSON-1600105144-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:22:09Z,user_data=None,user_id='a7f59dea3a6f4315828320a9ae6c721d',uuid=f8f612f3-41c9-4dae-8d49-218d61720b15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "address": "fa:16:3e:64:42:e4", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c62328f-29", "ovs_interfaceid": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converting VIF {"id": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "address": "fa:16:3e:64:42:e4", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c62328f-29", "ovs_interfaceid": "7c62328f-29e6-4fbb-88c7-31c0851c5fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:42:e4,bridge_name='br-int',has_traffic_filtering=True,id=7c62328f-29e6-4fbb-88c7-31c0851c5fe4,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c62328f-29') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG os_vif [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:42:e4,bridge_name='br-int',has_traffic_filtering=True,id=7c62328f-29e6-4fbb-88c7-31c0851c5fe4,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c62328f-29') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c62328f-29, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:48 user nova-compute[72820]: INFO os_vif [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:42:e4,bridge_name='br-int',has_traffic_filtering=True,id=7c62328f-29e6-4fbb-88c7-31c0851c5fe4,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c62328f-29')
Aug 27 02:36:48 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Deleting instance files /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15_del
Aug 27 02:36:48 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Deletion of /opt/stack/data/nova/instances/f8f612f3-41c9-4dae-8d49-218d61720b15_del complete
Aug 27 02:36:48 user nova-compute[72820]: INFO nova.compute.manager [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 27 02:36:48 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:36:48 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:36:49 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:36:49 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Took 0.56 seconds to deallocate network for instance.
Aug 27 02:36:49 user nova-compute[72820]: DEBUG nova.compute.manager [req-aa299bac-df06-4867-8497-fe7ad72ce0d0 req-507c8aab-d580-4531-84cc-e384599a2ad2 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Received event network-vif-deleted-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:36:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:49 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:36:49 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:36:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:49 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Deleted allocations for instance f8f612f3-41c9-4dae-8d49-218d61720b15
Aug 27 02:36:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e6633be7-dd41-4c66-92ae-944d3da29057 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.148s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:50 user nova-compute[72820]: DEBUG nova.compute.manager [req-a8fceedf-03bb-4399-bf86-fd8861885780 req-ef3bfb73-e228-423c-8256-457493138e57 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Received event network-vif-plugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:36:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a8fceedf-03bb-4399-bf86-fd8861885780 req-ef3bfb73-e228-423c-8256-457493138e57 service nova] Acquiring lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:36:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a8fceedf-03bb-4399-bf86-fd8861885780 req-ef3bfb73-e228-423c-8256-457493138e57 service nova] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:36:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a8fceedf-03bb-4399-bf86-fd8861885780 req-ef3bfb73-e228-423c-8256-457493138e57 service nova] Lock "f8f612f3-41c9-4dae-8d49-218d61720b15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:36:50 user nova-compute[72820]: DEBUG nova.compute.manager [req-a8fceedf-03bb-4399-bf86-fd8861885780 req-ef3bfb73-e228-423c-8256-457493138e57 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] No waiting events found dispatching network-vif-plugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:36:50 user nova-compute[72820]: WARNING nova.compute.manager [req-a8fceedf-03bb-4399-bf86-fd8861885780 req-ef3bfb73-e228-423c-8256-457493138e57 service nova] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Received unexpected event network-vif-plugged-7c62328f-29e6-4fbb-88c7-31c0851c5fe4 for instance with vm_state deleted and task_state None.
Aug 27 02:36:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:36:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid 26581695-c4b9-40b8-ab7a-34c99db0dadb {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid 6f37daba-9183-4111-bd01-f30cc4b83c2f {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid 1591319d-3d15-4c46-b823-4edddf018b5f {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid 85c8fa72-19be-49a0-975f-d6a0d30d011f {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid 15a1062a-ecfb-42b7-b8e5-03adbd6b8056 {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6 {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid 59de147f-63c9-4ded-811b-c6ff7b35b374 {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid a67eea06-dabf-4115-9650-ea4098f80bd7 {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "26581695-c4b9-40b8-ab7a-34c99db0dadb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "6f37daba-9183-4111-bd01-f30cc4b83c2f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "6f37daba-9183-4111-bd01-f30cc4b83c2f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "1591319d-3d15-4c46-b823-4edddf018b5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "85c8fa72-19be-49a0-975f-d6a0d30d011f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "59de147f-63c9-4ded-811b-c6ff7b35b374" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "59de147f-63c9-4ded-811b-c6ff7b35b374" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "1591319d-3d15-4c46-b823-4edddf018b5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "6f37daba-9183-4111-bd01-f30cc4b83c2f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "59de147f-63c9-4ded-811b-c6ff7b35b374" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:03 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103808.7048485, f8f612f3-41c9-4dae-8d49-218d61720b15 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:37:03 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] VM Stopped (Lifecycle Event)
Aug 27 02:37:03 user nova-compute[72820]: DEBUG nova.compute.manager [None req-aeb6a708-dbbd-4b48-a066-639a8f1ce70e None None] [instance: f8f612f3-41c9-4dae-8d49-218d61720b15] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:37:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:37:13 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:37:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:37:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:37:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:37:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:37:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:15 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:37:15 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:37:15 user nova-compute[72820]: INFO nova.compute.manager [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Rescuing
Aug 27 02:37:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "refresh_cache-53ce05c7-91a9-46f5-b4de-3c2c43642ef3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:37:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquired lock "refresh_cache-53ce05c7-91a9-46f5-b4de-3c2c43642ef3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:37:15 user nova-compute[72820]: DEBUG nova.network.neutron [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG nova.network.neutron [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Updating instance_info_cache with network_info: [{"id": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "address": "fa:16:3e:41:f5:3b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6fbe4-05", "ovs_interfaceid": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Releasing lock "refresh_cache-53ce05c7-91a9-46f5-b4de-3c2c43642ef3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG nova.compute.manager [req-a063cfc1-1aa7-4c62-b652-b289dc239683 req-47d56d68-c393-46fa-b72c-0340d7075370 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received event network-vif-unplugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a063cfc1-1aa7-4c62-b652-b289dc239683 req-47d56d68-c393-46fa-b72c-0340d7075370 service nova] Acquiring lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a063cfc1-1aa7-4c62-b652-b289dc239683 req-47d56d68-c393-46fa-b72c-0340d7075370 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a063cfc1-1aa7-4c62-b652-b289dc239683 req-47d56d68-c393-46fa-b72c-0340d7075370 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG nova.compute.manager [req-a063cfc1-1aa7-4c62-b652-b289dc239683 req-47d56d68-c393-46fa-b72c-0340d7075370 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] No waiting events found dispatching network-vif-unplugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:37:16 user nova-compute[72820]: WARNING nova.compute.manager [req-a063cfc1-1aa7-4c62-b652-b289dc239683 req-47d56d68-c393-46fa-b72c-0340d7075370 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received unexpected event network-vif-unplugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 for instance with vm_state active and task_state rescuing.
Aug 27 02:37:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:16 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Instance destroyed successfully.
Aug 27 02:37:16 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Attempting a stable device rescue
Aug 27 02:37:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72820) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Instance directory exists: not creating {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 02:37:16 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Creating image(s)
Aug 27 02:37:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "/opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "/opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "/opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'trusted_certs' on Instance uuid 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "04cabe174fe722a23b5de7a74b0e835155211fb3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "04cabe174fe722a23b5de7a74b0e835155211fb3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04cabe174fe722a23b5de7a74b0e835155211fb3.part --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04cabe174fe722a23b5de7a74b0e835155211fb3.part --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.images [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] 317ec64d-367f-4260-babd-f53482165609 was qcow2, converting to raw {{(pid=72820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.privsep.utils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04cabe174fe722a23b5de7a74b0e835155211fb3.part /opt/stack/data/nova/instances/_base/04cabe174fe722a23b5de7a74b0e835155211fb3.converted {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04cabe174fe722a23b5de7a74b0e835155211fb3.part /opt/stack/data/nova/instances/_base/04cabe174fe722a23b5de7a74b0e835155211fb3.converted" returned: 0 in 0.191s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04cabe174fe722a23b5de7a74b0e835155211fb3.converted --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04cabe174fe722a23b5de7a74b0e835155211fb3.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "04cabe174fe722a23b5de7a74b0e835155211fb3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.561s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "04cabe174fe722a23b5de7a74b0e835155211fb3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "04cabe174fe722a23b5de7a74b0e835155211fb3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04cabe174fe722a23b5de7a74b0e835155211fb3 --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.compute.manager [req-a05e8bcc-275e-45cc-b9e4-88b7b2c1120d req-e64b09ca-d1cf-4b6d-bfd6-c6994b214513 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received event network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a05e8bcc-275e-45cc-b9e4-88b7b2c1120d req-e64b09ca-d1cf-4b6d-bfd6-c6994b214513 service nova] Acquiring lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a05e8bcc-275e-45cc-b9e4-88b7b2c1120d req-e64b09ca-d1cf-4b6d-bfd6-c6994b214513 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a05e8bcc-275e-45cc-b9e4-88b7b2c1120d req-e64b09ca-d1cf-4b6d-bfd6-c6994b214513 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.compute.manager [req-a05e8bcc-275e-45cc-b9e4-88b7b2c1120d req-e64b09ca-d1cf-4b6d-bfd6-c6994b214513 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] No waiting events found dispatching network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:37:18 user nova-compute[72820]: WARNING nova.compute.manager [req-a05e8bcc-275e-45cc-b9e4-88b7b2c1120d req-e64b09ca-d1cf-4b6d-bfd6-c6994b214513 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received unexpected event network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 for instance with vm_state active and task_state rescuing.
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04cabe174fe722a23b5de7a74b0e835155211fb3 --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04cabe174fe722a23b5de7a74b0e835155211fb3,backing_fmt=raw /opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3/disk.rescue {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04cabe174fe722a23b5de7a74b0e835155211fb3,backing_fmt=raw /opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3/disk.rescue" returned: 0 in 0.047s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "04cabe174fe722a23b5de7a74b0e835155211fb3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'migration_context' on Instance uuid 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.objects.base [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Object Instance<53ce05c7-91a9-46f5-b4de-3c2c43642ef3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Start _get_guest_xml network_info=[{"id": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "address": "fa:16:3e:41:f5:3b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "vif_mac": "fa:16:3e:41:f5:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6fbe4-05", "ovs_interfaceid": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '317ec64d-367f-4260-babd-f53482165609', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f81cb5c2-1cb0-4335-ae89-4add530ba8a2', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RZjWPiSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '53ce05c7-91a9-46f5-b4de-3c2c43642ef3', 'attached_at': '', 'detached_at': '', 'volume_id': '67aebe6b-380b-426e-9490-a280e9f2e1eb', 'serial': '67aebe6b-380b-426e-9490-a280e9f2e1eb'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'resources' on Instance uuid 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.objects.base [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Object Instance<53ce05c7-91a9-46f5-b4de-3c2c43642ef3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'numa_topology' on Instance uuid 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.objects.base [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Object Instance<53ce05c7-91a9-46f5-b4de-3c2c43642ef3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:37:18 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:37:18 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'vcpu_model' on Instance uuid 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.objects.base [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Object Instance<53ce05c7-91a9-46f5-b4de-3c2c43642ef3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RZjWPiSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:37:18 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:37:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:37:18 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:37:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:37:18 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c938e829-88ec-4a7f-af32-f5b6fd768118]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = RZjWPiSw\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 27 02:37:18 user nova-compute[72820]: node.name = iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb
Aug 27 02:37:18 user nova-compute[72820]: node.tpgt = -1
Aug 27 02:37:18 user nova-compute[72820]: node.startup = automatic
Aug 27 02:37:18 user nova-compute[72820]: node.leading_login = No
Aug 27 02:37:18 user nova-compute[72820]: iface.iscsi_ifacename = default
Aug 27 02:37:18 user nova-compute[72820]: iface.net_ifacename = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.ipaddress = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.prefix_len = 0
Aug 27 02:37:18 user nova-compute[72820]: iface.hwaddress = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.transport_name = tcp
Aug 27 02:37:18 user nova-compute[72820]: iface.initiatorname = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.state = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.vlan_id = 0
Aug 27 02:37:18 user nova-compute[72820]: iface.vlan_priority = 0
Aug 27 02:37:18 user nova-compute[72820]: iface.vlan_state = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.iface_num = 0
Aug 27 02:37:18 user nova-compute[72820]: iface.mtu = 0
Aug 27 02:37:18 user nova-compute[72820]: iface.port = 0
Aug 27 02:37:18 user nova-compute[72820]: iface.bootproto = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.subnet_mask = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.gateway = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.dhcp_alt_client_id_state = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.dhcp_alt_client_id = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.dhcp_dns = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.dhcp_learn_iqn = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.dhcp_req_vendor_id_state = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.dhcp_vendor_id_state = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.dhcp_vendor_id = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.dhcp_slp_da = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.fragmentation = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.gratuitous_arp = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.incoming_forwarding = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.tos_state = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.tos = 0
Aug 27 02:37:18 user nova-compute[72820]: iface.ttl = 0
Aug 27 02:37:18 user nova-compute[72820]: iface.delayed_ack = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.tcp_nagle = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.tcp_wsf_state = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.tcp_wsf = 0
Aug 27 02:37:18 user nova-compute[72820]: iface.tcp_timer_scale = 0
Aug 27 02:37:18 user nova-compute[72820]: iface.tcp_timestamp = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.redirect = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.def_task_mgmt_timeout = 0
Aug 27 02:37:18 user nova-compute[72820]: iface.header_digest = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.data_digest = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.immediate_data = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.initial_r2t = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.data_seq_inorder = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.data_pdu_inorder = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.erl = 0
Aug 27 02:37:18 user nova-compute[72820]: iface.max_receive_data_len = 0
Aug 27 02:37:18 user nova-compute[72820]: iface.first_burst_len = 0
Aug 27 02:37:18 user nova-compute[72820]: iface.max_outstanding_r2t = 0
Aug 27 02:37:18 user nova-compute[72820]: iface.max_burst_len = 0
Aug 27 02:37:18 user nova-compute[72820]: iface.chap_auth = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.bidi_chap = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.strict_login_compliance = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.discovery_auth = <empty>
Aug 27 02:37:18 user nova-compute[72820]: iface.discovery_logout = <empty>
Aug 27 02:37:18 user nova-compute[72820]: node.discovery_address = <empty>
Aug 27 02:37:18 user nova-compute[72820]: node.discovery_port = 0
Aug 27 02:37:18 user nova-compute[72820]: node.discovery_type = static
Aug 27 02:37:18 user nova-compute[72820]: node.session.initial_cmdsn = 0
Aug 27 02:37:18 user nova-compute[72820]: node.session.initial_login_retry_max = 8
Aug 27 02:37:18 user nova-compute[72820]: node.session.xmit_thread_priority = -20
Aug 27 02:37:18 user nova-compute[72820]: node.session.cmds_max = 128
Aug 27 02:37:18 user nova-compute[72820]: node.session.queue_depth = 32
Aug 27 02:37:18 user nova-compute[72820]: node.session.nr_sessions = 1
Aug 27 02:37:18 user nova-compute[72820]: node.session.auth.authmethod = CHAP
Aug 27 02:37:18 user nova-compute[72820]: node.session.auth.username = RZjWPiSw
Aug 27 02:37:18 user nova-compute[72820]: node.session.auth.password = ***
Aug 27 02:37:18 user nova-compute[72820]: node.session.auth.username_in = <empty>
Aug 27 02:37:18 user nova-compute[72820]: node.session.auth.password_in = <empty>
Aug 27 02:37:18 user nova-compute[72820]: node.session.auth.chap_algs = MD5
Aug 27 02:37:18 user nova-compute[72820]: node.session.timeo.replacement_timeout = 120
Aug 27 02:37:18 user nova-compute[72820]: node.session.err_timeo.abort_timeout = 15
Aug 27 02:37:18 user nova-compute[72820]: node.session.err_timeo.lu_reset_timeout = 30
Aug 27 02:37:18 user nova-compute[72820]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 27 02:37:18 user nova-compute[72820]: node.session.err_timeo.host_reset_timeout = 60
Aug 27 02:37:18 user nova-compute[72820]: node.session.iscsi.FastAbort = Yes
Aug 27 02:37:18 user nova-compute[72820]: node.session.iscsi.InitialR2T = No
Aug 27 02:37:18 user nova-compute[72820]: node.session.iscsi.ImmediateData = Yes
Aug 27 02:37:18 user nova-compute[72820]: node.session.iscsi.FirstBurstLength = 262144
Aug 27 02:37:18 user nova-compute[72820]: node.session.iscsi.MaxBurstLength = 16776192
Aug 27 02:37:18 user nova-compute[72820]: node.session.iscsi.DefaultTime2Retain = 0
Aug 27 02:37:18 user nova-compute[72820]: node.session.iscsi.DefaultTime2Wait = 2
Aug 27 02:37:18 user nova-compute[72820]: node.session.iscsi.MaxConnections = 1
Aug 27 02:37:18 user nova-compute[72820]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 27 02:37:18 user nova-compute[72820]: node.session.iscsi.ERL = 0
Aug 27 02:37:18 user nova-compute[72820]: node.session.scan = manual
Aug 27 02:37:18 user nova-compute[72820]: node.session.reopen_max = 0
Aug 27 02:37:18 user nova-compute[72820]: node.conn[0].address = 172.16.0.220
Aug 27 02:37:18 user nova-compute[72820]: node.conn[0].port = 3260
Aug 27 02:37:18 user nova-compute[72820]: node.conn[0].startup = manual
Aug 27 02:37:18 user nova-compute[72820]: node.conn[0].tcp.window_size = 524288
Aug 27 02:37:18 user nova-compute[72820]: node.conn[0].tcp.type_of_service = 0
Aug 27 02:37:18 user nova-compute[72820]: node.conn[0].timeo.logout_timeout = 15
Aug 27 02:37:18 user nova-compute[72820]: node.conn[0].timeo.login_timeout = 15
Aug 27 02:37:18 user nova-compute[72820]: node.conn[0].timeo.auth_timeout = 45
Aug 27 02:37:18 user nova-compute[72820]: node.conn[0].timeo.noop_out_interval = 5
Aug 27 02:37:18 user nova-compute[72820]: node.conn[0].timeo.noop_out_timeout = 5
Aug 27 02:37:18 user nova-compute[72820]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 27 02:37:18 user nova-compute[72820]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 27 02:37:18 user nova-compute[72820]: node.conn[0].iscsi.HeaderDigest = None
Aug 27 02:37:18 user nova-compute[72820]: node.conn[0].iscsi.DataDigest = None
Aug 27 02:37:18 user nova-compute[72820]: node.conn[0].iscsi.IFMarker = No
Aug 27 02:37:18 user nova-compute[72820]: node.conn[0].iscsi.OFMarker = No
Aug 27 02:37:18 user nova-compute[72820]: # END RECORD
Aug 27 02:37:18 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3d547c-e5bb-4b49-8d8a-2166f57890c8]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e261390-9abb-4b7a-9fea-7981b1de4791]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:37:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RZjWPiSw {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RZjWPiSw" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27b76b7-0228-4b22-ad9a-aa26f80b8e5a]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RZjWPiSw'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fff552a-8708-45c9-a4a0-87cfdaadb7ea]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea113d9-774c-4ab1-ba87-ae146806cd57]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:37:19 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:37:19 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:37:19 user nova-compute[72820]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b (non-flash)
Aug 27 02:37:19 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:37:19 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:37:19 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:37:19 user nova-compute[72820]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b (non-flash)
Aug 27 02:37:19 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] HCTL ('35', '0', '0', 0) found on session 36 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[354ddc55-9d27-480a-a2ab-bcab3546069e]: (4, ('0 0 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Searching for a device in session 36 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RZjWPiSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.181s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] <== connect_volume: return (183ms) {'type': 'block', 'scsi_wwn': '26261343164666630', 'path': '/dev/sdd'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261343164666630', 'path': '/dev/sdd'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1580800830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1580800830',id=29,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:35:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f023daf1767f4088bf0a23524587e662',ramdisk_id='',reservation_id='r-y9v8i9bg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:35:59Z,user_data=None,user_id='bb67e11ecdd648a89dd58b4bf416060a',uuid=53ce05c7-91a9-46f5-b4de-3c2c43642ef3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "address": "fa:16:3e:41:f5:3b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "vif_mac": "fa:16:3e:41:f5:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6fbe4-05", "ovs_interfaceid": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converting VIF {"id": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "address": "fa:16:3e:41:f5:3b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "vif_mac": "fa:16:3e:41:f5:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6fbe4-05", "ovs_interfaceid": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:f5:3b,bridge_name='br-int',has_traffic_filtering=True,id=4aa6fbe4-05de-4a07-929c-868b2f949f09,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa6fbe4-05') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'pci_devices' on Instance uuid 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG nova.objects.base [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Object Instance<53ce05c7-91a9-46f5-b4de-3c2c43642ef3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:37:19 user nova-compute[72820]:   <uuid>53ce05c7-91a9-46f5-b4de-3c2c43642ef3</uuid>
Aug 27 02:37:19 user nova-compute[72820]:   <name>instance-0000001d</name>
Aug 27 02:37:19 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:37:19 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:37:19 user nova-compute[72820]:   <metadata>
Aug 27 02:37:19 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:37:19 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:37:19 user nova-compute[72820]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1580800830</nova:name>
Aug 27 02:37:19 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:37:18</nova:creationTime>
Aug 27 02:37:19 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:37:19 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:37:19 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:37:19 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:37:19 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:37:19 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:37:19 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:37:19 user nova-compute[72820]:       <nova:owner>
Aug 27 02:37:19 user nova-compute[72820]:         <nova:user uuid="bb67e11ecdd648a89dd58b4bf416060a">tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member</nova:user>
Aug 27 02:37:19 user nova-compute[72820]:         <nova:project uuid="f023daf1767f4088bf0a23524587e662">tempest-ServerBootFromVolumeStableRescueTest-2088708325</nova:project>
Aug 27 02:37:19 user nova-compute[72820]:       </nova:owner>
Aug 27 02:37:19 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:37:19 user nova-compute[72820]:       <nova:ports>
Aug 27 02:37:19 user nova-compute[72820]:         <nova:port uuid="4aa6fbe4-05de-4a07-929c-868b2f949f09">
Aug 27 02:37:19 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 02:37:19 user nova-compute[72820]:         </nova:port>
Aug 27 02:37:19 user nova-compute[72820]:       </nova:ports>
Aug 27 02:37:19 user nova-compute[72820]:     </nova:instance>
Aug 27 02:37:19 user nova-compute[72820]:   </metadata>
Aug 27 02:37:19 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:37:19 user nova-compute[72820]:     <system>
Aug 27 02:37:19 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:37:19 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:37:19 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:37:19 user nova-compute[72820]:       <entry name="serial">53ce05c7-91a9-46f5-b4de-3c2c43642ef3</entry>
Aug 27 02:37:19 user nova-compute[72820]:       <entry name="uuid">53ce05c7-91a9-46f5-b4de-3c2c43642ef3</entry>
Aug 27 02:37:19 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:37:19 user nova-compute[72820]:     </system>
Aug 27 02:37:19 user nova-compute[72820]:   </sysinfo>
Aug 27 02:37:19 user nova-compute[72820]:   <os>
Aug 27 02:37:19 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:37:19 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:37:19 user nova-compute[72820]:   </os>
Aug 27 02:37:19 user nova-compute[72820]:   <features>
Aug 27 02:37:19 user nova-compute[72820]:     <acpi/>
Aug 27 02:37:19 user nova-compute[72820]:     <apic/>
Aug 27 02:37:19 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:37:19 user nova-compute[72820]:   </features>
Aug 27 02:37:19 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:37:19 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:37:19 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:37:19 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:37:19 user nova-compute[72820]:   </clock>
Aug 27 02:37:19 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:37:19 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:37:19 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:37:19 user nova-compute[72820]:   </cpu>
Aug 27 02:37:19 user nova-compute[72820]:   <devices>
Aug 27 02:37:19 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:37:19 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:37:19 user nova-compute[72820]:       <source dev="/dev/sdd"/>
Aug 27 02:37:19 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:37:19 user nova-compute[72820]:       <serial>67aebe6b-380b-426e-9490-a280e9f2e1eb</serial>
Aug 27 02:37:19 user nova-compute[72820]:     </disk>
Aug 27 02:37:19 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:37:19 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:37:19 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3/disk.rescue"/>
Aug 27 02:37:19 user nova-compute[72820]:       <target dev="vdb" bus="virtio"/>
Aug 27 02:37:19 user nova-compute[72820]:       <boot order="1"/>
Aug 27 02:37:19 user nova-compute[72820]:     </disk>
Aug 27 02:37:19 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:37:19 user nova-compute[72820]:       <mac address="fa:16:3e:41:f5:3b"/>
Aug 27 02:37:19 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:37:19 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:37:19 user nova-compute[72820]:       <target dev="tap4aa6fbe4-05"/>
Aug 27 02:37:19 user nova-compute[72820]:     </interface>
Aug 27 02:37:19 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:37:19 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3/console.log" append="off"/>
Aug 27 02:37:19 user nova-compute[72820]:     </serial>
Aug 27 02:37:19 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:37:19 user nova-compute[72820]:     <video>
Aug 27 02:37:19 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:37:19 user nova-compute[72820]:     </video>
Aug 27 02:37:19 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:37:19 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:37:19 user nova-compute[72820]:     </rng>
Aug 27 02:37:19 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:37:19 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:37:19 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:37:19 user nova-compute[72820]:     </memballoon>
Aug 27 02:37:19 user nova-compute[72820]:   </devices>
Aug 27 02:37:19 user nova-compute[72820]: </domain>
Aug 27 02:37:19 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:37:19 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Instance destroyed successfully.
Aug 27 02:37:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] No VIF found with MAC fa:16:3e:41:f5:3b, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:37:19 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:37:20 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:37:20 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:37:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:20 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:37:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:20 user nova-compute[72820]: DEBUG nova.compute.manager [req-e22399b7-b8f0-44c1-ad2f-716209f9da8d req-8b3e745d-5f82-488a-9f2c-560d5ce1a12c service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received event network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e22399b7-b8f0-44c1-ad2f-716209f9da8d req-8b3e745d-5f82-488a-9f2c-560d5ce1a12c service nova] Acquiring lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e22399b7-b8f0-44c1-ad2f-716209f9da8d req-8b3e745d-5f82-488a-9f2c-560d5ce1a12c service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e22399b7-b8f0-44c1-ad2f-716209f9da8d req-8b3e745d-5f82-488a-9f2c-560d5ce1a12c service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:20 user nova-compute[72820]: DEBUG nova.compute.manager [req-e22399b7-b8f0-44c1-ad2f-716209f9da8d req-8b3e745d-5f82-488a-9f2c-560d5ce1a12c service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] No waiting events found dispatching network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:37:20 user nova-compute[72820]: WARNING nova.compute.manager [req-e22399b7-b8f0-44c1-ad2f-716209f9da8d req-8b3e745d-5f82-488a-9f2c-560d5ce1a12c service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received unexpected event network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 for instance with vm_state active and task_state rescuing.
Aug 27 02:37:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:37:21 user nova-compute[72820]: INFO nova.compute.manager [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Terminating instance
Aug 27 02:37:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:37:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59de147f-63c9-4ded-811b-c6ff7b35b374/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59de147f-63c9-4ded-811b-c6ff7b35b374/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59de147f-63c9-4ded-811b-c6ff7b35b374/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-27c16d27-b258-4ece-9dea-4eb83644fc15 req-32b67a0a-bb90-4ddf-84c6-61fa8271f3c1 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-vif-unplugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-27c16d27-b258-4ece-9dea-4eb83644fc15 req-32b67a0a-bb90-4ddf-84c6-61fa8271f3c1 service nova] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-27c16d27-b258-4ece-9dea-4eb83644fc15 req-32b67a0a-bb90-4ddf-84c6-61fa8271f3c1 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-27c16d27-b258-4ece-9dea-4eb83644fc15 req-32b67a0a-bb90-4ddf-84c6-61fa8271f3c1 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-27c16d27-b258-4ece-9dea-4eb83644fc15 req-32b67a0a-bb90-4ddf-84c6-61fa8271f3c1 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] No waiting events found dispatching network-vif-unplugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-27c16d27-b258-4ece-9dea-4eb83644fc15 req-32b67a0a-bb90-4ddf-84c6-61fa8271f3c1 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-vif-unplugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59de147f-63c9-4ded-811b-c6ff7b35b374/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:22 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Instance destroyed successfully.
Aug 27 02:37:22 user nova-compute[72820]: DEBUG nova.objects.instance [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'resources' on Instance uuid a67eea06-dabf-4115-9650-ea4098f80bd7 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T02:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-992417993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-992417993',id=24,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQesFgtpIxxL8sCQQFFOwOmpNR4N6yUY2jMITT3BKSU+Fz4HCZ8wmzaU//D1VTaaMjREKL1z86PTxVdQd+Q3SwZ0mDplq3tWNJOexRZYowP0u7zMy6yID/Tzq9KN8h6/g==',key_name='tempest-keypair-398704580',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5387e67178b141ae94025b9fd61f0124',ramdisk_id='',reservation_id='r-kyve7ptf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1913674887',owner_user_name='tempest-AttachVolumeShelveTestJSON-1913674887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6dbf37c8dec47aebcdc9c93ad1f3d69',uuid=a67eea06-dabf-4115-9650-ea4098f80bd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converting VIF {"id": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "address": "fa:16:3e:12:b9:b5", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e251de1-2d", "ovs_interfaceid": "8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:b5,bridge_name='br-int',has_traffic_filtering=True,id=8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e251de1-2d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG os_vif [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:b5,bridge_name='br-int',has_traffic_filtering=True,id=8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e251de1-2d') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e251de1-2d, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:37:22 user nova-compute[72820]: INFO os_vif [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:b5,bridge_name='br-int',has_traffic_filtering=True,id=8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e251de1-2d')
Aug 27 02:37:22 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Deleting instance files /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7_del
Aug 27 02:37:22 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Deletion of /opt/stack/data/nova/instances/a67eea06-dabf-4115-9650-ea4098f80bd7_del complete
Aug 27 02:37:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-dda89379-683d-4c75-b38f-27d4b4459c0b req-885eb7bf-c8d9-4a69-83d9-f66d2dd8b967 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received event network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-dda89379-683d-4c75-b38f-27d4b4459c0b req-885eb7bf-c8d9-4a69-83d9-f66d2dd8b967 service nova] Acquiring lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-dda89379-683d-4c75-b38f-27d4b4459c0b req-885eb7bf-c8d9-4a69-83d9-f66d2dd8b967 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-dda89379-683d-4c75-b38f-27d4b4459c0b req-885eb7bf-c8d9-4a69-83d9-f66d2dd8b967 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-dda89379-683d-4c75-b38f-27d4b4459c0b req-885eb7bf-c8d9-4a69-83d9-f66d2dd8b967 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] No waiting events found dispatching network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:37:22 user nova-compute[72820]: WARNING nova.compute.manager [req-dda89379-683d-4c75-b38f-27d4b4459c0b req-885eb7bf-c8d9-4a69-83d9-f66d2dd8b967 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received unexpected event network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 for instance with vm_state active and task_state rescuing.
Aug 27 02:37:22 user nova-compute[72820]: INFO nova.compute.manager [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 27 02:37:22 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:37:22 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Removed pending event for 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 due to event {{(pid=72820) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103843.0755749, 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:37:23 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] VM Resumed (Lifecycle Event)
Aug 27 02:37:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-bac42578-8d82-4432-9220-7fd3137ea3af tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:37:23 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 02:37:23 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103843.076156, 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:37:23 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] VM Started (Lifecycle Event)
Aug 27 02:37:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:23 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Error from libvirt while getting description of instance-00000018: [Error Code 42] Domain not found: no domain with matching uuid 'a67eea06-dabf-4115-9650-ea4098f80bd7' (instance-00000018): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a67eea06-dabf-4115-9650-ea4098f80bd7' (instance-00000018)
Aug 27 02:37:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-8b11c884-b944-4d61-ad9c-a86c8f649912 req-35ac0124-1a8e-431b-9293-2501d3b8e6a7 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-vif-deleted-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:24 user nova-compute[72820]: INFO nova.compute.manager [req-8b11c884-b944-4d61-ad9c-a86c8f649912 req-35ac0124-1a8e-431b-9293-2501d3b8e6a7 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Neutron deleted interface 8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8; detaching it from the instance and deleting it from the info cache
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.network.neutron [req-8b11c884-b944-4d61-ad9c-a86c8f649912 req-35ac0124-1a8e-431b-9293-2501d3b8e6a7 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:37:24 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Took 1.89 seconds to deallocate network for instance.
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] No waiting events found dispatching network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:37:24 user nova-compute[72820]: WARNING nova.compute.manager [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received unexpected event network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 for instance with vm_state active and task_state deleting.
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] No waiting events found dispatching network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:37:24 user nova-compute[72820]: WARNING nova.compute.manager [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received unexpected event network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 for instance with vm_state active and task_state deleting.
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] No waiting events found dispatching network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:37:24 user nova-compute[72820]: WARNING nova.compute.manager [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received unexpected event network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 for instance with vm_state active and task_state deleting.
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-vif-unplugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] No waiting events found dispatching network-vif-unplugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-vif-unplugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received event network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] Acquiring lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] No waiting events found dispatching network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:37:24 user nova-compute[72820]: WARNING nova.compute.manager [req-0341df7b-7506-473a-83f4-c33f200d92ba req-683d061b-19ca-4829-8318-241b0ef902f5 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Received unexpected event network-vif-plugged-8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8 for instance with vm_state active and task_state deleting.
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-8b11c884-b944-4d61-ad9c-a86c8f649912 req-35ac0124-1a8e-431b-9293-2501d3b8e6a7 service nova] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Detach interface failed, port_id=8e251de1-2da6-4cfd-8d4e-310d5fc2cbd8, reason: Instance a67eea06-dabf-4115-9650-ea4098f80bd7 could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 02:37:24 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:37:24 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7206MB free_disk=25.00815200805664GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 26581695-c4b9-40b8-ab7a-34c99db0dadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1591319d-3d15-4c46-b823-4edddf018b5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 15a1062a-ecfb-42b7-b8e5-03adbd6b8056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 85c8fa72-19be-49a0-975f-d6a0d30d011f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance a67eea06-dabf-4115-9650-ea4098f80bd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 59de147f-63c9-4ded-811b-c6ff7b35b374 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:37:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:37:25 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:37:25 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:37:25 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:37:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.612s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.566s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:25 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:37:25 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:37:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:25 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Deleted allocations for instance a67eea06-dabf-4115-9650-ea4098f80bd7
Aug 27 02:37:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b9109748-2676-4333-8936-5e069014e149 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "a67eea06-dabf-4115-9650-ea4098f80bd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.374s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:37:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:37:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:37:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:37:31 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:37:32 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Updating instance_info_cache with network_info: [{"id": "a0280116-060c-4078-b415-7abd9005c221", "address": "fa:16:3e:dc:2f:1b", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0280116-06", "ovs_interfaceid": "a0280116-060c-4078-b415-7abd9005c221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:37:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-6f37daba-9183-4111-bd01-f30cc4b83c2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:37:32 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:37:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:37:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:37:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:37:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:37:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:37 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103842.5615454, a67eea06-dabf-4115-9650-ea4098f80bd7 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:37:37 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] VM Stopped (Lifecycle Event)
Aug 27 02:37:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7e475c54-105c-46d2-a121-33d8794d9c57 None None] [instance: a67eea06-dabf-4115-9650-ea4098f80bd7] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:37:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "26581695-c4b9-40b8-ab7a-34c99db0dadb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:38 user nova-compute[72820]: INFO nova.compute.manager [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Terminating instance
Aug 27 02:37:38 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:37:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-bddf372a-6490-4464-aa9f-2f4e8cc97a75 req-99de2b34-40a9-49fe-8f88-ba24bc38fade service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received event network-vif-unplugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bddf372a-6490-4464-aa9f-2f4e8cc97a75 req-99de2b34-40a9-49fe-8f88-ba24bc38fade service nova] Acquiring lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bddf372a-6490-4464-aa9f-2f4e8cc97a75 req-99de2b34-40a9-49fe-8f88-ba24bc38fade service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bddf372a-6490-4464-aa9f-2f4e8cc97a75 req-99de2b34-40a9-49fe-8f88-ba24bc38fade service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-bddf372a-6490-4464-aa9f-2f4e8cc97a75 req-99de2b34-40a9-49fe-8f88-ba24bc38fade service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] No waiting events found dispatching network-vif-unplugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:37:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-bddf372a-6490-4464-aa9f-2f4e8cc97a75 req-99de2b34-40a9-49fe-8f88-ba24bc38fade service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received event network-vif-unplugged-4a579280-0dce-49fb-861a-4577ba1d70a3 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:37:39 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Instance destroyed successfully.
Aug 27 02:37:39 user nova-compute[72820]: DEBUG nova.objects.instance [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lazy-loading 'resources' on Instance uuid 26581695-c4b9-40b8-ab7a-34c99db0dadb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:37:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1979247934',display_name='tempest-ServerRescueNegativeTestJSON-server-1979247934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1979247934',id=2,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:25:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca683dd78dbf41ec8fbe3d3f76011272',ramdisk_id='',reservation_id='r-wryc5lmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1600105144',owner_user_name='tempest-ServerRescueNegativeTestJSON-1600105144-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:26:57Z,user_data=None,user_id='a7f59dea3a6f4315828320a9ae6c721d',uuid=26581695-c4b9-40b8-ab7a-34c99db0dadb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a579280-0dce-49fb-861a-4577ba1d70a3", "address": "fa:16:3e:37:4e:12", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a579280-0d", "ovs_interfaceid": "4a579280-0dce-49fb-861a-4577ba1d70a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:37:39 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converting VIF {"id": "4a579280-0dce-49fb-861a-4577ba1d70a3", "address": "fa:16:3e:37:4e:12", "network": {"id": "8d5e1c52-feed-4e64-8414-3c0a68b9813f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1492738494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca683dd78dbf41ec8fbe3d3f76011272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a579280-0d", "ovs_interfaceid": "4a579280-0dce-49fb-861a-4577ba1d70a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:37:39 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:4e:12,bridge_name='br-int',has_traffic_filtering=True,id=4a579280-0dce-49fb-861a-4577ba1d70a3,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a579280-0d') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:37:39 user nova-compute[72820]: DEBUG os_vif [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:4e:12,bridge_name='br-int',has_traffic_filtering=True,id=4a579280-0dce-49fb-861a-4577ba1d70a3,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a579280-0d') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:37:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a579280-0d, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:37:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:37:39 user nova-compute[72820]: INFO os_vif [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:4e:12,bridge_name='br-int',has_traffic_filtering=True,id=4a579280-0dce-49fb-861a-4577ba1d70a3,network=Network(8d5e1c52-feed-4e64-8414-3c0a68b9813f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a579280-0d')
Aug 27 02:37:39 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Deleting instance files /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb_del
Aug 27 02:37:39 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Deletion of /opt/stack/data/nova/instances/26581695-c4b9-40b8-ab7a-34c99db0dadb_del complete
Aug 27 02:37:39 user nova-compute[72820]: INFO nova.compute.manager [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 27 02:37:39 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:37:39 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:37:39 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:37:39 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:37:39 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Took 0.47 seconds to deallocate network for instance.
Aug 27 02:37:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:40 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:37:40 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:37:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:40 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Deleted allocations for instance 26581695-c4b9-40b8-ab7a-34c99db0dadb
Aug 27 02:37:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f669d412-c649-44a4-9aaf-83f7cdd034b3 tempest-ServerRescueNegativeTestJSON-1600105144 tempest-ServerRescueNegativeTestJSON-1600105144-project-member] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.021s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-e1825001-3bca-4919-ad67-36d3028dab17 req-456480a2-de08-4b19-8af7-2c1b8c604c72 service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received event network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e1825001-3bca-4919-ad67-36d3028dab17 req-456480a2-de08-4b19-8af7-2c1b8c604c72 service nova] Acquiring lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e1825001-3bca-4919-ad67-36d3028dab17 req-456480a2-de08-4b19-8af7-2c1b8c604c72 service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e1825001-3bca-4919-ad67-36d3028dab17 req-456480a2-de08-4b19-8af7-2c1b8c604c72 service nova] Lock "26581695-c4b9-40b8-ab7a-34c99db0dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-e1825001-3bca-4919-ad67-36d3028dab17 req-456480a2-de08-4b19-8af7-2c1b8c604c72 service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] No waiting events found dispatching network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:37:40 user nova-compute[72820]: WARNING nova.compute.manager [req-e1825001-3bca-4919-ad67-36d3028dab17 req-456480a2-de08-4b19-8af7-2c1b8c604c72 service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received unexpected event network-vif-plugged-4a579280-0dce-49fb-861a-4577ba1d70a3 for instance with vm_state deleted and task_state None.
Aug 27 02:37:40 user nova-compute[72820]: DEBUG nova.compute.manager [req-e1825001-3bca-4919-ad67-36d3028dab17 req-456480a2-de08-4b19-8af7-2c1b8c604c72 service nova] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Received event network-vif-deleted-4a579280-0dce-49fb-861a-4577ba1d70a3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:45 user nova-compute[72820]: INFO nova.compute.manager [None req-d55e49f1-6173-4f35-8ff7-a8ad99dab1f6 tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Get console output
Aug 27 02:37:45 user nova-compute[72820]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 27 02:37:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:53 user nova-compute[72820]: INFO nova.compute.manager [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Terminating instance
Aug 27 02:37:53 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:37:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-61210bf2-4de0-41dd-b992-db60571215f8 req-b0c7f2b3-6065-4d00-84c3-09a386f055f4 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Received event network-vif-unplugged-fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-61210bf2-4de0-41dd-b992-db60571215f8 req-b0c7f2b3-6065-4d00-84c3-09a386f055f4 service nova] Acquiring lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-61210bf2-4de0-41dd-b992-db60571215f8 req-b0c7f2b3-6065-4d00-84c3-09a386f055f4 service nova] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-61210bf2-4de0-41dd-b992-db60571215f8 req-b0c7f2b3-6065-4d00-84c3-09a386f055f4 service nova] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-61210bf2-4de0-41dd-b992-db60571215f8 req-b0c7f2b3-6065-4d00-84c3-09a386f055f4 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] No waiting events found dispatching network-vif-unplugged-fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:37:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-61210bf2-4de0-41dd-b992-db60571215f8 req-b0c7f2b3-6065-4d00-84c3-09a386f055f4 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Received event network-vif-unplugged-fb5553d4-177e-48d6-ba60-3de8b50c03da for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103859.1870797, 26581695-c4b9-40b8-ab7a-34c99db0dadb => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:37:54 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] VM Stopped (Lifecycle Event)
Aug 27 02:37:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-274f7928-7450-4c4e-9ddc-3e9d6ea05eab None None] [instance: 26581695-c4b9-40b8-ab7a-34c99db0dadb] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:54 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Instance destroyed successfully.
Aug 27 02:37:54 user nova-compute[72820]: DEBUG nova.objects.instance [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lazy-loading 'resources' on Instance uuid c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1060042085',display_name='tempest-TestVolumeBootPattern-server-1060042085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1060042085',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:36:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84f02ddcfa2b4571a4d7cacf1287aebd',ramdisk_id='',reservation_id='r-pbnxvdyw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-631676638',owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:36:11Z,user_data=None,user_id='878038feacda4094b5d2c9e3814c8bf0',uuid=c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "address": "fa:16:3e:2d:6d:79", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5553d4-17", "ovs_interfaceid": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converting VIF {"id": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "address": "fa:16:3e:2d:6d:79", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5553d4-17", "ovs_interfaceid": "fb5553d4-177e-48d6-ba60-3de8b50c03da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=fb5553d4-177e-48d6-ba60-3de8b50c03da,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5553d4-17') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_vif [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=fb5553d4-177e-48d6-ba60-3de8b50c03da,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5553d4-17') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb5553d4-17, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:37:54 user nova-compute[72820]: INFO os_vif [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=fb5553d4-177e-48d6-ba60-3de8b50c03da,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5553d4-17')
Aug 27 02:37:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WUhymrpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:37:54 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5730ff2-9c11-4ea4-884f-4700733fdb6e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:37:54 user nova-compute[72820]: No targets found.
Aug 27 02:37:54 user nova-compute[72820]: iSNS:
Aug 27 02:37:54 user nova-compute[72820]: No targets found.
Aug 27 02:37:54 user nova-compute[72820]: STATIC:
Aug 27 02:37:54 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b
Aug 27 02:37:54 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:37:54 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:37:54 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:37:54 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:37:54 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:37:54 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb
Aug 27 02:37:54 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:37:54 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:37:54 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e
Aug 27 02:37:54 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:37:54 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:37:54 user nova-compute[72820]: FIRMWARE:
Aug 27 02:37:54 user nova-compute[72820]: No targets found.
Aug 27 02:37:54 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:37:54 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:37:54 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c61bdc1-339e-4501-a2d0-606141b7b63d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a129fbf-269d-4731-a33a-9a8b993d7c41]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:37:54 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:37:54 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:37:54 user nova-compute[72820]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b (non-flash)
Aug 27 02:37:54 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:37:54 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:37:54 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:37:54 user nova-compute[72820]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b (non-flash)
Aug 27 02:37:54 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a05e7e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b'): ({'sde'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Removing single pathed devices sde {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1bdca6-9ee1-4a9c-a23f-b444cf8d96d6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c73913f-dabf-497b-8f62-c3eb1f552536]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Flushing IO for device /dev/sde {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[67544ea4-b832-442d-98ee-8a26584a34eb]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[73094b38-7311-4199-8de3-79e72b4037ba]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] SCSI volumes sde have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_edb2f62', '/dev/disk/by-id/scsi-1SCST_BIOedb2f62-f291f3163ed1f3ba', '/dev/disk/by-id/scsi-26632393166333136') {{(pid=84057) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 02:37:54 user nova-compute[72820]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26632393166333136
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3011755-0b75-4a2a-9d08-29121e9dddf8]: (4, None) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8625bd-8faf-4d87-89bc-201b40844533]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cd7823-41e2-4ceb-a255-847bb2a3aaff]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b, portal: 172.16.0.220,3260]
Aug 27 02:37:54 user nova-compute[72820]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b, portal: 172.16.0.220,3260] successful.
Aug 27 02:37:54 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d857c5a-4c65-48a3-a0e5-c3a71170f60b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe48a1f0-a4a7-40d2-b5b5-f81dd3a014e9]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] <== disconnect_volume: return (378ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:37:54 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Deleting instance files /opt/stack/data/nova/instances/c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6_del
Aug 27 02:37:54 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Deletion of /opt/stack/data/nova/instances/c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6_del complete
Aug 27 02:37:54 user nova-compute[72820]: INFO nova.compute.manager [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 27 02:37:54 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:37:55 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Took 0.86 seconds to deallocate network for instance.
Aug 27 02:37:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Received event network-vif-plugged-fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] Acquiring lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] No waiting events found dispatching network-vif-plugged-fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:37:55 user nova-compute[72820]: WARNING nova.compute.manager [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Received unexpected event network-vif-plugged-fb5553d4-177e-48d6-ba60-3de8b50c03da for instance with vm_state active and task_state deleting.
Aug 27 02:37:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Received event network-vif-plugged-fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] Acquiring lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] No waiting events found dispatching network-vif-plugged-fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:37:55 user nova-compute[72820]: WARNING nova.compute.manager [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Received unexpected event network-vif-plugged-fb5553d4-177e-48d6-ba60-3de8b50c03da for instance with vm_state active and task_state deleting.
Aug 27 02:37:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Received event network-vif-plugged-fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] Acquiring lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] No waiting events found dispatching network-vif-plugged-fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:37:55 user nova-compute[72820]: WARNING nova.compute.manager [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Received unexpected event network-vif-plugged-fb5553d4-177e-48d6-ba60-3de8b50c03da for instance with vm_state active and task_state deleting.
Aug 27 02:37:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Received event network-vif-unplugged-fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] Acquiring lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] No waiting events found dispatching network-vif-unplugged-fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Received event network-vif-unplugged-fb5553d4-177e-48d6-ba60-3de8b50c03da for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Received event network-vif-plugged-fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] Acquiring lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] No waiting events found dispatching network-vif-plugged-fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:37:55 user nova-compute[72820]: WARNING nova.compute.manager [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Received unexpected event network-vif-plugged-fb5553d4-177e-48d6-ba60-3de8b50c03da for instance with vm_state active and task_state deleting.
Aug 27 02:37:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-78aa5d20-af05-46f8-847b-b20074792ba1 req-f3e257ad-49f3-4113-9f53-3ba6076cee74 service nova] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Received event network-vif-deleted-fb5553d4-177e-48d6-ba60-3de8b50c03da {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:37:56 user nova-compute[72820]: INFO nova.compute.manager [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Took 0.81 seconds to detach 1 volumes for instance.
Aug 27 02:37:56 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Deleting volume: 9d857c5a-4c65-48a3-a0e5-c3a71170f60b {{(pid=72820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 02:37:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:37:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:37:56 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:37:56 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:37:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:56 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Deleted allocations for instance c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6
Aug 27 02:37:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-dd032767-9b3b-4275-a70d-6be42ad2aa4b tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.472s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:37:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:37:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:38:09 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103874.200776, c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:38:09 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] VM Stopped (Lifecycle Event)
Aug 27 02:38:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a9604361-899d-4df9-a32f-d4b5c7cac651 None None] [instance: c5ff1e3f-e89e-4165-9f5e-8d7e1af81dd6] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:38:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:38:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:38:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:38:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:38:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:12 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:38:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-9512307d-5b91-4111-aeca-57ecfcf28c55 req-996c02c8-8c4d-434e-953f-f42b11d57909 service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Received event network-changed-6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:38:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-9512307d-5b91-4111-aeca-57ecfcf28c55 req-996c02c8-8c4d-434e-953f-f42b11d57909 service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Refreshing instance network info cache due to event network-changed-6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:38:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9512307d-5b91-4111-aeca-57ecfcf28c55 req-996c02c8-8c4d-434e-953f-f42b11d57909 service nova] Acquiring lock "refresh_cache-59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:38:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9512307d-5b91-4111-aeca-57ecfcf28c55 req-996c02c8-8c4d-434e-953f-f42b11d57909 service nova] Acquired lock "refresh_cache-59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:38:13 user nova-compute[72820]: DEBUG nova.network.neutron [req-9512307d-5b91-4111-aeca-57ecfcf28c55 req-996c02c8-8c4d-434e-953f-f42b11d57909 service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Refreshing network info cache for port 6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:38:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:14 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:38:14 user nova-compute[72820]: DEBUG nova.network.neutron [req-9512307d-5b91-4111-aeca-57ecfcf28c55 req-996c02c8-8c4d-434e-953f-f42b11d57909 service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Updated VIF entry in instance network info cache for port 6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:38:14 user nova-compute[72820]: DEBUG nova.network.neutron [req-9512307d-5b91-4111-aeca-57ecfcf28c55 req-996c02c8-8c4d-434e-953f-f42b11d57909 service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Updating instance_info_cache with network_info: [{"id": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "address": "fa:16:3e:94:19:e2", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9d1ee5-3b", "ovs_interfaceid": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:38:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9512307d-5b91-4111-aeca-57ecfcf28c55 req-996c02c8-8c4d-434e-953f-f42b11d57909 service nova] Releasing lock "refresh_cache-59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquiring lock "59de147f-63c9-4ded-811b-c6ff7b35b374" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "59de147f-63c9-4ded-811b-c6ff7b35b374" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquiring lock "59de147f-63c9-4ded-811b-c6ff7b35b374-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "59de147f-63c9-4ded-811b-c6ff7b35b374-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "59de147f-63c9-4ded-811b-c6ff7b35b374-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:15 user nova-compute[72820]: INFO nova.compute.manager [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Terminating instance
Aug 27 02:38:15 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG nova.compute.manager [req-6e1532ad-2774-4503-aa96-68a8319a13c2 req-e4e4b029-fd40-4235-b764-ca0625eda192 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Received event network-vif-unplugged-72a72a4b-544c-4d18-a868-40b36ff67b7c {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6e1532ad-2774-4503-aa96-68a8319a13c2 req-e4e4b029-fd40-4235-b764-ca0625eda192 service nova] Acquiring lock "59de147f-63c9-4ded-811b-c6ff7b35b374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6e1532ad-2774-4503-aa96-68a8319a13c2 req-e4e4b029-fd40-4235-b764-ca0625eda192 service nova] Lock "59de147f-63c9-4ded-811b-c6ff7b35b374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6e1532ad-2774-4503-aa96-68a8319a13c2 req-e4e4b029-fd40-4235-b764-ca0625eda192 service nova] Lock "59de147f-63c9-4ded-811b-c6ff7b35b374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG nova.compute.manager [req-6e1532ad-2774-4503-aa96-68a8319a13c2 req-e4e4b029-fd40-4235-b764-ca0625eda192 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] No waiting events found dispatching network-vif-unplugged-72a72a4b-544c-4d18-a868-40b36ff67b7c {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG nova.compute.manager [req-6e1532ad-2774-4503-aa96-68a8319a13c2 req-e4e4b029-fd40-4235-b764-ca0625eda192 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Received event network-vif-unplugged-72a72a4b-544c-4d18-a868-40b36ff67b7c for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:38:15 user nova-compute[72820]: INFO nova.compute.claims [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Claim successful on node user
Aug 27 02:38:16 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Instance destroyed successfully.
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.objects.instance [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lazy-loading 'resources' on Instance uuid 59de147f-63c9-4ded-811b-c6ff7b35b374 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1331150882',display_name='tempest-VolumesActionsTest-instance-1331150882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1331150882',id=31,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:36:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4bc4037270664e758e9411acbfe2d3a3',ramdisk_id='',reservation_id='r-9dkulls4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1595890573',owner_user_name='tempest-VolumesActionsTest-1595890573-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:36:34Z,user_data=None,user_id='5607a2e69fce42b7af26a8c3afdb3589',uuid=59de147f-63c9-4ded-811b-c6ff7b35b374,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "address": "fa:16:3e:c6:e7:26", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a72a4b-54", "ovs_interfaceid": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Converting VIF {"id": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "address": "fa:16:3e:c6:e7:26", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a72a4b-54", "ovs_interfaceid": "72a72a4b-544c-4d18-a868-40b36ff67b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:e7:26,bridge_name='br-int',has_traffic_filtering=True,id=72a72a4b-544c-4d18-a868-40b36ff67b7c,network=Network(ae065ae6-bfe7-4b57-81fc-8cd4df52cec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a72a4b-54') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG os_vif [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:e7:26,bridge_name='br-int',has_traffic_filtering=True,id=72a72a4b-544c-4d18-a868-40b36ff67b7c,network=Network(ae065ae6-bfe7-4b57-81fc-8cd4df52cec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a72a4b-54') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72a72a4b-54, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:38:16 user nova-compute[72820]: INFO os_vif [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:e7:26,bridge_name='br-int',has_traffic_filtering=True,id=72a72a4b-544c-4d18-a868-40b36ff67b7c,network=Network(ae065ae6-bfe7-4b57-81fc-8cd4df52cec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a72a4b-54')
Aug 27 02:38:16 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Deleting instance files /opt/stack/data/nova/instances/59de147f-63c9-4ded-811b-c6ff7b35b374_del
Aug 27 02:38:16 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Deletion of /opt/stack/data/nova/instances/59de147f-63c9-4ded-811b-c6ff7b35b374_del complete
Aug 27 02:38:16 user nova-compute[72820]: INFO nova.compute.manager [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 27 02:38:16 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.network.neutron [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:38:16 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.policy [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6dbf37c8dec47aebcdc9c93ad1f3d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5387e67178b141ae94025b9fd61f0124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:38:16 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Creating image(s)
Aug 27 02:38:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "/opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "/opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "/opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.compute.manager [req-2d5fb0e0-2b25-4ad4-b4ac-23d94ae2d693 req-757e42d4-a58a-4b38-9b21-18d9fa9f3353 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Received event network-vif-deleted-72a72a4b-544c-4d18-a868-40b36ff67b7c {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:38:16 user nova-compute[72820]: INFO nova.compute.manager [req-2d5fb0e0-2b25-4ad4-b4ac-23d94ae2d693 req-757e42d4-a58a-4b38-9b21-18d9fa9f3353 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Neutron deleted interface 72a72a4b-544c-4d18-a868-40b36ff67b7c; detaching it from the instance and deleting it from the info cache
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.network.neutron [req-2d5fb0e0-2b25-4ad4-b4ac-23d94ae2d693 req-757e42d4-a58a-4b38-9b21-18d9fa9f3353 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:38:16 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Took 0.60 seconds to deallocate network for instance.
Aug 27 02:38:16 user nova-compute[72820]: DEBUG nova.compute.manager [req-2d5fb0e0-2b25-4ad4-b4ac-23d94ae2d693 req-757e42d4-a58a-4b38-9b21-18d9fa9f3353 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Detach interface failed, port_id=72a72a4b-544c-4d18-a868-40b36ff67b7c, reason: Instance 59de147f-63c9-4ded-811b-c6ff7b35b374 could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.210s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:16 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.206s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk 1073741824" returned: 0 in 0.053s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.215s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.581s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:17 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Deleted allocations for instance 59de147f-63c9-4ded-811b-c6ff7b35b374
Aug 27 02:38:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Cannot resize image /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Ensure instance console log exists: /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG nova.network.neutron [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Successfully created port: 44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f30534f5-d9bb-4a88-a2d4-008795f436f8 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "59de147f-63c9-4ded-811b-c6ff7b35b374" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.388s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG nova.compute.manager [req-51037beb-21a3-497c-bef1-b711bbc5614d req-5e26955b-3fe8-48f1-83af-8afeb8f40760 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Received event network-vif-plugged-72a72a4b-544c-4d18-a868-40b36ff67b7c {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-51037beb-21a3-497c-bef1-b711bbc5614d req-5e26955b-3fe8-48f1-83af-8afeb8f40760 service nova] Acquiring lock "59de147f-63c9-4ded-811b-c6ff7b35b374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-51037beb-21a3-497c-bef1-b711bbc5614d req-5e26955b-3fe8-48f1-83af-8afeb8f40760 service nova] Lock "59de147f-63c9-4ded-811b-c6ff7b35b374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-51037beb-21a3-497c-bef1-b711bbc5614d req-5e26955b-3fe8-48f1-83af-8afeb8f40760 service nova] Lock "59de147f-63c9-4ded-811b-c6ff7b35b374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:17 user nova-compute[72820]: DEBUG nova.compute.manager [req-51037beb-21a3-497c-bef1-b711bbc5614d req-5e26955b-3fe8-48f1-83af-8afeb8f40760 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] No waiting events found dispatching network-vif-plugged-72a72a4b-544c-4d18-a868-40b36ff67b7c {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:38:17 user nova-compute[72820]: WARNING nova.compute.manager [req-51037beb-21a3-497c-bef1-b711bbc5614d req-5e26955b-3fe8-48f1-83af-8afeb8f40760 service nova] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Received unexpected event network-vif-plugged-72a72a4b-544c-4d18-a868-40b36ff67b7c for instance with vm_state deleted and task_state None.
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.network.neutron [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Successfully updated port: 44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquired lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.network.neutron [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.compute.manager [req-3088a306-6b7a-4451-8ef6-50dcb23f0f0a req-8c7247a4-913a-4fac-ab8f-322cbbe628cf service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received event network-changed-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.compute.manager [req-3088a306-6b7a-4451-8ef6-50dcb23f0f0a req-8c7247a4-913a-4fac-ab8f-322cbbe628cf service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Refreshing instance network info cache due to event network-changed-44b914a9-6a23-44dc-9711-dd33dfdd276b. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3088a306-6b7a-4451-8ef6-50dcb23f0f0a req-8c7247a4-913a-4fac-ab8f-322cbbe628cf service nova] Acquiring lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.network.neutron [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.objects.instance [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'flavor' on Instance uuid 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.network.neutron [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Updating instance_info_cache with network_info: [{"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Releasing lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Instance network_info: |[{"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3088a306-6b7a-4451-8ef6-50dcb23f0f0a req-8c7247a4-913a-4fac-ab8f-322cbbe628cf service nova] Acquired lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.network.neutron [req-3088a306-6b7a-4451-8ef6-50dcb23f0f0a req-8c7247a4-913a-4fac-ab8f-322cbbe628cf service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Refreshing network info cache for port 44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Start _get_guest_xml network_info=[{"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:38:18 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:38:18 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:38:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1380869967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1380869967',id=32,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOciKBBC8NJ35hgRq02smcI4uF6t4M94gsu+a5kRirwGvo1EOVp24o42AMRihJmcVfkkv/PMoLN/H5Rsi/oO2DWABm120N26knoQDRfWSEMs7kV0T76++jbrlQxgFhe0QQ==',key_name='tempest-keypair-956790269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5387e67178b141ae94025b9fd61f0124',ramdisk_id='',reservation_id='r-3mee6amo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1913674887',owner_user_name='tempest-AttachVolumeShelveTestJSON-1913674887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:38:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6dbf37c8dec47aebcdc9c93ad1f3d69',uuid=7726f4c9-697d-49ac-a2ee-ed42f81d8c64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converting VIF {"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:49:83,bridge_name='br-int',has_traffic_filtering=True,id=44b914a9-6a23-44dc-9711-dd33dfdd276b,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b914a9-6a') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG nova.objects.instance [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'pci_devices' on Instance uuid 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:38:19 user nova-compute[72820]:   <uuid>7726f4c9-697d-49ac-a2ee-ed42f81d8c64</uuid>
Aug 27 02:38:19 user nova-compute[72820]:   <name>instance-00000020</name>
Aug 27 02:38:19 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:38:19 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:38:19 user nova-compute[72820]:   <metadata>
Aug 27 02:38:19 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:38:19 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:38:19 user nova-compute[72820]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1380869967</nova:name>
Aug 27 02:38:19 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:38:18</nova:creationTime>
Aug 27 02:38:19 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:38:19 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:38:19 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:38:19 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:38:19 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:38:19 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:38:19 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:38:19 user nova-compute[72820]:       <nova:owner>
Aug 27 02:38:19 user nova-compute[72820]:         <nova:user uuid="e6dbf37c8dec47aebcdc9c93ad1f3d69">tempest-AttachVolumeShelveTestJSON-1913674887-project-member</nova:user>
Aug 27 02:38:19 user nova-compute[72820]:         <nova:project uuid="5387e67178b141ae94025b9fd61f0124">tempest-AttachVolumeShelveTestJSON-1913674887</nova:project>
Aug 27 02:38:19 user nova-compute[72820]:       </nova:owner>
Aug 27 02:38:19 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:38:19 user nova-compute[72820]:       <nova:ports>
Aug 27 02:38:19 user nova-compute[72820]:         <nova:port uuid="44b914a9-6a23-44dc-9711-dd33dfdd276b">
Aug 27 02:38:19 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 02:38:19 user nova-compute[72820]:         </nova:port>
Aug 27 02:38:19 user nova-compute[72820]:       </nova:ports>
Aug 27 02:38:19 user nova-compute[72820]:     </nova:instance>
Aug 27 02:38:19 user nova-compute[72820]:   </metadata>
Aug 27 02:38:19 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:38:19 user nova-compute[72820]:     <system>
Aug 27 02:38:19 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:38:19 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:38:19 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:38:19 user nova-compute[72820]:       <entry name="serial">7726f4c9-697d-49ac-a2ee-ed42f81d8c64</entry>
Aug 27 02:38:19 user nova-compute[72820]:       <entry name="uuid">7726f4c9-697d-49ac-a2ee-ed42f81d8c64</entry>
Aug 27 02:38:19 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:38:19 user nova-compute[72820]:     </system>
Aug 27 02:38:19 user nova-compute[72820]:   </sysinfo>
Aug 27 02:38:19 user nova-compute[72820]:   <os>
Aug 27 02:38:19 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:38:19 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:38:19 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:38:19 user nova-compute[72820]:   </os>
Aug 27 02:38:19 user nova-compute[72820]:   <features>
Aug 27 02:38:19 user nova-compute[72820]:     <acpi/>
Aug 27 02:38:19 user nova-compute[72820]:     <apic/>
Aug 27 02:38:19 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:38:19 user nova-compute[72820]:   </features>
Aug 27 02:38:19 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:38:19 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:38:19 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:38:19 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:38:19 user nova-compute[72820]:   </clock>
Aug 27 02:38:19 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:38:19 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:38:19 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:38:19 user nova-compute[72820]:   </cpu>
Aug 27 02:38:19 user nova-compute[72820]:   <devices>
Aug 27 02:38:19 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:38:19 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:38:19 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk"/>
Aug 27 02:38:19 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:38:19 user nova-compute[72820]:     </disk>
Aug 27 02:38:19 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:38:19 user nova-compute[72820]:       <mac address="fa:16:3e:6c:49:83"/>
Aug 27 02:38:19 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:38:19 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:38:19 user nova-compute[72820]:       <target dev="tap44b914a9-6a"/>
Aug 27 02:38:19 user nova-compute[72820]:     </interface>
Aug 27 02:38:19 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:38:19 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/console.log" append="off"/>
Aug 27 02:38:19 user nova-compute[72820]:     </serial>
Aug 27 02:38:19 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:38:19 user nova-compute[72820]:     <video>
Aug 27 02:38:19 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:38:19 user nova-compute[72820]:     </video>
Aug 27 02:38:19 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:38:19 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:38:19 user nova-compute[72820]:     </rng>
Aug 27 02:38:19 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:38:19 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:38:19 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:38:19 user nova-compute[72820]:     </memballoon>
Aug 27 02:38:19 user nova-compute[72820]:   </devices>
Aug 27 02:38:19 user nova-compute[72820]: </domain>
Aug 27 02:38:19 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1380869967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1380869967',id=32,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOciKBBC8NJ35hgRq02smcI4uF6t4M94gsu+a5kRirwGvo1EOVp24o42AMRihJmcVfkkv/PMoLN/H5Rsi/oO2DWABm120N26knoQDRfWSEMs7kV0T76++jbrlQxgFhe0QQ==',key_name='tempest-keypair-956790269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5387e67178b141ae94025b9fd61f0124',ramdisk_id='',reservation_id='r-3mee6amo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1913674887',owner_user_name='tempest-AttachVolumeShelveTestJSON-1913674887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:38:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6dbf37c8dec47aebcdc9c93ad1f3d69',uuid=7726f4c9-697d-49ac-a2ee-ed42f81d8c64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converting VIF {"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:49:83,bridge_name='br-int',has_traffic_filtering=True,id=44b914a9-6a23-44dc-9711-dd33dfdd276b,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b914a9-6a') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG os_vif [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:49:83,bridge_name='br-int',has_traffic_filtering=True,id=44b914a9-6a23-44dc-9711-dd33dfdd276b,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b914a9-6a') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44b914a9-6a, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap44b914a9-6a, col_values=(('external_ids', {'iface-id': '44b914a9-6a23-44dc-9711-dd33dfdd276b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:49:83', 'vm-uuid': '7726f4c9-697d-49ac-a2ee-ed42f81d8c64'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:19 user nova-compute[72820]: INFO os_vif [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:49:83,bridge_name='br-int',has_traffic_filtering=True,id=44b914a9-6a23-44dc-9711-dd33dfdd276b,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b914a9-6a')
Aug 27 02:38:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] No VIF found with MAC fa:16:3e:6c:49:83, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:19 user nova-compute[72820]: INFO nova.compute.manager [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Attaching volume 96e791f9-f9db-4ee2-b2e8-e96475459555 to /dev/vdb
Aug 27 02:38:19 user nova-compute[72820]: DEBUG os_brick.utils [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4868557-86c8-4b21-a6b0-30c4cdbc7da0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca2b11a-28e9-462e-82e0-d580a3b713dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a51ddc-c641-4461-8d7a-9cb160d7188a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9b3e07-1a7d-467d-8ff3-99c4f52f2af8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:38:19 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8f7a30-68fa-44e8-b78d-e2ea02ec795a]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG os_brick.utils [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Updating existing volume attachment record: 71f9d727-3690-49d2-97b6-2e303778e47c {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG nova.network.neutron [req-3088a306-6b7a-4451-8ef6-50dcb23f0f0a req-8c7247a4-913a-4fac-ab8f-322cbbe628cf service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Updated VIF entry in instance network info cache for port 44b914a9-6a23-44dc-9711-dd33dfdd276b. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG nova.network.neutron [req-3088a306-6b7a-4451-8ef6-50dcb23f0f0a req-8c7247a4-913a-4fac-ab8f-322cbbe628cf service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Updating instance_info_cache with network_info: [{"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:38:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3088a306-6b7a-4451-8ef6-50dcb23f0f0a req-8c7247a4-913a-4fac-ab8f-322cbbe628cf service nova] Releasing lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:38:20 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:38:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:20 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:38:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:20 user nova-compute[72820]: DEBUG nova.compute.manager [req-c02f96fd-dca9-4b4c-9c9a-bcdc36547e42 req-ab767286-0780-4213-845b-544aac210f45 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received event network-vif-plugged-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:38:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c02f96fd-dca9-4b4c-9c9a-bcdc36547e42 req-ab767286-0780-4213-845b-544aac210f45 service nova] Acquiring lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c02f96fd-dca9-4b4c-9c9a-bcdc36547e42 req-ab767286-0780-4213-845b-544aac210f45 service nova] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c02f96fd-dca9-4b4c-9c9a-bcdc36547e42 req-ab767286-0780-4213-845b-544aac210f45 service nova] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:20 user nova-compute[72820]: DEBUG nova.compute.manager [req-c02f96fd-dca9-4b4c-9c9a-bcdc36547e42 req-ab767286-0780-4213-845b-544aac210f45 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] No waiting events found dispatching network-vif-plugged-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:38:20 user nova-compute[72820]: WARNING nova.compute.manager [req-c02f96fd-dca9-4b4c-9c9a-bcdc36547e42 req-ab767286-0780-4213-845b-544aac210f45 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received unexpected event network-vif-plugged-44b914a9-6a23-44dc-9711-dd33dfdd276b for instance with vm_state building and task_state spawning.
Aug 27 02:38:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:38:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:38:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103902.634943, 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:38:22 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] VM Resumed (Lifecycle Event)
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:38:22 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Instance spawned successfully.
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:38:22 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103902.6353226, 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:38:22 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] VM Started (Lifecycle Event)
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:38:22 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:38:22 user nova-compute[72820]: INFO nova.compute.manager [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Took 6.11 seconds to spawn the instance on the hypervisor.
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-12e514e5-a1be-4e95-bb41-099d0908d900 req-8d3c3e9d-8c43-40fa-902d-d6ff01b724ee service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received event network-vif-plugged-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-12e514e5-a1be-4e95-bb41-099d0908d900 req-8d3c3e9d-8c43-40fa-902d-d6ff01b724ee service nova] Acquiring lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-12e514e5-a1be-4e95-bb41-099d0908d900 req-8d3c3e9d-8c43-40fa-902d-d6ff01b724ee service nova] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-12e514e5-a1be-4e95-bb41-099d0908d900 req-8d3c3e9d-8c43-40fa-902d-d6ff01b724ee service nova] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-12e514e5-a1be-4e95-bb41-099d0908d900 req-8d3c3e9d-8c43-40fa-902d-d6ff01b724ee service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] No waiting events found dispatching network-vif-plugged-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:38:22 user nova-compute[72820]: WARNING nova.compute.manager [req-12e514e5-a1be-4e95-bb41-099d0908d900 req-8d3c3e9d-8c43-40fa-902d-d6ff01b724ee service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received unexpected event network-vif-plugged-44b914a9-6a23-44dc-9711-dd33dfdd276b for instance with vm_state building and task_state spawning.
Aug 27 02:38:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3/disk.rescue --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:22 user nova-compute[72820]: INFO nova.compute.manager [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Took 6.99 seconds to build instance.
Aug 27 02:38:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5f79b37e-954b-42d5-a2f6-138d9cdf0a65 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.092s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:23 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:38:23 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:38:23 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7730MB free_disk=25.070919036865234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:38:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:38:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:38:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1591319d-3d15-4c46-b823-4edddf018b5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:38:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 15a1062a-ecfb-42b7-b8e5-03adbd6b8056 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:38:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 85c8fa72-19be-49a0-975f-d6a0d30d011f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:38:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:38:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:38:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:38:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:38:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:38:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:24 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:38:24 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:38:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:38:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:25 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:38:25 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:38:25 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:38:26 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:38:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:38:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:38:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:38:26 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:38:26 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Updating instance_info_cache with network_info: [{"id": "b330a8f4-0812-4964-bd70-10d41689406a", "address": "fa:16:3e:a4:9d:95", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb330a8f4-08", "ovs_interfaceid": "b330a8f4-0812-4964-bd70-10d41689406a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:38:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:38:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:38:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103896.1126158, 59de147f-63c9-4ded-811b-c6ff7b35b374 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:38:31 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] VM Stopped (Lifecycle Event)
Aug 27 02:38:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-15579eb8-4693-46e2-b1f8-46c8869d9d0a None None] [instance: 59de147f-63c9-4ded-811b-c6ff7b35b374] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmWPTrdJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:38:31 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:38:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:38:31 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:38:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:38:31 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c45fc4d-a51b-4ccc-bd6f-88edc733aa00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:38:31 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb17a3a-f00d-418e-badb-2caf72ac4d26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555] added
Aug 27 02:38:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a39e06e-33b8-4956-b78f-513d60ee7dc0]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a408dc5c-8c9f-43bf-9d59-0c28c6bb3490]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GmWPTrdJ {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GmWPTrdJ" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6442e770-78ea-4903-a620-f300b1adc11c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GmWPTrdJ'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef3bd46-ee31-4ff0-9e88-2342dceacd75]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f433d6-d444-4e33-833b-281b940cc4d5]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:38:31 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:38:31 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:38:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:38:31 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:38:31 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:38:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b35093e-7f99-42a9-bdd5-24f008bd9b53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555, portal: 172.16.0.220,3260]
Aug 27 02:38:31 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555, portal: 172.16.0.220,3260] successful.
Aug 27 02:38:31 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb078113-ce1b-4e9c-8245-0214266136b9]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd031fa-a425-44b6-b1d2-bddbad155ade]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:38:32 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:38:32 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:38:32 user nova-compute[72820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 (non-flash)
Aug 27 02:38:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:38:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:38:32 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:38:32 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:38:32 user nova-compute[72820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 (non-flash)
Aug 27 02:38:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:38:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:38:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:38:32 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:38:32 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:38:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1ff9ab-9fb7-4817-b824-e9b97998429c]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:32 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:38:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:38:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmWPTrdJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:38:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:38:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23530653635346635', 'path': '/dev/sdb'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:38:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530653635346635', 'path': '/dev/sdb'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:38:33 user nova-compute[72820]: DEBUG nova.objects.instance [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'flavor' on Instance uuid 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:38:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:38:33 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:38:33 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:38:33 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:38:33 user nova-compute[72820]:   <serial>96e791f9-f9db-4ee2-b2e8-e96475459555</serial>
Aug 27 02:38:33 user nova-compute[72820]: </disk>
Aug 27 02:38:33 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:38:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:38:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:38:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] No VIF found with MAC fa:16:3e:94:19:e2, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:38:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a964dc57-a8ec-4681-9816-2c003b1f6be1 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.510s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG nova.objects.instance [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'flavor' on Instance uuid 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:39 user nova-compute[72820]: INFO nova.compute.manager [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Attaching volume a6b937b1-fb86-4d84-8500-52b01693b674 to /dev/vdc
Aug 27 02:38:39 user nova-compute[72820]: DEBUG os_brick.utils [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d931164a-fc76-4943-b880-1d646991e7b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a3eabc-6c1a-43f8-b262-9400974b25ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c056bc7-752a-4afa-86ba-2d8c8b883bff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2d8de6-7b3c-4327-b497-e9a7e440ae24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:38:39 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:38:39 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7763c4-39e0-45ce-a792-1c0c83e3c1e7]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG os_brick.utils [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Updating existing volume attachment record: 37e87fa0-9c0e-462e-80f1-060c3cad02d3 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:38:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquiring lock "b1a0ba95-2678-493d-87ba-061abf80887a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "b1a0ba95-2678-493d-87ba-061abf80887a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:38:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:41 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:38:41 user nova-compute[72820]: INFO nova.compute.claims [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Claim successful on node user
Aug 27 02:38:41 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:38:41 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:38:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:38:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:38:41 user nova-compute[72820]: DEBUG nova.network.neutron [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:38:41 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:38:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG nova.policy [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '314d3a67dbd24abb848225eaeaa33da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0977a141ee1145b3a94c5cd60571d3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:38:42 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Creating image(s)
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "/opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "/opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.184s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.191s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk 1073741824" returned: 0 in 0.057s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG nova.network.neutron [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Successfully created port: 4a90a590-7f63-4988-87bf-d7dd0ac275cd {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.190s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Cannot resize image /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Ensure instance console log exists: /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:43 user nova-compute[72820]: DEBUG nova.network.neutron [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Successfully updated port: 4a90a590-7f63-4988-87bf-d7dd0ac275cd {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:38:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquiring lock "refresh_cache-b1a0ba95-2678-493d-87ba-061abf80887a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:38:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquired lock "refresh_cache-b1a0ba95-2678-493d-87ba-061abf80887a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:38:43 user nova-compute[72820]: DEBUG nova.network.neutron [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:38:43 user nova-compute[72820]: DEBUG nova.compute.manager [req-4afb8b6e-9d54-42cd-b400-a76a1b5df66d req-b2f19e39-da45-480a-8ba4-4fc89468b2ac service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Received event network-changed-4a90a590-7f63-4988-87bf-d7dd0ac275cd {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:38:43 user nova-compute[72820]: DEBUG nova.compute.manager [req-4afb8b6e-9d54-42cd-b400-a76a1b5df66d req-b2f19e39-da45-480a-8ba4-4fc89468b2ac service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Refreshing instance network info cache due to event network-changed-4a90a590-7f63-4988-87bf-d7dd0ac275cd. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:38:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4afb8b6e-9d54-42cd-b400-a76a1b5df66d req-b2f19e39-da45-480a-8ba4-4fc89468b2ac service nova] Acquiring lock "refresh_cache-b1a0ba95-2678-493d-87ba-061abf80887a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:38:43 user nova-compute[72820]: DEBUG nova.network.neutron [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.network.neutron [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Updating instance_info_cache with network_info: [{"id": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "address": "fa:16:3e:36:09:99", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a90a590-7f", "ovs_interfaceid": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Releasing lock "refresh_cache-b1a0ba95-2678-493d-87ba-061abf80887a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Instance network_info: |[{"id": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "address": "fa:16:3e:36:09:99", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a90a590-7f", "ovs_interfaceid": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4afb8b6e-9d54-42cd-b400-a76a1b5df66d req-b2f19e39-da45-480a-8ba4-4fc89468b2ac service nova] Acquired lock "refresh_cache-b1a0ba95-2678-493d-87ba-061abf80887a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.network.neutron [req-4afb8b6e-9d54-42cd-b400-a76a1b5df66d req-b2f19e39-da45-480a-8ba4-4fc89468b2ac service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Refreshing network info cache for port 4a90a590-7f63-4988-87bf-d7dd0ac275cd {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Start _get_guest_xml network_info=[{"id": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "address": "fa:16:3e:36:09:99", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a90a590-7f", "ovs_interfaceid": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:38:44 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:38:44 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-523175913',display_name='tempest-ServersNegativeTestJSON-server-523175913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-523175913',id=33,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0977a141ee1145b3a94c5cd60571d3d2',ramdisk_id='',reservation_id='r-kdcehtll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1999174782',owner_user_name='tempest-ServersNegativeTestJSON-1999174782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:38:42Z,user_data=None,user_id='314d3a67dbd24abb848225eaeaa33da6',uuid=b1a0ba95-2678-493d-87ba-061abf80887a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "address": "fa:16:3e:36:09:99", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a90a590-7f", "ovs_interfaceid": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Converting VIF {"id": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "address": "fa:16:3e:36:09:99", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a90a590-7f", "ovs_interfaceid": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:09:99,bridge_name='br-int',has_traffic_filtering=True,id=4a90a590-7f63-4988-87bf-d7dd0ac275cd,network=Network(5f1eaafc-a7ec-4d9d-b853-a4930adeb587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a90a590-7f') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.objects.instance [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lazy-loading 'pci_devices' on Instance uuid b1a0ba95-2678-493d-87ba-061abf80887a {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:38:44 user nova-compute[72820]:   <uuid>b1a0ba95-2678-493d-87ba-061abf80887a</uuid>
Aug 27 02:38:44 user nova-compute[72820]:   <name>instance-00000021</name>
Aug 27 02:38:44 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:38:44 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:38:44 user nova-compute[72820]:   <metadata>
Aug 27 02:38:44 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:38:44 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:38:44 user nova-compute[72820]:       <nova:name>tempest-ServersNegativeTestJSON-server-523175913</nova:name>
Aug 27 02:38:44 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:38:44</nova:creationTime>
Aug 27 02:38:44 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:38:44 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:38:44 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:38:44 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:38:44 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:38:44 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:38:44 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:38:44 user nova-compute[72820]:       <nova:owner>
Aug 27 02:38:44 user nova-compute[72820]:         <nova:user uuid="314d3a67dbd24abb848225eaeaa33da6">tempest-ServersNegativeTestJSON-1999174782-project-member</nova:user>
Aug 27 02:38:44 user nova-compute[72820]:         <nova:project uuid="0977a141ee1145b3a94c5cd60571d3d2">tempest-ServersNegativeTestJSON-1999174782</nova:project>
Aug 27 02:38:44 user nova-compute[72820]:       </nova:owner>
Aug 27 02:38:44 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:38:44 user nova-compute[72820]:       <nova:ports>
Aug 27 02:38:44 user nova-compute[72820]:         <nova:port uuid="4a90a590-7f63-4988-87bf-d7dd0ac275cd">
Aug 27 02:38:44 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 02:38:44 user nova-compute[72820]:         </nova:port>
Aug 27 02:38:44 user nova-compute[72820]:       </nova:ports>
Aug 27 02:38:44 user nova-compute[72820]:     </nova:instance>
Aug 27 02:38:44 user nova-compute[72820]:   </metadata>
Aug 27 02:38:44 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:38:44 user nova-compute[72820]:     <system>
Aug 27 02:38:44 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:38:44 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:38:44 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:38:44 user nova-compute[72820]:       <entry name="serial">b1a0ba95-2678-493d-87ba-061abf80887a</entry>
Aug 27 02:38:44 user nova-compute[72820]:       <entry name="uuid">b1a0ba95-2678-493d-87ba-061abf80887a</entry>
Aug 27 02:38:44 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:38:44 user nova-compute[72820]:     </system>
Aug 27 02:38:44 user nova-compute[72820]:   </sysinfo>
Aug 27 02:38:44 user nova-compute[72820]:   <os>
Aug 27 02:38:44 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:38:44 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:38:44 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:38:44 user nova-compute[72820]:   </os>
Aug 27 02:38:44 user nova-compute[72820]:   <features>
Aug 27 02:38:44 user nova-compute[72820]:     <acpi/>
Aug 27 02:38:44 user nova-compute[72820]:     <apic/>
Aug 27 02:38:44 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:38:44 user nova-compute[72820]:   </features>
Aug 27 02:38:44 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:38:44 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:38:44 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:38:44 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:38:44 user nova-compute[72820]:   </clock>
Aug 27 02:38:44 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:38:44 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:38:44 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:38:44 user nova-compute[72820]:   </cpu>
Aug 27 02:38:44 user nova-compute[72820]:   <devices>
Aug 27 02:38:44 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:38:44 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:38:44 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk"/>
Aug 27 02:38:44 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:38:44 user nova-compute[72820]:     </disk>
Aug 27 02:38:44 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:38:44 user nova-compute[72820]:       <mac address="fa:16:3e:36:09:99"/>
Aug 27 02:38:44 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:38:44 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:38:44 user nova-compute[72820]:       <target dev="tap4a90a590-7f"/>
Aug 27 02:38:44 user nova-compute[72820]:     </interface>
Aug 27 02:38:44 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:38:44 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/console.log" append="off"/>
Aug 27 02:38:44 user nova-compute[72820]:     </serial>
Aug 27 02:38:44 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:38:44 user nova-compute[72820]:     <video>
Aug 27 02:38:44 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:38:44 user nova-compute[72820]:     </video>
Aug 27 02:38:44 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:38:44 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:38:44 user nova-compute[72820]:     </rng>
Aug 27 02:38:44 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:38:44 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:38:44 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:38:44 user nova-compute[72820]:     </memballoon>
Aug 27 02:38:44 user nova-compute[72820]:   </devices>
Aug 27 02:38:44 user nova-compute[72820]: </domain>
Aug 27 02:38:44 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-523175913',display_name='tempest-ServersNegativeTestJSON-server-523175913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-523175913',id=33,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0977a141ee1145b3a94c5cd60571d3d2',ramdisk_id='',reservation_id='r-kdcehtll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1999174782',owner_user_name='tempest-ServersNegativeTestJSON-1999174782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:38:42Z,user_data=None,user_id='314d3a67dbd24abb848225eaeaa33da6',uuid=b1a0ba95-2678-493d-87ba-061abf80887a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "address": "fa:16:3e:36:09:99", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a90a590-7f", "ovs_interfaceid": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Converting VIF {"id": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "address": "fa:16:3e:36:09:99", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a90a590-7f", "ovs_interfaceid": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:09:99,bridge_name='br-int',has_traffic_filtering=True,id=4a90a590-7f63-4988-87bf-d7dd0ac275cd,network=Network(5f1eaafc-a7ec-4d9d-b853-a4930adeb587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a90a590-7f') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG os_vif [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:09:99,bridge_name='br-int',has_traffic_filtering=True,id=4a90a590-7f63-4988-87bf-d7dd0ac275cd,network=Network(5f1eaafc-a7ec-4d9d-b853-a4930adeb587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a90a590-7f') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a90a590-7f, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a90a590-7f, col_values=(('external_ids', {'iface-id': '4a90a590-7f63-4988-87bf-d7dd0ac275cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:09:99', 'vm-uuid': 'b1a0ba95-2678-493d-87ba-061abf80887a'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:44 user nova-compute[72820]: INFO os_vif [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:09:99,bridge_name='br-int',has_traffic_filtering=True,id=4a90a590-7f63-4988-87bf-d7dd0ac275cd,network=Network(5f1eaafc-a7ec-4d9d-b853-a4930adeb587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a90a590-7f')
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] No VIF found with MAC fa:16:3e:36:09:99, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.network.neutron [req-4afb8b6e-9d54-42cd-b400-a76a1b5df66d req-b2f19e39-da45-480a-8ba4-4fc89468b2ac service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Updated VIF entry in instance network info cache for port 4a90a590-7f63-4988-87bf-d7dd0ac275cd. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG nova.network.neutron [req-4afb8b6e-9d54-42cd-b400-a76a1b5df66d req-b2f19e39-da45-480a-8ba4-4fc89468b2ac service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Updating instance_info_cache with network_info: [{"id": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "address": "fa:16:3e:36:09:99", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a90a590-7f", "ovs_interfaceid": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:38:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4afb8b6e-9d54-42cd-b400-a76a1b5df66d req-b2f19e39-da45-480a-8ba4-4fc89468b2ac service nova] Releasing lock "refresh_cache-b1a0ba95-2678-493d-87ba-061abf80887a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:38:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:46 user nova-compute[72820]: DEBUG nova.compute.manager [req-1f4f8614-c97b-41f6-8876-060816c03299 req-530652fe-5c21-4312-8825-a029f9694131 service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Received event network-vif-plugged-4a90a590-7f63-4988-87bf-d7dd0ac275cd {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:38:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1f4f8614-c97b-41f6-8876-060816c03299 req-530652fe-5c21-4312-8825-a029f9694131 service nova] Acquiring lock "b1a0ba95-2678-493d-87ba-061abf80887a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1f4f8614-c97b-41f6-8876-060816c03299 req-530652fe-5c21-4312-8825-a029f9694131 service nova] Lock "b1a0ba95-2678-493d-87ba-061abf80887a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1f4f8614-c97b-41f6-8876-060816c03299 req-530652fe-5c21-4312-8825-a029f9694131 service nova] Lock "b1a0ba95-2678-493d-87ba-061abf80887a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:46 user nova-compute[72820]: DEBUG nova.compute.manager [req-1f4f8614-c97b-41f6-8876-060816c03299 req-530652fe-5c21-4312-8825-a029f9694131 service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] No waiting events found dispatching network-vif-plugged-4a90a590-7f63-4988-87bf-d7dd0ac275cd {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:38:46 user nova-compute[72820]: WARNING nova.compute.manager [req-1f4f8614-c97b-41f6-8876-060816c03299 req-530652fe-5c21-4312-8825-a029f9694131 service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Received unexpected event network-vif-plugged-4a90a590-7f63-4988-87bf-d7dd0ac275cd for instance with vm_state building and task_state spawning.
Aug 27 02:38:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "85c8fa72-19be-49a0-975f-d6a0d30d011f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:46 user nova-compute[72820]: INFO nova.compute.manager [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Terminating instance
Aug 27 02:38:46 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:38:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:47 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Instance destroyed successfully.
Aug 27 02:38:47 user nova-compute[72820]: DEBUG nova.objects.instance [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lazy-loading 'resources' on Instance uuid 85c8fa72-19be-49a0-975f-d6a0d30d011f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-831814397',display_name='tempest-ServerActionsTestOtherA-server-831814397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-831814397',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuMDNJccFoG9J2MvjXPhebjkkaCvYt2BV0fWoVRWE0WGnLVqeM0TmypkIBpwP+aIP0dc17AS8ytt0zxz7hB47f2I8lo+2akMvc3UtIkl7mLDLkN7AXVg520jT6ETK7MXw==',key_name='tempest-keypair-1957607282',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:34:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7797569db44f40f193483e6e6933a0d0',ramdisk_id='',reservation_id='r-ggl9724x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-892102693',owner_user_name='tempest-ServerActionsTestOtherA-892102693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:35:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='275f713edfd042d4b4fa32620956484a',uuid=85c8fa72-19be-49a0-975f-d6a0d30d011f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converting VIF {"id": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "address": "fa:16:3e:52:bd:22", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cbacdf-27", "ovs_interfaceid": "b1cbacdf-27a3-48f2-8c08-e77c49f40d81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:bd:22,bridge_name='br-int',has_traffic_filtering=True,id=b1cbacdf-27a3-48f2-8c08-e77c49f40d81,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cbacdf-27') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_vif [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:bd:22,bridge_name='br-int',has_traffic_filtering=True,id=b1cbacdf-27a3-48f2-8c08-e77c49f40d81,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cbacdf-27') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1cbacdf-27, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:38:47 user nova-compute[72820]: INFO os_vif [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:bd:22,bridge_name='br-int',has_traffic_filtering=True,id=b1cbacdf-27a3-48f2-8c08-e77c49f40d81,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cbacdf-27')
Aug 27 02:38:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bWCZxFLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:38:47 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[15970b15-4207-49a2-86ab-9e190fe23fe9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:38:47 user nova-compute[72820]: No targets found.
Aug 27 02:38:47 user nova-compute[72820]: iSNS:
Aug 27 02:38:47 user nova-compute[72820]: No targets found.
Aug 27 02:38:47 user nova-compute[72820]: STATIC:
Aug 27 02:38:47 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:38:47 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:38:47 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:38:47 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb
Aug 27 02:38:47 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:38:47 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:38:47 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e
Aug 27 02:38:47 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:38:47 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:38:47 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555
Aug 27 02:38:47 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:38:47 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:38:47 user nova-compute[72820]: FIRMWARE:
Aug 27 02:38:47 user nova-compute[72820]: No targets found.
Aug 27 02:38:47 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:38:47 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:38:47 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[28003435-e276-4f6a-9f7d-0a671d5ab7d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4717550b-e708-4182-81f1-00a44c85b287]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:38:47 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:38:47 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:38:47 user nova-compute[72820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 (non-flash)
Aug 27 02:38:47 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:38:47 user nova-compute[72820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e (non-flash)
Aug 27 02:38:47 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:38:47 user nova-compute[72820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 (non-flash)
Aug 27 02:38:47 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a04dab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e'): ({'sdc'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Removing single pathed devices sdc {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0b3e7a-fd48-473d-8c84-ef037ed7380a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.033s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d215871c-a80b-4748-ad62-e33a4ff8ff31]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Flushing IO for device /dev/sdc {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[539b54f7-07a5-48df-a7e9-164733c381f4]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[20477f6f-0568-48ec-b33e-f9239accb9cf]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4d9b49-181c-41e0-b4a6-3c8adc2d848c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[96df15e1-9165-4595-b428-d073875bc65f]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e, portal: 172.16.0.220,3260]
Aug 27 02:38:47 user nova-compute[72820]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e, portal: 172.16.0.220,3260] successful.
Aug 27 02:38:47 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265fa4c-ed31-4423-83e2-100c129caa8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d58e95-eb19-45b7-8247-993cab6d57d3]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] <== disconnect_volume: return (396ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:38:47 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Deleting instance files /opt/stack/data/nova/instances/85c8fa72-19be-49a0-975f-d6a0d30d011f_del
Aug 27 02:38:47 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Deletion of /opt/stack/data/nova/instances/85c8fa72-19be-49a0-975f-d6a0d30d011f_del complete
Aug 27 02:38:47 user nova-compute[72820]: INFO nova.compute.manager [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Took 1.35 seconds to destroy the instance on the hypervisor.
Aug 27 02:38:47 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:38:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-f0a83618-6aa9-47ff-af97-30cc18665a4d req-99934bc2-a073-4b2f-ba5f-3728fac2fbba service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Received event network-vif-plugged-4a90a590-7f63-4988-87bf-d7dd0ac275cd {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f0a83618-6aa9-47ff-af97-30cc18665a4d req-99934bc2-a073-4b2f-ba5f-3728fac2fbba service nova] Acquiring lock "b1a0ba95-2678-493d-87ba-061abf80887a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f0a83618-6aa9-47ff-af97-30cc18665a4d req-99934bc2-a073-4b2f-ba5f-3728fac2fbba service nova] Lock "b1a0ba95-2678-493d-87ba-061abf80887a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f0a83618-6aa9-47ff-af97-30cc18665a4d req-99934bc2-a073-4b2f-ba5f-3728fac2fbba service nova] Lock "b1a0ba95-2678-493d-87ba-061abf80887a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-f0a83618-6aa9-47ff-af97-30cc18665a4d req-99934bc2-a073-4b2f-ba5f-3728fac2fbba service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] No waiting events found dispatching network-vif-plugged-4a90a590-7f63-4988-87bf-d7dd0ac275cd {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:38:48 user nova-compute[72820]: WARNING nova.compute.manager [req-f0a83618-6aa9-47ff-af97-30cc18665a4d req-99934bc2-a073-4b2f-ba5f-3728fac2fbba service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Received unexpected event network-vif-plugged-4a90a590-7f63-4988-87bf-d7dd0ac275cd for instance with vm_state building and task_state spawning.
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-f0a83618-6aa9-47ff-af97-30cc18665a4d req-99934bc2-a073-4b2f-ba5f-3728fac2fbba service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received event network-vif-unplugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f0a83618-6aa9-47ff-af97-30cc18665a4d req-99934bc2-a073-4b2f-ba5f-3728fac2fbba service nova] Acquiring lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f0a83618-6aa9-47ff-af97-30cc18665a4d req-99934bc2-a073-4b2f-ba5f-3728fac2fbba service nova] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f0a83618-6aa9-47ff-af97-30cc18665a4d req-99934bc2-a073-4b2f-ba5f-3728fac2fbba service nova] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-f0a83618-6aa9-47ff-af97-30cc18665a4d req-99934bc2-a073-4b2f-ba5f-3728fac2fbba service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] No waiting events found dispatching network-vif-unplugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-f0a83618-6aa9-47ff-af97-30cc18665a4d req-99934bc2-a073-4b2f-ba5f-3728fac2fbba service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received event network-vif-unplugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-f0a83618-6aa9-47ff-af97-30cc18665a4d req-99934bc2-a073-4b2f-ba5f-3728fac2fbba service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received event network-vif-plugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f0a83618-6aa9-47ff-af97-30cc18665a4d req-99934bc2-a073-4b2f-ba5f-3728fac2fbba service nova] Acquiring lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f0a83618-6aa9-47ff-af97-30cc18665a4d req-99934bc2-a073-4b2f-ba5f-3728fac2fbba service nova] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f0a83618-6aa9-47ff-af97-30cc18665a4d req-99934bc2-a073-4b2f-ba5f-3728fac2fbba service nova] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-f0a83618-6aa9-47ff-af97-30cc18665a4d req-99934bc2-a073-4b2f-ba5f-3728fac2fbba service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] No waiting events found dispatching network-vif-plugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:38:48 user nova-compute[72820]: WARNING nova.compute.manager [req-f0a83618-6aa9-47ff-af97-30cc18665a4d req-99934bc2-a073-4b2f-ba5f-3728fac2fbba service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received unexpected event network-vif-plugged-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 for instance with vm_state active and task_state deleting.
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103928.4299233, b1a0ba95-2678-493d-87ba-061abf80887a => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:38:48 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] VM Resumed (Lifecycle Event)
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:38:48 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Instance spawned successfully.
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:38:48 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103928.4310374, b1a0ba95-2678-493d-87ba-061abf80887a => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:38:48 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] VM Started (Lifecycle Event)
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:38:48 user nova-compute[72820]: INFO nova.compute.manager [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Took 6.47 seconds to spawn the instance on the hypervisor.
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:38:48 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:38:48 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Took 1.01 seconds to deallocate network for instance.
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-a886c048-0e0d-4e76-8e87-4d42be81ab82 req-19f8b7b1-63f9-46f2-ac95-2e1ef4bf3432 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Received event network-vif-deleted-b1cbacdf-27a3-48f2-8c08-e77c49f40d81 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:38:48 user nova-compute[72820]: INFO nova.compute.manager [req-a886c048-0e0d-4e76-8e87-4d42be81ab82 req-19f8b7b1-63f9-46f2-ac95-2e1ef4bf3432 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Neutron deleted interface b1cbacdf-27a3-48f2-8c08-e77c49f40d81; detaching it from the instance and deleting it from the info cache
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.network.neutron [req-a886c048-0e0d-4e76-8e87-4d42be81ab82 req-19f8b7b1-63f9-46f2-ac95-2e1ef4bf3432 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:38:48 user nova-compute[72820]: DEBUG nova.compute.manager [req-a886c048-0e0d-4e76-8e87-4d42be81ab82 req-19f8b7b1-63f9-46f2-ac95-2e1ef4bf3432 service nova] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Detach interface failed, port_id=b1cbacdf-27a3-48f2-8c08-e77c49f40d81, reason: Instance 85c8fa72-19be-49a0-975f-d6a0d30d011f could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 02:38:48 user nova-compute[72820]: INFO nova.compute.manager [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Took 7.35 seconds to build instance.
Aug 27 02:38:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f3a7e73-0274-4d11-9254-756dc7c88808 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "b1a0ba95-2678-493d-87ba-061abf80887a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.476s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arFndIXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:38:52 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:38:52 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:38:52 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df16c5f-6544-4a95-b5a5-5183d92de8cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:38:52 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bb1b54-fffb-4cfc-8c28-fea22903ef87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674] added
Aug 27 02:38:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95f9288-ae3f-4767-a168-9b8ba491af31]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6580fe6-9852-42c1-b5b5-1fdbb620107f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v arFndIXx {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v arFndIXx" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0210ce-c56f-45a2-ba01-b125e506a52f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'arFndIXx'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5c7caa-fdbe-4b77-8c7c-7ed17bfaf2bd]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bfd751-e817-44a7-a406-f26360f98905]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:38:52 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:38:52 user nova-compute[72820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 (non-flash)
Aug 27 02:38:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:38:52 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:38:52 user nova-compute[72820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 (non-flash)
Aug 27 02:38:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[274a503a-746f-431c-a3f1-feea3aeb3ef8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674, portal: 172.16.0.220,3260]
Aug 27 02:38:52 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674, portal: 172.16.0.220,3260] successful.
Aug 27 02:38:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfec5976-bb78-4dfa-8f01-39645fabd2cd]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d712f6d-c0d5-4b2e-bff2-b51158042764]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:38:52 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:38:52 user nova-compute[72820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 (non-flash)
Aug 27 02:38:52 user nova-compute[72820]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 (non-flash)
Aug 27 02:38:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:38:52 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:38:52 user nova-compute[72820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 (non-flash)
Aug 27 02:38:52 user nova-compute[72820]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 (non-flash)
Aug 27 02:38:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19e2942-b39a-4d61-ad72-de4b1d245ef6]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arFndIXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:38:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:38:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26561623466323234', 'path': '/dev/sdc'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:38:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561623466323234', 'path': '/dev/sdc'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:38:53 user nova-compute[72820]: DEBUG nova.objects.instance [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'flavor' on Instance uuid 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:38:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:38:53 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:38:53 user nova-compute[72820]:   <source dev="/dev/sdc"/>
Aug 27 02:38:53 user nova-compute[72820]:   <target dev="vdc" bus="virtio"/>
Aug 27 02:38:53 user nova-compute[72820]:   <serial>a6b937b1-fb86-4d84-8500-52b01693b674</serial>
Aug 27 02:38:53 user nova-compute[72820]: </disk>
Aug 27 02:38:53 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:38:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:38:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:38:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:38:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] No VIF found with MAC fa:16:3e:94:19:e2, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:38:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-3dfb0a73-3576-49f7-8221-9bd72b2bbd7c tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.885s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:54 user nova-compute[72820]: INFO nova.compute.manager [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Took 6.26 seconds to detach 1 volumes for instance.
Aug 27 02:38:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Deleting volume: 4265fa4c-ed31-4423-83e2-100c129caa8e {{(pid=72820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 02:38:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:54 user nova-compute[72820]: INFO nova.compute.manager [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Detaching volume 96e791f9-f9db-4ee2-b2e8-e96475459555
Aug 27 02:38:54 user nova-compute[72820]: INFO nova.virt.block_device [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Attempting to driver detach volume 96e791f9-f9db-4ee2-b2e8-e96475459555 from mountpoint /dev/vdb
Aug 27 02:38:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Attempting to detach device vdb from instance 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:38:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:38:54 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:38:54 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:38:54 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:38:54 user nova-compute[72820]:   <serial>96e791f9-f9db-4ee2-b2e8-e96475459555</serial>
Aug 27 02:38:54 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:38:54 user nova-compute[72820]: </disk>
Aug 27 02:38:54 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:38:54 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Successfully detached device vdb from instance 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 from the persistent domain config.
Aug 27 02:38:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:38:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:38:54 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:38:54 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:38:54 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:38:54 user nova-compute[72820]:   <serial>96e791f9-f9db-4ee2-b2e8-e96475459555</serial>
Aug 27 02:38:54 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:38:54 user nova-compute[72820]: </disk>
Aug 27 02:38:54 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:55 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Deleted allocations for instance 85c8fa72-19be-49a0-975f-d6a0d30d011f
Aug 27 02:38:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693103935.4428823, 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:38:55 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Successfully detached device vdb from instance 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 from the live domain config.
Aug 27 02:38:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmWPTrdJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:38:55 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ad7b96f6-212d-4b74-8ed4-de7138cf05ce tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "85c8fa72-19be-49a0-975f-d6a0d30d011f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.252s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f366e658-18ad-483f-8e9c-45c8f663ea5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:38:55 user nova-compute[72820]: No targets found.
Aug 27 02:38:55 user nova-compute[72820]: iSNS:
Aug 27 02:38:55 user nova-compute[72820]: No targets found.
Aug 27 02:38:55 user nova-compute[72820]: STATIC:
Aug 27 02:38:55 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:38:55 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:38:55 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:38:55 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb
Aug 27 02:38:55 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:38:55 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:38:55 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555
Aug 27 02:38:55 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:38:55 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:38:55 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674
Aug 27 02:38:55 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:38:55 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:38:55 user nova-compute[72820]: FIRMWARE:
Aug 27 02:38:55 user nova-compute[72820]: No targets found.
Aug 27 02:38:55 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:38:55 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:38:55 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5b22a9-3cf2-4707-a55f-1ea9f1a8c8b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5719f04-dc9e-4e12-904a-4464cbe9d773]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:38:55 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:38:55 user nova-compute[72820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 (non-flash)
Aug 27 02:38:55 user nova-compute[72820]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 (non-flash)
Aug 27 02:38:55 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:38:55 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:38:55 user nova-compute[72820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 (non-flash)
Aug 27 02:38:55 user nova-compute[72820]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 (non-flash)
Aug 27 02:38:55 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a05f71c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555'): ({'sdb'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Removing single pathed devices sdb {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a1727c-a3b2-4977-b0b0-24432c57563c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88f2de2-b872-4ea4-b2fb-ae7d9cbd1454]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Flushing IO for device /dev/sdb {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6c7259-3345-48dd-aa19-7d776be0a323]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[65541be7-e543-4ba0-8929-471fbbc2319c]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a7dce4-3b44-4d05-9a9d-5d203ae9e6aa]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6237182-f4a1-43e2-ae6e-f2754ebcc2af]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555, portal: 172.16.0.220,3260]
Aug 27 02:38:55 user nova-compute[72820]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555, portal: 172.16.0.220,3260] successful.
Aug 27 02:38:55 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e791f9-f9db-4ee2-b2e8-e96475459555 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2777f70-3611-4480-af0e-d1dfd38b8c9e]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] <== disconnect_volume: return (332ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:38:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:38:56 user nova-compute[72820]: DEBUG nova.objects.instance [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'flavor' on Instance uuid 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:38:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-71699397-1f1f-400b-b528-d57d9c4eadf5 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.848s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:57 user nova-compute[72820]: INFO nova.compute.manager [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Detaching volume a6b937b1-fb86-4d84-8500-52b01693b674
Aug 27 02:38:57 user nova-compute[72820]: INFO nova.virt.block_device [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Attempting to driver detach volume a6b937b1-fb86-4d84-8500-52b01693b674 from mountpoint /dev/vdc
Aug 27 02:38:57 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Attempting to detach device vdc from instance 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:38:57 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:38:57 user nova-compute[72820]:   <source dev="/dev/sdc"/>
Aug 27 02:38:57 user nova-compute[72820]:   <target dev="vdc" bus="virtio"/>
Aug 27 02:38:57 user nova-compute[72820]:   <serial>a6b937b1-fb86-4d84-8500-52b01693b674</serial>
Aug 27 02:38:57 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 02:38:57 user nova-compute[72820]: </disk>
Aug 27 02:38:57 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:38:57 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Successfully detached device vdc from instance 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 from the persistent domain config.
Aug 27 02:38:57 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:38:57 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:38:57 user nova-compute[72820]:   <source dev="/dev/sdc"/>
Aug 27 02:38:57 user nova-compute[72820]:   <target dev="vdc" bus="virtio"/>
Aug 27 02:38:57 user nova-compute[72820]:   <serial>a6b937b1-fb86-4d84-8500-52b01693b674</serial>
Aug 27 02:38:57 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 02:38:57 user nova-compute[72820]: </disk>
Aug 27 02:38:57 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693103937.8568075, 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:38:57 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Successfully detached device vdc from instance 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 from the live domain config.
Aug 27 02:38:57 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arFndIXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:38:57 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:38:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[70673027-b3ff-44c2-913d-acede0b19e20]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:38:57 user nova-compute[72820]: No targets found.
Aug 27 02:38:57 user nova-compute[72820]: iSNS:
Aug 27 02:38:57 user nova-compute[72820]: No targets found.
Aug 27 02:38:57 user nova-compute[72820]: STATIC:
Aug 27 02:38:57 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:38:57 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:38:57 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:38:57 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb
Aug 27 02:38:57 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:38:57 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:38:57 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674
Aug 27 02:38:57 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:38:57 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:38:57 user nova-compute[72820]: FIRMWARE:
Aug 27 02:38:57 user nova-compute[72820]: No targets found.
Aug 27 02:38:57 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:38:57 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:38:57 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a31e743-7bc2-4a26-b886-7ebccdae48bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de842c0-041a-4eda-8cf1-85c585e316ad]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:38:57 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:38:57 user nova-compute[72820]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 (non-flash)
Aug 27 02:38:57 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:38:57 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:38:57 user nova-compute[72820]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 (non-flash)
Aug 27 02:38:57 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c028d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674'): ({'sdc'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Removing single pathed devices sdc {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc16d2c7-ddca-452a-8579-457411182349]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e95eaf-da0f-4cf5-b038-188ad6ebad53]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Flushing IO for device /dev/sdc {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:38:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b472fb89-9878-4a3f-8c12-8fa2adda532e]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f157469e-69f5-435a-80cb-b8715ba1ac83]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d585003-1c73-4f20-a242-256d763a116e]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[12db4bce-c67a-4068-b58f-0c8af94f4813]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674, portal: 172.16.0.220,3260]
Aug 27 02:38:58 user nova-compute[72820]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674, portal: 172.16.0.220,3260] successful.
Aug 27 02:38:58 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b937b1-fb86-4d84-8500-52b01693b674 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43787ff-7ad4-4e5b-8315-f68e68b125d9]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] <== disconnect_volume: return (307ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:38:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:38:59 user nova-compute[72820]: DEBUG nova.objects.instance [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'flavor' on Instance uuid 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:38:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6f793898-80dc-43a0-95d2-508598d89444 tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.856s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:38:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:38:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:38:59 user nova-compute[72820]: INFO nova.compute.manager [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Terminating instance
Aug 27 02:38:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:38:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-5ca97437-70e5-42aa-98bf-ebe623c3f993 req-1ef59462-344d-4c7e-8bf0-49d08dec768f service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Received event network-vif-unplugged-6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5ca97437-70e5-42aa-98bf-ebe623c3f993 req-1ef59462-344d-4c7e-8bf0-49d08dec768f service nova] Acquiring lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5ca97437-70e5-42aa-98bf-ebe623c3f993 req-1ef59462-344d-4c7e-8bf0-49d08dec768f service nova] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5ca97437-70e5-42aa-98bf-ebe623c3f993 req-1ef59462-344d-4c7e-8bf0-49d08dec768f service nova] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-5ca97437-70e5-42aa-98bf-ebe623c3f993 req-1ef59462-344d-4c7e-8bf0-49d08dec768f service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] No waiting events found dispatching network-vif-unplugged-6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-5ca97437-70e5-42aa-98bf-ebe623c3f993 req-1ef59462-344d-4c7e-8bf0-49d08dec768f service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Received event network-vif-unplugged-6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:39:00 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Instance destroyed successfully.
Aug 27 02:39:00 user nova-compute[72820]: DEBUG nova.objects.instance [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lazy-loading 'resources' on Instance uuid 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:36:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1653379425',display_name='tempest-AttachVolumeTestJSON-server-1653379425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1653379425',id=30,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIaoG2we2x0FMkHb430bBtSgDU8nDy+0V7PQNAxLOg4LSvEjSSDME6PPAQCeABDgSgi/r8pcqCPrZNqQ4xIfaoT2aGN15U4w5kZwBxiiQa4LRCraBzpFmSxT6KDD9DuSQ==',key_name='tempest-keypair-1719736260',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:36:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a70199cb55f74880a86a7f4d2342054e',ramdisk_id='',reservation_id='r-py41qjar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-316094052',owner_user_name='tempest-AttachVolumeTestJSON-316094052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:36:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbbf87fbd76543bab71f44d664bec48c',uuid=59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "address": "fa:16:3e:94:19:e2", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9d1ee5-3b", "ovs_interfaceid": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converting VIF {"id": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "address": "fa:16:3e:94:19:e2", "network": {"id": "bf5c6012-e3d5-4956-987a-d54482bff9bf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1835328250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70199cb55f74880a86a7f4d2342054e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9d1ee5-3b", "ovs_interfaceid": "6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9d1ee5-3b') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG os_vif [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9d1ee5-3b') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e9d1ee5-3b, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:00 user nova-compute[72820]: INFO os_vif [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7,network=Network(bf5c6012-e3d5-4956-987a-d54482bff9bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9d1ee5-3b')
Aug 27 02:39:00 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Deleting instance files /opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0_del
Aug 27 02:39:00 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Deletion of /opt/stack/data/nova/instances/59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0_del complete
Aug 27 02:39:00 user nova-compute[72820]: INFO nova.compute.manager [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 27 02:39:00 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:39:00 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:39:01 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:39:01 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Took 1.11 seconds to deallocate network for instance.
Aug 27 02:39:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:02 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103927.0619183, 85c8fa72-19be-49a0-975f-d6a0d30d011f => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:39:02 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] VM Stopped (Lifecycle Event)
Aug 27 02:39:02 user nova-compute[72820]: DEBUG nova.compute.manager [None req-91c5e222-19ec-44a7-a160-453b0dc1126d None None] [instance: 85c8fa72-19be-49a0-975f-d6a0d30d011f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:39:02 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:39:02 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:39:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:02 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Deleted allocations for instance 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0
Aug 27 02:39:02 user nova-compute[72820]: DEBUG nova.compute.manager [req-87a6fa70-d9b6-4814-a827-5ca3e7e5a735 req-0884f228-d39f-41d5-b315-f32bdd907d8d service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Received event network-vif-plugged-6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:39:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-87a6fa70-d9b6-4814-a827-5ca3e7e5a735 req-0884f228-d39f-41d5-b315-f32bdd907d8d service nova] Acquiring lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-87a6fa70-d9b6-4814-a827-5ca3e7e5a735 req-0884f228-d39f-41d5-b315-f32bdd907d8d service nova] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-87a6fa70-d9b6-4814-a827-5ca3e7e5a735 req-0884f228-d39f-41d5-b315-f32bdd907d8d service nova] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:02 user nova-compute[72820]: DEBUG nova.compute.manager [req-87a6fa70-d9b6-4814-a827-5ca3e7e5a735 req-0884f228-d39f-41d5-b315-f32bdd907d8d service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] No waiting events found dispatching network-vif-plugged-6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:39:02 user nova-compute[72820]: WARNING nova.compute.manager [req-87a6fa70-d9b6-4814-a827-5ca3e7e5a735 req-0884f228-d39f-41d5-b315-f32bdd907d8d service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Received unexpected event network-vif-plugged-6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 for instance with vm_state deleted and task_state None.
Aug 27 02:39:02 user nova-compute[72820]: DEBUG nova.compute.manager [req-87a6fa70-d9b6-4814-a827-5ca3e7e5a735 req-0884f228-d39f-41d5-b315-f32bdd907d8d service nova] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Received event network-vif-deleted-6e9d1ee5-3bdd-4e5d-894b-a7ab5f6637f7 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:39:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a456841f-7270-4dc0-a0ed-ec3dd478427a tempest-AttachVolumeTestJSON-316094052 tempest-AttachVolumeTestJSON-316094052-project-member] Lock "59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.605s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:06 user nova-compute[72820]: INFO nova.compute.manager [None req-f226be98-62ae-40a2-beb1-6fa26ed4103f tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Unrescuing
Aug 27 02:39:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f226be98-62ae-40a2-beb1-6fa26ed4103f tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "refresh_cache-53ce05c7-91a9-46f5-b4de-3c2c43642ef3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:39:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f226be98-62ae-40a2-beb1-6fa26ed4103f tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquired lock "refresh_cache-53ce05c7-91a9-46f5-b4de-3c2c43642ef3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:39:06 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f226be98-62ae-40a2-beb1-6fa26ed4103f tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:39:07 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f226be98-62ae-40a2-beb1-6fa26ed4103f tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Updating instance_info_cache with network_info: [{"id": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "address": "fa:16:3e:41:f5:3b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6fbe4-05", "ovs_interfaceid": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:39:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f226be98-62ae-40a2-beb1-6fa26ed4103f tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Releasing lock "refresh_cache-53ce05c7-91a9-46f5-b4de-3c2c43642ef3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:39:07 user nova-compute[72820]: DEBUG nova.objects.instance [None req-f226be98-62ae-40a2-beb1-6fa26ed4103f tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'flavor' on Instance uuid 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:39:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-b9570380-d7cd-40b8-9660-b2aa8e0fb861 req-47f11d47-d28f-4cde-88b9-d1f6fe8f1eb3 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received event network-vif-unplugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:39:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b9570380-d7cd-40b8-9660-b2aa8e0fb861 req-47f11d47-d28f-4cde-88b9-d1f6fe8f1eb3 service nova] Acquiring lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b9570380-d7cd-40b8-9660-b2aa8e0fb861 req-47f11d47-d28f-4cde-88b9-d1f6fe8f1eb3 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b9570380-d7cd-40b8-9660-b2aa8e0fb861 req-47f11d47-d28f-4cde-88b9-d1f6fe8f1eb3 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-b9570380-d7cd-40b8-9660-b2aa8e0fb861 req-47f11d47-d28f-4cde-88b9-d1f6fe8f1eb3 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] No waiting events found dispatching network-vif-unplugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:39:07 user nova-compute[72820]: WARNING nova.compute.manager [req-b9570380-d7cd-40b8-9660-b2aa8e0fb861 req-47f11d47-d28f-4cde-88b9-d1f6fe8f1eb3 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received unexpected event network-vif-unplugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:39:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquiring lock "8678adad-a0a3-4ba3-84f3-81984a457130" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "8678adad-a0a3-4ba3-84f3-81984a457130" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:39:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:08 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:39:08 user nova-compute[72820]: INFO nova.compute.claims [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Claim successful on node user
Aug 27 02:39:08 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Instance destroyed successfully.
Aug 27 02:39:08 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:39:08 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:39:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:08 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:39:08 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:39:08 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:39:08 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:39:08 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:39:08 user nova-compute[72820]: DEBUG nova.policy [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5607a2e69fce42b7af26a8c3afdb3589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc4037270664e758e9411acbfe2d3a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:39:08 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:39:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:39:08 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Creating image(s)
Aug 27 02:39:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquiring lock "/opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "/opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "/opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.196s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.192s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/disk 1073741824" returned: 0 in 0.053s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.238s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Successfully created port: 178dec21-430b-4f69-b98f-0e91ae08525c {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG nova.compute.manager [req-5d732ae6-110f-47f5-9b9c-2f1a44dd25e4 req-0056ae1d-288f-4b51-8ea8-eaf2adc32a94 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received event network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5d732ae6-110f-47f5-9b9c-2f1a44dd25e4 req-0056ae1d-288f-4b51-8ea8-eaf2adc32a94 service nova] Acquiring lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5d732ae6-110f-47f5-9b9c-2f1a44dd25e4 req-0056ae1d-288f-4b51-8ea8-eaf2adc32a94 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5d732ae6-110f-47f5-9b9c-2f1a44dd25e4 req-0056ae1d-288f-4b51-8ea8-eaf2adc32a94 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG nova.compute.manager [req-5d732ae6-110f-47f5-9b9c-2f1a44dd25e4 req-0056ae1d-288f-4b51-8ea8-eaf2adc32a94 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] No waiting events found dispatching network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:39:09 user nova-compute[72820]: WARNING nova.compute.manager [req-5d732ae6-110f-47f5-9b9c-2f1a44dd25e4 req-0056ae1d-288f-4b51-8ea8-eaf2adc32a94 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received unexpected event network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:39:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Cannot resize image /opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Ensure instance console log exists: /opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:11 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Successfully updated port: 178dec21-430b-4f69-b98f-0e91ae08525c {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:39:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-a459d78c-1304-4b8e-b25f-a8730085b6ff req-b313b56a-00eb-47fe-874e-166bc3699538 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received event network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:39:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a459d78c-1304-4b8e-b25f-a8730085b6ff req-b313b56a-00eb-47fe-874e-166bc3699538 service nova] Acquiring lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a459d78c-1304-4b8e-b25f-a8730085b6ff req-b313b56a-00eb-47fe-874e-166bc3699538 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a459d78c-1304-4b8e-b25f-a8730085b6ff req-b313b56a-00eb-47fe-874e-166bc3699538 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-a459d78c-1304-4b8e-b25f-a8730085b6ff req-b313b56a-00eb-47fe-874e-166bc3699538 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] No waiting events found dispatching network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:39:11 user nova-compute[72820]: WARNING nova.compute.manager [req-a459d78c-1304-4b8e-b25f-a8730085b6ff req-b313b56a-00eb-47fe-874e-166bc3699538 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received unexpected event network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:39:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-a459d78c-1304-4b8e-b25f-a8730085b6ff req-b313b56a-00eb-47fe-874e-166bc3699538 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received event network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:39:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a459d78c-1304-4b8e-b25f-a8730085b6ff req-b313b56a-00eb-47fe-874e-166bc3699538 service nova] Acquiring lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a459d78c-1304-4b8e-b25f-a8730085b6ff req-b313b56a-00eb-47fe-874e-166bc3699538 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a459d78c-1304-4b8e-b25f-a8730085b6ff req-b313b56a-00eb-47fe-874e-166bc3699538 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-a459d78c-1304-4b8e-b25f-a8730085b6ff req-b313b56a-00eb-47fe-874e-166bc3699538 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] No waiting events found dispatching network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:39:11 user nova-compute[72820]: WARNING nova.compute.manager [req-a459d78c-1304-4b8e-b25f-a8730085b6ff req-b313b56a-00eb-47fe-874e-166bc3699538 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received unexpected event network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 for instance with vm_state rescued and task_state unrescuing.
Aug 27 02:39:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquiring lock "refresh_cache-8678adad-a0a3-4ba3-84f3-81984a457130" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:39:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquired lock "refresh_cache-8678adad-a0a3-4ba3-84f3-81984a457130" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:39:11 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:39:11 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Removed pending event for 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 due to event {{(pid=72820) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103952.0505247, 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:39:12 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] VM Resumed (Lifecycle Event)
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f226be98-62ae-40a2-beb1-6fa26ed4103f tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:39:12 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103952.052481, 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:39:12 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] VM Started (Lifecycle Event)
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Updating instance_info_cache with network_info: [{"id": "178dec21-430b-4f69-b98f-0e91ae08525c", "address": "fa:16:3e:9f:6e:e0", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178dec21-43", "ovs_interfaceid": "178dec21-430b-4f69-b98f-0e91ae08525c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Releasing lock "refresh_cache-8678adad-a0a3-4ba3-84f3-81984a457130" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Instance network_info: |[{"id": "178dec21-430b-4f69-b98f-0e91ae08525c", "address": "fa:16:3e:9f:6e:e0", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178dec21-43", "ovs_interfaceid": "178dec21-430b-4f69-b98f-0e91ae08525c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Start _get_guest_xml network_info=[{"id": "178dec21-430b-4f69-b98f-0e91ae08525c", "address": "fa:16:3e:9f:6e:e0", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178dec21-43", "ovs_interfaceid": "178dec21-430b-4f69-b98f-0e91ae08525c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:39:12 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:39:12 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-17584111',display_name='tempest-VolumesActionsTest-instance-17584111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-17584111',id=34,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bc4037270664e758e9411acbfe2d3a3',ramdisk_id='',reservation_id='r-5qac00re',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1595890573',owner_user_name='tempest-VolumesActionsTest-1595890573-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:39:09Z,user_data=None,user_id='5607a2e69fce42b7af26a8c3afdb3589',uuid=8678adad-a0a3-4ba3-84f3-81984a457130,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "178dec21-430b-4f69-b98f-0e91ae08525c", "address": "fa:16:3e:9f:6e:e0", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178dec21-43", "ovs_interfaceid": "178dec21-430b-4f69-b98f-0e91ae08525c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Converting VIF {"id": "178dec21-430b-4f69-b98f-0e91ae08525c", "address": "fa:16:3e:9f:6e:e0", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178dec21-43", "ovs_interfaceid": "178dec21-430b-4f69-b98f-0e91ae08525c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6e:e0,bridge_name='br-int',has_traffic_filtering=True,id=178dec21-430b-4f69-b98f-0e91ae08525c,network=Network(ae065ae6-bfe7-4b57-81fc-8cd4df52cec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178dec21-43') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.objects.instance [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lazy-loading 'pci_devices' on Instance uuid 8678adad-a0a3-4ba3-84f3-81984a457130 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:39:12 user nova-compute[72820]:   <uuid>8678adad-a0a3-4ba3-84f3-81984a457130</uuid>
Aug 27 02:39:12 user nova-compute[72820]:   <name>instance-00000022</name>
Aug 27 02:39:12 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:39:12 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:39:12 user nova-compute[72820]:   <metadata>
Aug 27 02:39:12 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:39:12 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:39:12 user nova-compute[72820]:       <nova:name>tempest-VolumesActionsTest-instance-17584111</nova:name>
Aug 27 02:39:12 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:39:12</nova:creationTime>
Aug 27 02:39:12 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:39:12 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:39:12 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:39:12 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:39:12 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:39:12 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:39:12 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:39:12 user nova-compute[72820]:       <nova:owner>
Aug 27 02:39:12 user nova-compute[72820]:         <nova:user uuid="5607a2e69fce42b7af26a8c3afdb3589">tempest-VolumesActionsTest-1595890573-project-member</nova:user>
Aug 27 02:39:12 user nova-compute[72820]:         <nova:project uuid="4bc4037270664e758e9411acbfe2d3a3">tempest-VolumesActionsTest-1595890573</nova:project>
Aug 27 02:39:12 user nova-compute[72820]:       </nova:owner>
Aug 27 02:39:12 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:39:12 user nova-compute[72820]:       <nova:ports>
Aug 27 02:39:12 user nova-compute[72820]:         <nova:port uuid="178dec21-430b-4f69-b98f-0e91ae08525c">
Aug 27 02:39:12 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 02:39:12 user nova-compute[72820]:         </nova:port>
Aug 27 02:39:12 user nova-compute[72820]:       </nova:ports>
Aug 27 02:39:12 user nova-compute[72820]:     </nova:instance>
Aug 27 02:39:12 user nova-compute[72820]:   </metadata>
Aug 27 02:39:12 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:39:12 user nova-compute[72820]:     <system>
Aug 27 02:39:12 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:39:12 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:39:12 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:39:12 user nova-compute[72820]:       <entry name="serial">8678adad-a0a3-4ba3-84f3-81984a457130</entry>
Aug 27 02:39:12 user nova-compute[72820]:       <entry name="uuid">8678adad-a0a3-4ba3-84f3-81984a457130</entry>
Aug 27 02:39:12 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:39:12 user nova-compute[72820]:     </system>
Aug 27 02:39:12 user nova-compute[72820]:   </sysinfo>
Aug 27 02:39:12 user nova-compute[72820]:   <os>
Aug 27 02:39:12 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:39:12 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:39:12 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:39:12 user nova-compute[72820]:   </os>
Aug 27 02:39:12 user nova-compute[72820]:   <features>
Aug 27 02:39:12 user nova-compute[72820]:     <acpi/>
Aug 27 02:39:12 user nova-compute[72820]:     <apic/>
Aug 27 02:39:12 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:39:12 user nova-compute[72820]:   </features>
Aug 27 02:39:12 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:39:12 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:39:12 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:39:12 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:39:12 user nova-compute[72820]:   </clock>
Aug 27 02:39:12 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:39:12 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:39:12 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:39:12 user nova-compute[72820]:   </cpu>
Aug 27 02:39:12 user nova-compute[72820]:   <devices>
Aug 27 02:39:12 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:39:12 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:39:12 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/disk"/>
Aug 27 02:39:12 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:39:12 user nova-compute[72820]:     </disk>
Aug 27 02:39:12 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:39:12 user nova-compute[72820]:       <mac address="fa:16:3e:9f:6e:e0"/>
Aug 27 02:39:12 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:39:12 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:39:12 user nova-compute[72820]:       <target dev="tap178dec21-43"/>
Aug 27 02:39:12 user nova-compute[72820]:     </interface>
Aug 27 02:39:12 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:39:12 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/console.log" append="off"/>
Aug 27 02:39:12 user nova-compute[72820]:     </serial>
Aug 27 02:39:12 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:39:12 user nova-compute[72820]:     <video>
Aug 27 02:39:12 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:39:12 user nova-compute[72820]:     </video>
Aug 27 02:39:12 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:39:12 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:39:12 user nova-compute[72820]:     </rng>
Aug 27 02:39:12 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:39:12 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:39:12 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:39:12 user nova-compute[72820]:     </memballoon>
Aug 27 02:39:12 user nova-compute[72820]:   </devices>
Aug 27 02:39:12 user nova-compute[72820]: </domain>
Aug 27 02:39:12 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-17584111',display_name='tempest-VolumesActionsTest-instance-17584111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-17584111',id=34,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bc4037270664e758e9411acbfe2d3a3',ramdisk_id='',reservation_id='r-5qac00re',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1595890573',owner_user_name='tempest-VolumesActionsTest-1595890573-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:39:09Z,user_data=None,user_id='5607a2e69fce42b7af26a8c3afdb3589',uuid=8678adad-a0a3-4ba3-84f3-81984a457130,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "178dec21-430b-4f69-b98f-0e91ae08525c", "address": "fa:16:3e:9f:6e:e0", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178dec21-43", "ovs_interfaceid": "178dec21-430b-4f69-b98f-0e91ae08525c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Converting VIF {"id": "178dec21-430b-4f69-b98f-0e91ae08525c", "address": "fa:16:3e:9f:6e:e0", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178dec21-43", "ovs_interfaceid": "178dec21-430b-4f69-b98f-0e91ae08525c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6e:e0,bridge_name='br-int',has_traffic_filtering=True,id=178dec21-430b-4f69-b98f-0e91ae08525c,network=Network(ae065ae6-bfe7-4b57-81fc-8cd4df52cec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178dec21-43') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG os_vif [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6e:e0,bridge_name='br-int',has_traffic_filtering=True,id=178dec21-430b-4f69-b98f-0e91ae08525c,network=Network(ae065ae6-bfe7-4b57-81fc-8cd4df52cec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178dec21-43') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap178dec21-43, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap178dec21-43, col_values=(('external_ids', {'iface-id': '178dec21-430b-4f69-b98f-0e91ae08525c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:6e:e0', 'vm-uuid': '8678adad-a0a3-4ba3-84f3-81984a457130'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:12 user nova-compute[72820]: INFO os_vif [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6e:e0,bridge_name='br-int',has_traffic_filtering=True,id=178dec21-430b-4f69-b98f-0e91ae08525c,network=Network(ae065ae6-bfe7-4b57-81fc-8cd4df52cec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178dec21-43')
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] No VIF found with MAC fa:16:3e:9f:6e:e0, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:39:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-1bd0ffc9-d08f-4437-b64a-ec514b894ec9 req-fd76e187-1038-4d1b-a80c-b585c57e180a service nova] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Received event network-changed-178dec21-430b-4f69-b98f-0e91ae08525c {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:39:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-1bd0ffc9-d08f-4437-b64a-ec514b894ec9 req-fd76e187-1038-4d1b-a80c-b585c57e180a service nova] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Refreshing instance network info cache due to event network-changed-178dec21-430b-4f69-b98f-0e91ae08525c. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:39:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1bd0ffc9-d08f-4437-b64a-ec514b894ec9 req-fd76e187-1038-4d1b-a80c-b585c57e180a service nova] Acquiring lock "refresh_cache-8678adad-a0a3-4ba3-84f3-81984a457130" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:39:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1bd0ffc9-d08f-4437-b64a-ec514b894ec9 req-fd76e187-1038-4d1b-a80c-b585c57e180a service nova] Acquired lock "refresh_cache-8678adad-a0a3-4ba3-84f3-81984a457130" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:39:13 user nova-compute[72820]: DEBUG nova.network.neutron [req-1bd0ffc9-d08f-4437-b64a-ec514b894ec9 req-fd76e187-1038-4d1b-a80c-b585c57e180a service nova] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Refreshing network info cache for port 178dec21-430b-4f69-b98f-0e91ae08525c {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:39:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:14 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:39:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-75dda820-8435-446b-b118-c79fc7f68998 req-63302734-9858-4cd7-adaf-0e0c9116f909 service nova] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Received event network-vif-plugged-178dec21-430b-4f69-b98f-0e91ae08525c {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:39:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-75dda820-8435-446b-b118-c79fc7f68998 req-63302734-9858-4cd7-adaf-0e0c9116f909 service nova] Acquiring lock "8678adad-a0a3-4ba3-84f3-81984a457130-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-75dda820-8435-446b-b118-c79fc7f68998 req-63302734-9858-4cd7-adaf-0e0c9116f909 service nova] Lock "8678adad-a0a3-4ba3-84f3-81984a457130-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-75dda820-8435-446b-b118-c79fc7f68998 req-63302734-9858-4cd7-adaf-0e0c9116f909 service nova] Lock "8678adad-a0a3-4ba3-84f3-81984a457130-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-75dda820-8435-446b-b118-c79fc7f68998 req-63302734-9858-4cd7-adaf-0e0c9116f909 service nova] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] No waiting events found dispatching network-vif-plugged-178dec21-430b-4f69-b98f-0e91ae08525c {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:39:14 user nova-compute[72820]: WARNING nova.compute.manager [req-75dda820-8435-446b-b118-c79fc7f68998 req-63302734-9858-4cd7-adaf-0e0c9116f909 service nova] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Received unexpected event network-vif-plugged-178dec21-430b-4f69-b98f-0e91ae08525c for instance with vm_state building and task_state spawning.
Aug 27 02:39:14 user nova-compute[72820]: DEBUG nova.network.neutron [req-1bd0ffc9-d08f-4437-b64a-ec514b894ec9 req-fd76e187-1038-4d1b-a80c-b585c57e180a service nova] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Updated VIF entry in instance network info cache for port 178dec21-430b-4f69-b98f-0e91ae08525c. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:39:14 user nova-compute[72820]: DEBUG nova.network.neutron [req-1bd0ffc9-d08f-4437-b64a-ec514b894ec9 req-fd76e187-1038-4d1b-a80c-b585c57e180a service nova] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Updating instance_info_cache with network_info: [{"id": "178dec21-430b-4f69-b98f-0e91ae08525c", "address": "fa:16:3e:9f:6e:e0", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178dec21-43", "ovs_interfaceid": "178dec21-430b-4f69-b98f-0e91ae08525c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:39:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1bd0ffc9-d08f-4437-b64a-ec514b894ec9 req-fd76e187-1038-4d1b-a80c-b585c57e180a service nova] Releasing lock "refresh_cache-8678adad-a0a3-4ba3-84f3-81984a457130" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:39:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:15 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103940.6378398, 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:39:15 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] VM Stopped (Lifecycle Event)
Aug 27 02:39:15 user nova-compute[72820]: DEBUG nova.compute.manager [None req-21020d35-e627-4a5f-984b-a0c0ba2982c6 None None] [instance: 59a775b8-b98c-4ac5-97fd-8dd4e2c0ebe0] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:39:16 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:39:16 user nova-compute[72820]: DEBUG nova.compute.manager [req-bedd93b8-8f5b-47dc-9693-78dbc2f5e0cf req-513e3ef3-861d-4f5f-be5f-a7900cf235b0 service nova] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Received event network-vif-plugged-178dec21-430b-4f69-b98f-0e91ae08525c {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:39:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bedd93b8-8f5b-47dc-9693-78dbc2f5e0cf req-513e3ef3-861d-4f5f-be5f-a7900cf235b0 service nova] Acquiring lock "8678adad-a0a3-4ba3-84f3-81984a457130-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bedd93b8-8f5b-47dc-9693-78dbc2f5e0cf req-513e3ef3-861d-4f5f-be5f-a7900cf235b0 service nova] Lock "8678adad-a0a3-4ba3-84f3-81984a457130-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bedd93b8-8f5b-47dc-9693-78dbc2f5e0cf req-513e3ef3-861d-4f5f-be5f-a7900cf235b0 service nova] Lock "8678adad-a0a3-4ba3-84f3-81984a457130-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:16 user nova-compute[72820]: DEBUG nova.compute.manager [req-bedd93b8-8f5b-47dc-9693-78dbc2f5e0cf req-513e3ef3-861d-4f5f-be5f-a7900cf235b0 service nova] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] No waiting events found dispatching network-vif-plugged-178dec21-430b-4f69-b98f-0e91ae08525c {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:39:16 user nova-compute[72820]: WARNING nova.compute.manager [req-bedd93b8-8f5b-47dc-9693-78dbc2f5e0cf req-513e3ef3-861d-4f5f-be5f-a7900cf235b0 service nova] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Received unexpected event network-vif-plugged-178dec21-430b-4f69-b98f-0e91ae08525c for instance with vm_state building and task_state spawning.
Aug 27 02:39:16 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103956.5634706, 8678adad-a0a3-4ba3-84f3-81984a457130 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:39:16 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] VM Resumed (Lifecycle Event)
Aug 27 02:39:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:39:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:39:16 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Instance spawned successfully.
Aug 27 02:39:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:39:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:39:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:39:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:39:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:39:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:39:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:39:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:39:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:39:16 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:39:16 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103956.5650482, 8678adad-a0a3-4ba3-84f3-81984a457130 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:39:16 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] VM Started (Lifecycle Event)
Aug 27 02:39:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:39:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:39:16 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:39:16 user nova-compute[72820]: INFO nova.compute.manager [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Took 7.91 seconds to spawn the instance on the hypervisor.
Aug 27 02:39:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:39:16 user nova-compute[72820]: INFO nova.compute.manager [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Took 8.81 seconds to build instance.
Aug 27 02:39:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f4aff0dc-a0f3-4a06-b7fc-7d57fc7b6f99 tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "8678adad-a0a3-4ba3-84f3-81984a457130" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.948s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:17 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:39:17 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:39:17 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:39:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:21 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:39:21 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:39:21 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:39:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:21 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:39:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:39:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:21 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:39:21 user nova-compute[72820]: INFO nova.compute.claims [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Claim successful on node user
Aug 27 02:39:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:39:22 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:39:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:39:22 user nova-compute[72820]: INFO nova.virt.block_device [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Booting with volume 9a7af1bf-d395-4e76-85de-944041885c0b at /dev/vda
Aug 27 02:39:22 user nova-compute[72820]: DEBUG nova.policy [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '878038feacda4094b5d2c9e3814c8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f02ddcfa2b4571a4d7cacf1287aebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.512s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG os_brick.utils [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[af16fca2-8c27-4317-9450-a6326f299381]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53bee37-4082-4338-9240-cfa68bb89c44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[806fcc50-e465-4e7e-ac69-49da6ac9af1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e70661e-440c-4338-9bc9-ba0fb28c77f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:39:22 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f843abf6-2115-49cb-bc6e-fa7c35622c4b]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG os_brick.utils [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:39:22 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Updating existing volume attachment record: 9b533b4d-ad89-4df1-9ff3-d8d591821351 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:39:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:23 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Successfully created port: 9c663cbb-4c46-4618-b58e-318aa323a440 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:39:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:39:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Successfully updated port: 9c663cbb-4c46-4618-b58e-318aa323a440 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-8abc34cc-afed-48d6-8204-b52341dff00a req-9bbf4910-07f8-4ec5-889a-e5baf3da1150 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Received event network-changed-9c663cbb-4c46-4618-b58e-318aa323a440 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-8abc34cc-afed-48d6-8204-b52341dff00a req-9bbf4910-07f8-4ec5-889a-e5baf3da1150 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Refreshing instance network info cache due to event network-changed-9c663cbb-4c46-4618-b58e-318aa323a440. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8abc34cc-afed-48d6-8204-b52341dff00a req-9bbf4910-07f8-4ec5-889a-e5baf3da1150 service nova] Acquiring lock "refresh_cache-96b0b198-aadc-44cb-a54e-9cc1a08226dc" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8abc34cc-afed-48d6-8204-b52341dff00a req-9bbf4910-07f8-4ec5-889a-e5baf3da1150 service nova] Acquired lock "refresh_cache-96b0b198-aadc-44cb-a54e-9cc1a08226dc" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG nova.network.neutron [req-8abc34cc-afed-48d6-8204-b52341dff00a req-9bbf4910-07f8-4ec5-889a-e5baf3da1150 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Refreshing network info cache for port 9c663cbb-4c46-4618-b58e-318aa323a440 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:39:24 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:39:24 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:39:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7741MB free_disk=25.021251678466797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "refresh_cache-96b0b198-aadc-44cb-a54e-9cc1a08226dc" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG nova.network.neutron [req-8abc34cc-afed-48d6-8204-b52341dff00a req-9bbf4910-07f8-4ec5-889a-e5baf3da1150 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6f37daba-9183-4111-bd01-f30cc4b83c2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1591319d-3d15-4c46-b823-4edddf018b5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 15a1062a-ecfb-42b7-b8e5-03adbd6b8056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance b1a0ba95-2678-493d-87ba-061abf80887a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 8678adad-a0a3-4ba3-84f3-81984a457130 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 96b0b198-aadc-44cb-a54e-9cc1a08226dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:39:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:39:25 user nova-compute[72820]: DEBUG nova.network.neutron [req-8abc34cc-afed-48d6-8204-b52341dff00a req-9bbf4910-07f8-4ec5-889a-e5baf3da1150 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:39:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8abc34cc-afed-48d6-8204-b52341dff00a req-9bbf4910-07f8-4ec5-889a-e5baf3da1150 service nova] Releasing lock "refresh_cache-96b0b198-aadc-44cb-a54e-9cc1a08226dc" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:39:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquired lock "refresh_cache-96b0b198-aadc-44cb-a54e-9cc1a08226dc" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:39:25 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:39:25 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:39:25 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:39:25 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:39:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:25 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:39:26 user nova-compute[72820]: DEBUG nova.network.neutron [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Updating instance_info_cache with network_info: [{"id": "9c663cbb-4c46-4618-b58e-318aa323a440", "address": "fa:16:3e:fb:46:b1", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c663cbb-4c", "ovs_interfaceid": "9c663cbb-4c46-4618-b58e-318aa323a440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:39:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Releasing lock "refresh_cache-96b0b198-aadc-44cb-a54e-9cc1a08226dc" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:39:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Instance network_info: |[{"id": "9c663cbb-4c46-4618-b58e-318aa323a440", "address": "fa:16:3e:fb:46:b1", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c663cbb-4c", "ovs_interfaceid": "9c663cbb-4c46-4618-b58e-318aa323a440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:39:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:28 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:39:28 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:39:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:39:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-1591319d-3d15-4c46-b823-4edddf018b5f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:39:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-1591319d-3d15-4c46-b823-4edddf018b5f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:39:28 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:39:28 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Updating instance_info_cache with network_info: [{"id": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "address": "fa:16:3e:05:00:70", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb04bdd2-29", "ovs_interfaceid": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:39:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-1591319d-3d15-4c46-b823-4edddf018b5f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:39:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:39:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:39:34 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Creating image(s)
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Did not create local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Ensure instance console log exists: /opt/stack/data/nova/instances/96b0b198-aadc-44cb-a54e-9cc1a08226dc/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Start _get_guest_xml network_info=[{"id": "9c663cbb-4c46-4618-b58e-318aa323a440", "address": "fa:16:3e:fb:46:b1", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c663cbb-4c", "ovs_interfaceid": "9c663cbb-4c46-4618-b58e-318aa323a440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9b533b4d-ad89-4df1-9ff3-d8d591821351', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yiWBmZkw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '96b0b198-aadc-44cb-a54e-9cc1a08226dc', 'attached_at': '', 'detached_at': '', 'volume_id': '9a7af1bf-d395-4e76-85de-944041885c0b', 'serial': '9a7af1bf-d395-4e76-85de-944041885c0b'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:39:34 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:39:34 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yiWBmZkw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:39:34 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:39:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:39:34 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:39:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:39:34 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4584b5fc-5668-4e26-b93a-79b6df22cd92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:39:34 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c5234b-e88c-44f4-91d4-b0ba25d4e21c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b] added
Aug 27 02:39:34 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0b7cea-eb4f-4734-8084-3c5ea0533623]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0c9c43-a8d5-46e6-bd23-9a7af4a00e5b]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yiWBmZkw {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yiWBmZkw" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaec363e-ff0d-4394-b4d1-117cbb2b1243]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yiWBmZkw'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1064df1-0120-44a1-961f-8f0d6691db23]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7481993e-1f23-4a4d-a5ab-d621cb025ddf]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:39:34 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:39:34 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:39:34 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:39:34 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[450023f1-8f8f-4c51-9640-430c1fdf1270]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b, portal: 172.16.0.220,3260]
Aug 27 02:39:34 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b, portal: 172.16.0.220,3260] successful.
Aug 27 02:39:34 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b6bcf6-cff9-498b-a779-c07af7ef3fb4]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:39:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:35 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a17169e-2ba1-4291-a303-f363c1701bc0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:39:35 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:39:35 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:39:35 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:39:35 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:39:35 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:39:35 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:39:35 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:39:35 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:39:35 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:39:35 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:39:35 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:39:35 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:39:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:39:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:39:35 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3495a99c-349a-4d06-a75c-596d26beff74]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:39:35 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:39:35 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yiWBmZkw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23534663433303936', 'path': '/dev/sdb'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534663433303936', 'path': '/dev/sdb'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-38069467',display_name='tempest-TestVolumeBootPattern-volume-backed-server-38069467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-38069467',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOKPBoOH6a8HuZnXEMPsPKAOXgNqMpvHxPQO7+4INzfu9DL259bmU3+zvkNeEhdHxwTrb/YIiOkr59XMdG1dIMgbZAVuxTJ0/9KtuIp4mf+ft3vBWN3Z+CCUzUbNeS1Ag==',key_name='tempest-keypair-2139575159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84f02ddcfa2b4571a4d7cacf1287aebd',ramdisk_id='',reservation_id='r-hyd8ffz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-631676638',owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='878038feacda4094b5d2c9e3814c8bf0',uuid=96b0b198-aadc-44cb-a54e-9cc1a08226dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c663cbb-4c46-4618-b58e-318aa323a440", "address": "fa:16:3e:fb:46:b1", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c663cbb-4c", "ovs_interfaceid": "9c663cbb-4c46-4618-b58e-318aa323a440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converting VIF {"id": "9c663cbb-4c46-4618-b58e-318aa323a440", "address": "fa:16:3e:fb:46:b1", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c663cbb-4c", "ovs_interfaceid": "9c663cbb-4c46-4618-b58e-318aa323a440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:46:b1,bridge_name='br-int',has_traffic_filtering=True,id=9c663cbb-4c46-4618-b58e-318aa323a440,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c663cbb-4c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG nova.objects.instance [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lazy-loading 'pci_devices' on Instance uuid 96b0b198-aadc-44cb-a54e-9cc1a08226dc {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:39:36 user nova-compute[72820]:   <uuid>96b0b198-aadc-44cb-a54e-9cc1a08226dc</uuid>
Aug 27 02:39:36 user nova-compute[72820]:   <name>instance-00000023</name>
Aug 27 02:39:36 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:39:36 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:39:36 user nova-compute[72820]:   <metadata>
Aug 27 02:39:36 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:39:36 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:39:36 user nova-compute[72820]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-38069467</nova:name>
Aug 27 02:39:36 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:39:34</nova:creationTime>
Aug 27 02:39:36 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:39:36 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:39:36 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:39:36 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:39:36 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:39:36 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:39:36 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:39:36 user nova-compute[72820]:       <nova:owner>
Aug 27 02:39:36 user nova-compute[72820]:         <nova:user uuid="878038feacda4094b5d2c9e3814c8bf0">tempest-TestVolumeBootPattern-631676638-project-member</nova:user>
Aug 27 02:39:36 user nova-compute[72820]:         <nova:project uuid="84f02ddcfa2b4571a4d7cacf1287aebd">tempest-TestVolumeBootPattern-631676638</nova:project>
Aug 27 02:39:36 user nova-compute[72820]:       </nova:owner>
Aug 27 02:39:36 user nova-compute[72820]:       <nova:ports>
Aug 27 02:39:36 user nova-compute[72820]:         <nova:port uuid="9c663cbb-4c46-4618-b58e-318aa323a440">
Aug 27 02:39:36 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 02:39:36 user nova-compute[72820]:         </nova:port>
Aug 27 02:39:36 user nova-compute[72820]:       </nova:ports>
Aug 27 02:39:36 user nova-compute[72820]:     </nova:instance>
Aug 27 02:39:36 user nova-compute[72820]:   </metadata>
Aug 27 02:39:36 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:39:36 user nova-compute[72820]:     <system>
Aug 27 02:39:36 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:39:36 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:39:36 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:39:36 user nova-compute[72820]:       <entry name="serial">96b0b198-aadc-44cb-a54e-9cc1a08226dc</entry>
Aug 27 02:39:36 user nova-compute[72820]:       <entry name="uuid">96b0b198-aadc-44cb-a54e-9cc1a08226dc</entry>
Aug 27 02:39:36 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:39:36 user nova-compute[72820]:     </system>
Aug 27 02:39:36 user nova-compute[72820]:   </sysinfo>
Aug 27 02:39:36 user nova-compute[72820]:   <os>
Aug 27 02:39:36 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:39:36 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:39:36 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:39:36 user nova-compute[72820]:   </os>
Aug 27 02:39:36 user nova-compute[72820]:   <features>
Aug 27 02:39:36 user nova-compute[72820]:     <acpi/>
Aug 27 02:39:36 user nova-compute[72820]:     <apic/>
Aug 27 02:39:36 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:39:36 user nova-compute[72820]:   </features>
Aug 27 02:39:36 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:39:36 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:39:36 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:39:36 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:39:36 user nova-compute[72820]:   </clock>
Aug 27 02:39:36 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:39:36 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:39:36 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:39:36 user nova-compute[72820]:   </cpu>
Aug 27 02:39:36 user nova-compute[72820]:   <devices>
Aug 27 02:39:36 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:39:36 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:39:36 user nova-compute[72820]:       <source dev="/dev/sdb"/>
Aug 27 02:39:36 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:39:36 user nova-compute[72820]:       <serial>9a7af1bf-d395-4e76-85de-944041885c0b</serial>
Aug 27 02:39:36 user nova-compute[72820]:     </disk>
Aug 27 02:39:36 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:39:36 user nova-compute[72820]:       <mac address="fa:16:3e:fb:46:b1"/>
Aug 27 02:39:36 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:39:36 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:39:36 user nova-compute[72820]:       <target dev="tap9c663cbb-4c"/>
Aug 27 02:39:36 user nova-compute[72820]:     </interface>
Aug 27 02:39:36 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:39:36 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/96b0b198-aadc-44cb-a54e-9cc1a08226dc/console.log" append="off"/>
Aug 27 02:39:36 user nova-compute[72820]:     </serial>
Aug 27 02:39:36 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:39:36 user nova-compute[72820]:     <video>
Aug 27 02:39:36 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:39:36 user nova-compute[72820]:     </video>
Aug 27 02:39:36 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:39:36 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:39:36 user nova-compute[72820]:     </rng>
Aug 27 02:39:36 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:39:36 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:39:36 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:39:36 user nova-compute[72820]:     </memballoon>
Aug 27 02:39:36 user nova-compute[72820]:   </devices>
Aug 27 02:39:36 user nova-compute[72820]: </domain>
Aug 27 02:39:36 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-38069467',display_name='tempest-TestVolumeBootPattern-volume-backed-server-38069467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-38069467',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOKPBoOH6a8HuZnXEMPsPKAOXgNqMpvHxPQO7+4INzfu9DL259bmU3+zvkNeEhdHxwTrb/YIiOkr59XMdG1dIMgbZAVuxTJ0/9KtuIp4mf+ft3vBWN3Z+CCUzUbNeS1Ag==',key_name='tempest-keypair-2139575159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84f02ddcfa2b4571a4d7cacf1287aebd',ramdisk_id='',reservation_id='r-hyd8ffz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-631676638',owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='878038feacda4094b5d2c9e3814c8bf0',uuid=96b0b198-aadc-44cb-a54e-9cc1a08226dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c663cbb-4c46-4618-b58e-318aa323a440", "address": "fa:16:3e:fb:46:b1", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c663cbb-4c", "ovs_interfaceid": "9c663cbb-4c46-4618-b58e-318aa323a440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converting VIF {"id": "9c663cbb-4c46-4618-b58e-318aa323a440", "address": "fa:16:3e:fb:46:b1", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c663cbb-4c", "ovs_interfaceid": "9c663cbb-4c46-4618-b58e-318aa323a440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:46:b1,bridge_name='br-int',has_traffic_filtering=True,id=9c663cbb-4c46-4618-b58e-318aa323a440,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c663cbb-4c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG os_vif [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:46:b1,bridge_name='br-int',has_traffic_filtering=True,id=9c663cbb-4c46-4618-b58e-318aa323a440,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c663cbb-4c') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c663cbb-4c, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c663cbb-4c, col_values=(('external_ids', {'iface-id': '9c663cbb-4c46-4618-b58e-318aa323a440', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:46:b1', 'vm-uuid': '96b0b198-aadc-44cb-a54e-9cc1a08226dc'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:36 user nova-compute[72820]: INFO os_vif [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:46:b1,bridge_name='br-int',has_traffic_filtering=True,id=9c663cbb-4c46-4618-b58e-318aa323a440,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c663cbb-4c')
Aug 27 02:39:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:39:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] No VIF found with MAC fa:16:3e:fb:46:b1, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:39:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-7af3f045-6053-4d3c-ba1e-f7ca4b77c47f req-406a39a2-81ea-4d61-b055-4b5e8f86bab0 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Received event network-vif-plugged-9c663cbb-4c46-4618-b58e-318aa323a440 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:39:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7af3f045-6053-4d3c-ba1e-f7ca4b77c47f req-406a39a2-81ea-4d61-b055-4b5e8f86bab0 service nova] Acquiring lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7af3f045-6053-4d3c-ba1e-f7ca4b77c47f req-406a39a2-81ea-4d61-b055-4b5e8f86bab0 service nova] Lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7af3f045-6053-4d3c-ba1e-f7ca4b77c47f req-406a39a2-81ea-4d61-b055-4b5e8f86bab0 service nova] Lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-7af3f045-6053-4d3c-ba1e-f7ca4b77c47f req-406a39a2-81ea-4d61-b055-4b5e8f86bab0 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] No waiting events found dispatching network-vif-plugged-9c663cbb-4c46-4618-b58e-318aa323a440 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:39:37 user nova-compute[72820]: WARNING nova.compute.manager [req-7af3f045-6053-4d3c-ba1e-f7ca4b77c47f req-406a39a2-81ea-4d61-b055-4b5e8f86bab0 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Received unexpected event network-vif-plugged-9c663cbb-4c46-4618-b58e-318aa323a440 for instance with vm_state building and task_state spawning.
Aug 27 02:39:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:39 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103979.8714173, 96b0b198-aadc-44cb-a54e-9cc1a08226dc => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:39:39 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] VM Resumed (Lifecycle Event)
Aug 27 02:39:39 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:39:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:39:39 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Instance spawned successfully.
Aug 27 02:39:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:39:39 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:39:39 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:39:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:39:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:39:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:39:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:39:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:39:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:39:39 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:39:39 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693103979.875857, 96b0b198-aadc-44cb-a54e-9cc1a08226dc => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:39:39 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] VM Started (Lifecycle Event)
Aug 27 02:39:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-8711ab2d-8f4d-4b10-bf0a-d81d304a3204 req-5f1d9732-771b-468c-904c-e3954cd6f976 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Received event network-vif-plugged-9c663cbb-4c46-4618-b58e-318aa323a440 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:39:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8711ab2d-8f4d-4b10-bf0a-d81d304a3204 req-5f1d9732-771b-468c-904c-e3954cd6f976 service nova] Acquiring lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8711ab2d-8f4d-4b10-bf0a-d81d304a3204 req-5f1d9732-771b-468c-904c-e3954cd6f976 service nova] Lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8711ab2d-8f4d-4b10-bf0a-d81d304a3204 req-5f1d9732-771b-468c-904c-e3954cd6f976 service nova] Lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-8711ab2d-8f4d-4b10-bf0a-d81d304a3204 req-5f1d9732-771b-468c-904c-e3954cd6f976 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] No waiting events found dispatching network-vif-plugged-9c663cbb-4c46-4618-b58e-318aa323a440 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:39:39 user nova-compute[72820]: WARNING nova.compute.manager [req-8711ab2d-8f4d-4b10-bf0a-d81d304a3204 req-5f1d9732-771b-468c-904c-e3954cd6f976 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Received unexpected event network-vif-plugged-9c663cbb-4c46-4618-b58e-318aa323a440 for instance with vm_state building and task_state spawning.
Aug 27 02:39:39 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:39:39 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:39:39 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:39:39 user nova-compute[72820]: INFO nova.compute.manager [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Took 5.31 seconds to spawn the instance on the hypervisor.
Aug 27 02:39:39 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:39:40 user nova-compute[72820]: INFO nova.compute.manager [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Took 18.52 seconds to build instance.
Aug 27 02:39:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a030734d-c503-434f-a575-b83665f912ef tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.620s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "6f37daba-9183-4111-bd01-f30cc4b83c2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "6f37daba-9183-4111-bd01-f30cc4b83c2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "6f37daba-9183-4111-bd01-f30cc4b83c2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "6f37daba-9183-4111-bd01-f30cc4b83c2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "6f37daba-9183-4111-bd01-f30cc4b83c2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:48 user nova-compute[72820]: INFO nova.compute.manager [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Terminating instance
Aug 27 02:39:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:39:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:49 user nova-compute[72820]: DEBUG nova.compute.manager [req-c2daf2ca-ecd6-4996-a8f8-89acd95afdfd req-6f8c8a60-8de7-43e6-a54d-15482454d3af service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Received event network-vif-unplugged-a0280116-060c-4078-b415-7abd9005c221 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:39:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c2daf2ca-ecd6-4996-a8f8-89acd95afdfd req-6f8c8a60-8de7-43e6-a54d-15482454d3af service nova] Acquiring lock "6f37daba-9183-4111-bd01-f30cc4b83c2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c2daf2ca-ecd6-4996-a8f8-89acd95afdfd req-6f8c8a60-8de7-43e6-a54d-15482454d3af service nova] Lock "6f37daba-9183-4111-bd01-f30cc4b83c2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c2daf2ca-ecd6-4996-a8f8-89acd95afdfd req-6f8c8a60-8de7-43e6-a54d-15482454d3af service nova] Lock "6f37daba-9183-4111-bd01-f30cc4b83c2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:49 user nova-compute[72820]: DEBUG nova.compute.manager [req-c2daf2ca-ecd6-4996-a8f8-89acd95afdfd req-6f8c8a60-8de7-43e6-a54d-15482454d3af service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] No waiting events found dispatching network-vif-unplugged-a0280116-060c-4078-b415-7abd9005c221 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:39:49 user nova-compute[72820]: DEBUG nova.compute.manager [req-c2daf2ca-ecd6-4996-a8f8-89acd95afdfd req-6f8c8a60-8de7-43e6-a54d-15482454d3af service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Received event network-vif-unplugged-a0280116-060c-4078-b415-7abd9005c221 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:39:49 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Instance destroyed successfully.
Aug 27 02:39:49 user nova-compute[72820]: DEBUG nova.objects.instance [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lazy-loading 'resources' on Instance uuid 6f37daba-9183-4111-bd01-f30cc4b83c2f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:39:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1387597911',display_name='tempest-ServerActionsTestOtherA-server-1387597911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1387597911',id=5,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuMDNJccFoG9J2MvjXPhebjkkaCvYt2BV0fWoVRWE0WGnLVqeM0TmypkIBpwP+aIP0dc17AS8ytt0zxz7hB47f2I8lo+2akMvc3UtIkl7mLDLkN7AXVg520jT6ETK7MXw==',key_name='tempest-keypair-1957607282',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:20:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7797569db44f40f193483e6e6933a0d0',ramdisk_id='',reservation_id='r-2pmbbm13',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-892102693',owner_user_name='tempest-ServerActionsTestOtherA-892102693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:20:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='275f713edfd042d4b4fa32620956484a',uuid=6f37daba-9183-4111-bd01-f30cc4b83c2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0280116-060c-4078-b415-7abd9005c221", "address": "fa:16:3e:dc:2f:1b", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0280116-06", "ovs_interfaceid": "a0280116-060c-4078-b415-7abd9005c221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:39:49 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converting VIF {"id": "a0280116-060c-4078-b415-7abd9005c221", "address": "fa:16:3e:dc:2f:1b", "network": {"id": "daa639e7-6004-492e-81c2-75654cf0466a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493967525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7797569db44f40f193483e6e6933a0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0280116-06", "ovs_interfaceid": "a0280116-060c-4078-b415-7abd9005c221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:39:49 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:2f:1b,bridge_name='br-int',has_traffic_filtering=True,id=a0280116-060c-4078-b415-7abd9005c221,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0280116-06') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:39:49 user nova-compute[72820]: DEBUG os_vif [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:2f:1b,bridge_name='br-int',has_traffic_filtering=True,id=a0280116-060c-4078-b415-7abd9005c221,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0280116-06') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:39:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0280116-06, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:39:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:39:49 user nova-compute[72820]: INFO os_vif [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:2f:1b,bridge_name='br-int',has_traffic_filtering=True,id=a0280116-060c-4078-b415-7abd9005c221,network=Network(daa639e7-6004-492e-81c2-75654cf0466a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0280116-06')
Aug 27 02:39:49 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Deleting instance files /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f_del
Aug 27 02:39:49 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Deletion of /opt/stack/data/nova/instances/6f37daba-9183-4111-bd01-f30cc4b83c2f_del complete
Aug 27 02:39:49 user nova-compute[72820]: INFO nova.compute.manager [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 27 02:39:49 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:39:49 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:39:49 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:39:50 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:39:50 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Took 1.17 seconds to deallocate network for instance.
Aug 27 02:39:50 user nova-compute[72820]: DEBUG nova.compute.manager [req-565f70e3-53de-423d-bf7f-001ecb36bb49 req-ca66f1b3-c64b-477c-9c65-d12aa48cef72 service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Received event network-vif-deleted-a0280116-060c-4078-b415-7abd9005c221 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:39:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:51 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:39:51 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:39:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:51 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Deleted allocations for instance 6f37daba-9183-4111-bd01-f30cc4b83c2f
Aug 27 02:39:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ebfd9c8d-acbb-4cce-a1e6-b04d546c2adc tempest-ServerActionsTestOtherA-892102693 tempest-ServerActionsTestOtherA-892102693-project-member] Lock "6f37daba-9183-4111-bd01-f30cc4b83c2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.655s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-30884332-2d7e-4e64-9b1a-e7f4a453518b req-fd20c2a2-47d3-4922-85c9-3323cb9621ee service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Received event network-vif-plugged-a0280116-060c-4078-b415-7abd9005c221 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:39:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-30884332-2d7e-4e64-9b1a-e7f4a453518b req-fd20c2a2-47d3-4922-85c9-3323cb9621ee service nova] Acquiring lock "6f37daba-9183-4111-bd01-f30cc4b83c2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:39:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-30884332-2d7e-4e64-9b1a-e7f4a453518b req-fd20c2a2-47d3-4922-85c9-3323cb9621ee service nova] Lock "6f37daba-9183-4111-bd01-f30cc4b83c2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:39:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-30884332-2d7e-4e64-9b1a-e7f4a453518b req-fd20c2a2-47d3-4922-85c9-3323cb9621ee service nova] Lock "6f37daba-9183-4111-bd01-f30cc4b83c2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:39:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-30884332-2d7e-4e64-9b1a-e7f4a453518b req-fd20c2a2-47d3-4922-85c9-3323cb9621ee service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] No waiting events found dispatching network-vif-plugged-a0280116-060c-4078-b415-7abd9005c221 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:39:51 user nova-compute[72820]: WARNING nova.compute.manager [req-30884332-2d7e-4e64-9b1a-e7f4a453518b req-fd20c2a2-47d3-4922-85c9-3323cb9621ee service nova] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Received unexpected event network-vif-plugged-a0280116-060c-4078-b415-7abd9005c221 for instance with vm_state deleted and task_state None.
Aug 27 02:39:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:39:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Acquiring lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG nova.compute.manager [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:40:02 user nova-compute[72820]: INFO nova.compute.claims [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Claim successful on node user
Aug 27 02:40:02 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG nova.compute.manager [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG nova.compute.manager [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG nova.network.neutron [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:40:02 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:40:02 user nova-compute[72820]: DEBUG nova.compute.manager [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG nova.policy [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33e98854926f4e1580b450ad5debdce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce56ca2340b84b4785f0f8132f15296b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG nova.compute.manager [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:40:02 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Creating image(s)
Aug 27 02:40:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "/opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "/opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.179s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk 1073741824" returned: 0 in 0.052s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:03 user nova-compute[72820]: DEBUG nova.network.neutron [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Successfully created port: 8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:40:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.230s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:03 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:40:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:03 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Cannot resize image /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:40:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:40:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Ensure instance console log exists: /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:40:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:04 user nova-compute[72820]: DEBUG nova.network.neutron [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Successfully updated port: 8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:40:04 user nova-compute[72820]: DEBUG nova.compute.manager [req-ecffb4cc-5945-492d-847f-1ac6137c4375 req-4c6741be-d257-4838-9895-97d9dd6cc7a0 service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Received event network-changed-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:40:04 user nova-compute[72820]: DEBUG nova.compute.manager [req-ecffb4cc-5945-492d-847f-1ac6137c4375 req-4c6741be-d257-4838-9895-97d9dd6cc7a0 service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Refreshing instance network info cache due to event network-changed-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:40:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ecffb4cc-5945-492d-847f-1ac6137c4375 req-4c6741be-d257-4838-9895-97d9dd6cc7a0 service nova] Acquiring lock "refresh_cache-dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:40:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ecffb4cc-5945-492d-847f-1ac6137c4375 req-4c6741be-d257-4838-9895-97d9dd6cc7a0 service nova] Acquired lock "refresh_cache-dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:40:04 user nova-compute[72820]: DEBUG nova.network.neutron [req-ecffb4cc-5945-492d-847f-1ac6137c4375 req-4c6741be-d257-4838-9895-97d9dd6cc7a0 service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Refreshing network info cache for port 8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:40:04 user nova-compute[72820]: DEBUG nova.network.neutron [req-ecffb4cc-5945-492d-847f-1ac6137c4375 req-4c6741be-d257-4838-9895-97d9dd6cc7a0 service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:40:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Acquiring lock "refresh_cache-dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:40:04 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693103989.6107564, 6f37daba-9183-4111-bd01-f30cc4b83c2f => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:40:04 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] VM Stopped (Lifecycle Event)
Aug 27 02:40:04 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a4111d9b-4e1a-4cbb-8417-05865cdfd021 None None] [instance: 6f37daba-9183-4111-bd01-f30cc4b83c2f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:40:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:04 user nova-compute[72820]: DEBUG nova.network.neutron [req-ecffb4cc-5945-492d-847f-1ac6137c4375 req-4c6741be-d257-4838-9895-97d9dd6cc7a0 service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:40:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ecffb4cc-5945-492d-847f-1ac6137c4375 req-4c6741be-d257-4838-9895-97d9dd6cc7a0 service nova] Releasing lock "refresh_cache-dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:40:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Acquired lock "refresh_cache-dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:40:04 user nova-compute[72820]: DEBUG nova.network.neutron [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:40:04 user nova-compute[72820]: DEBUG nova.network.neutron [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.network.neutron [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Updating instance_info_cache with network_info: [{"id": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "address": "fa:16:3e:a3:f9:24", "network": {"id": "f4a9038d-1157-4fde-86e7-fb932a428e31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1722086374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce56ca2340b84b4785f0f8132f15296b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba5dbcd-5f", "ovs_interfaceid": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Releasing lock "refresh_cache-dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.compute.manager [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Instance network_info: |[{"id": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "address": "fa:16:3e:a3:f9:24", "network": {"id": "f4a9038d-1157-4fde-86e7-fb932a428e31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1722086374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce56ca2340b84b4785f0f8132f15296b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba5dbcd-5f", "ovs_interfaceid": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Start _get_guest_xml network_info=[{"id": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "address": "fa:16:3e:a3:f9:24", "network": {"id": "f4a9038d-1157-4fde-86e7-fb932a428e31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1722086374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce56ca2340b84b4785f0f8132f15296b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba5dbcd-5f", "ovs_interfaceid": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:40:05 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:40:05 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1025065636',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1025065636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1025065',id=36,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrRUwD26sBtNnmuf/cpDBlFLiKDz9epWhUxJ88pOSz541DQuZOXokwoK6I0IjbIizk/Pl9LdFWTgmlM3wxyLHxYKc/wMMx+S3pOKlSf3QB/mGV4A7nBHZJt1/iqHSSqYQ==',key_name='tempest-keypair-1499900525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce56ca2340b84b4785f0f8132f15296b',ramdisk_id='',reservation_id='r-656hfzov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1778950119',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:40:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33e98854926f4e1580b450ad5debdce3',uuid=dc94e6fe-575e-44a1-bf2c-a471abcbbfe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "address": "fa:16:3e:a3:f9:24", "network": {"id": "f4a9038d-1157-4fde-86e7-fb932a428e31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1722086374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce56ca2340b84b4785f0f8132f15296b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba5dbcd-5f", "ovs_interfaceid": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Converting VIF {"id": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "address": "fa:16:3e:a3:f9:24", "network": {"id": "f4a9038d-1157-4fde-86e7-fb932a428e31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1722086374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce56ca2340b84b4785f0f8132f15296b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba5dbcd-5f", "ovs_interfaceid": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:f9:24,bridge_name='br-int',has_traffic_filtering=True,id=8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a,network=Network(f4a9038d-1157-4fde-86e7-fb932a428e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba5dbcd-5f') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.objects.instance [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lazy-loading 'pci_devices' on Instance uuid dc94e6fe-575e-44a1-bf2c-a471abcbbfe7 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:40:05 user nova-compute[72820]:   <uuid>dc94e6fe-575e-44a1-bf2c-a471abcbbfe7</uuid>
Aug 27 02:40:05 user nova-compute[72820]:   <name>instance-00000024</name>
Aug 27 02:40:05 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:40:05 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:40:05 user nova-compute[72820]:   <metadata>
Aug 27 02:40:05 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:40:05 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:40:05 user nova-compute[72820]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1025065636</nova:name>
Aug 27 02:40:05 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:40:05</nova:creationTime>
Aug 27 02:40:05 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:40:05 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:40:05 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:40:05 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:40:05 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:40:05 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:40:05 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:40:05 user nova-compute[72820]:       <nova:owner>
Aug 27 02:40:05 user nova-compute[72820]:         <nova:user uuid="33e98854926f4e1580b450ad5debdce3">tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member</nova:user>
Aug 27 02:40:05 user nova-compute[72820]:         <nova:project uuid="ce56ca2340b84b4785f0f8132f15296b">tempest-TestServerVolumeAttachScenarioOldVersion-1778950119</nova:project>
Aug 27 02:40:05 user nova-compute[72820]:       </nova:owner>
Aug 27 02:40:05 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:40:05 user nova-compute[72820]:       <nova:ports>
Aug 27 02:40:05 user nova-compute[72820]:         <nova:port uuid="8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a">
Aug 27 02:40:05 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 02:40:05 user nova-compute[72820]:         </nova:port>
Aug 27 02:40:05 user nova-compute[72820]:       </nova:ports>
Aug 27 02:40:05 user nova-compute[72820]:     </nova:instance>
Aug 27 02:40:05 user nova-compute[72820]:   </metadata>
Aug 27 02:40:05 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:40:05 user nova-compute[72820]:     <system>
Aug 27 02:40:05 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:40:05 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:40:05 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:40:05 user nova-compute[72820]:       <entry name="serial">dc94e6fe-575e-44a1-bf2c-a471abcbbfe7</entry>
Aug 27 02:40:05 user nova-compute[72820]:       <entry name="uuid">dc94e6fe-575e-44a1-bf2c-a471abcbbfe7</entry>
Aug 27 02:40:05 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:40:05 user nova-compute[72820]:     </system>
Aug 27 02:40:05 user nova-compute[72820]:   </sysinfo>
Aug 27 02:40:05 user nova-compute[72820]:   <os>
Aug 27 02:40:05 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:40:05 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:40:05 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:40:05 user nova-compute[72820]:   </os>
Aug 27 02:40:05 user nova-compute[72820]:   <features>
Aug 27 02:40:05 user nova-compute[72820]:     <acpi/>
Aug 27 02:40:05 user nova-compute[72820]:     <apic/>
Aug 27 02:40:05 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:40:05 user nova-compute[72820]:   </features>
Aug 27 02:40:05 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:40:05 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:40:05 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:40:05 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:40:05 user nova-compute[72820]:   </clock>
Aug 27 02:40:05 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:40:05 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:40:05 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:40:05 user nova-compute[72820]:   </cpu>
Aug 27 02:40:05 user nova-compute[72820]:   <devices>
Aug 27 02:40:05 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:40:05 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:40:05 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk"/>
Aug 27 02:40:05 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:40:05 user nova-compute[72820]:     </disk>
Aug 27 02:40:05 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:40:05 user nova-compute[72820]:       <mac address="fa:16:3e:a3:f9:24"/>
Aug 27 02:40:05 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:40:05 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:40:05 user nova-compute[72820]:       <target dev="tap8ba5dbcd-5f"/>
Aug 27 02:40:05 user nova-compute[72820]:     </interface>
Aug 27 02:40:05 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:40:05 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/console.log" append="off"/>
Aug 27 02:40:05 user nova-compute[72820]:     </serial>
Aug 27 02:40:05 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:40:05 user nova-compute[72820]:     <video>
Aug 27 02:40:05 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:40:05 user nova-compute[72820]:     </video>
Aug 27 02:40:05 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:40:05 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:40:05 user nova-compute[72820]:     </rng>
Aug 27 02:40:05 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:40:05 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:40:05 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:40:05 user nova-compute[72820]:     </memballoon>
Aug 27 02:40:05 user nova-compute[72820]:   </devices>
Aug 27 02:40:05 user nova-compute[72820]: </domain>
Aug 27 02:40:05 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1025065636',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1025065636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1025065',id=36,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrRUwD26sBtNnmuf/cpDBlFLiKDz9epWhUxJ88pOSz541DQuZOXokwoK6I0IjbIizk/Pl9LdFWTgmlM3wxyLHxYKc/wMMx+S3pOKlSf3QB/mGV4A7nBHZJt1/iqHSSqYQ==',key_name='tempest-keypair-1499900525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce56ca2340b84b4785f0f8132f15296b',ramdisk_id='',reservation_id='r-656hfzov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1778950119',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:40:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33e98854926f4e1580b450ad5debdce3',uuid=dc94e6fe-575e-44a1-bf2c-a471abcbbfe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "address": "fa:16:3e:a3:f9:24", "network": {"id": "f4a9038d-1157-4fde-86e7-fb932a428e31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1722086374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce56ca2340b84b4785f0f8132f15296b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba5dbcd-5f", "ovs_interfaceid": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Converting VIF {"id": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "address": "fa:16:3e:a3:f9:24", "network": {"id": "f4a9038d-1157-4fde-86e7-fb932a428e31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1722086374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce56ca2340b84b4785f0f8132f15296b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba5dbcd-5f", "ovs_interfaceid": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:f9:24,bridge_name='br-int',has_traffic_filtering=True,id=8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a,network=Network(f4a9038d-1157-4fde-86e7-fb932a428e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba5dbcd-5f') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG os_vif [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:f9:24,bridge_name='br-int',has_traffic_filtering=True,id=8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a,network=Network(f4a9038d-1157-4fde-86e7-fb932a428e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba5dbcd-5f') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ba5dbcd-5f, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ba5dbcd-5f, col_values=(('external_ids', {'iface-id': '8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:f9:24', 'vm-uuid': 'dc94e6fe-575e-44a1-bf2c-a471abcbbfe7'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:05 user nova-compute[72820]: INFO os_vif [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:f9:24,bridge_name='br-int',has_traffic_filtering=True,id=8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a,network=Network(f4a9038d-1157-4fde-86e7-fb932a428e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba5dbcd-5f')
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:40:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] No VIF found with MAC fa:16:3e:a3:f9:24, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:40:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-def57c2a-6392-4921-b1d5-1a13d5b9465b req-2bab31ff-137c-46dd-928c-2ef1683a1358 service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Received event network-vif-plugged-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:40:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-def57c2a-6392-4921-b1d5-1a13d5b9465b req-2bab31ff-137c-46dd-928c-2ef1683a1358 service nova] Acquiring lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-def57c2a-6392-4921-b1d5-1a13d5b9465b req-2bab31ff-137c-46dd-928c-2ef1683a1358 service nova] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-def57c2a-6392-4921-b1d5-1a13d5b9465b req-2bab31ff-137c-46dd-928c-2ef1683a1358 service nova] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-def57c2a-6392-4921-b1d5-1a13d5b9465b req-2bab31ff-137c-46dd-928c-2ef1683a1358 service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] No waiting events found dispatching network-vif-plugged-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:40:07 user nova-compute[72820]: WARNING nova.compute.manager [req-def57c2a-6392-4921-b1d5-1a13d5b9465b req-2bab31ff-137c-46dd-928c-2ef1683a1358 service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Received unexpected event network-vif-plugged-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a for instance with vm_state building and task_state spawning.
Aug 27 02:40:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-e0e5353b-d698-4a9e-844d-c79dfc3e6f49 req-1d4fcbc8-3c2c-413b-8074-e0ea9270cda9 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received event network-changed-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:40:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-e0e5353b-d698-4a9e-844d-c79dfc3e6f49 req-1d4fcbc8-3c2c-413b-8074-e0ea9270cda9 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Refreshing instance network info cache due to event network-changed-44b914a9-6a23-44dc-9711-dd33dfdd276b. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:40:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e0e5353b-d698-4a9e-844d-c79dfc3e6f49 req-1d4fcbc8-3c2c-413b-8074-e0ea9270cda9 service nova] Acquiring lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:40:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e0e5353b-d698-4a9e-844d-c79dfc3e6f49 req-1d4fcbc8-3c2c-413b-8074-e0ea9270cda9 service nova] Acquired lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:40:07 user nova-compute[72820]: DEBUG nova.network.neutron [req-e0e5353b-d698-4a9e-844d-c79dfc3e6f49 req-1d4fcbc8-3c2c-413b-8074-e0ea9270cda9 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Refreshing network info cache for port 44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:40:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:08 user nova-compute[72820]: DEBUG nova.network.neutron [req-e0e5353b-d698-4a9e-844d-c79dfc3e6f49 req-1d4fcbc8-3c2c-413b-8074-e0ea9270cda9 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Updated VIF entry in instance network info cache for port 44b914a9-6a23-44dc-9711-dd33dfdd276b. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:40:08 user nova-compute[72820]: DEBUG nova.network.neutron [req-e0e5353b-d698-4a9e-844d-c79dfc3e6f49 req-1d4fcbc8-3c2c-413b-8074-e0ea9270cda9 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Updating instance_info_cache with network_info: [{"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:40:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e0e5353b-d698-4a9e-844d-c79dfc3e6f49 req-1d4fcbc8-3c2c-413b-8074-e0ea9270cda9 service nova] Releasing lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:40:09 user nova-compute[72820]: DEBUG nova.compute.manager [req-1af1a0d1-8ed2-4b8d-a06d-53771c21a2dd req-b7e83b3a-5ec6-4871-a435-56f75d853276 service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Received event network-vif-plugged-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:40:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1af1a0d1-8ed2-4b8d-a06d-53771c21a2dd req-b7e83b3a-5ec6-4871-a435-56f75d853276 service nova] Acquiring lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1af1a0d1-8ed2-4b8d-a06d-53771c21a2dd req-b7e83b3a-5ec6-4871-a435-56f75d853276 service nova] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1af1a0d1-8ed2-4b8d-a06d-53771c21a2dd req-b7e83b3a-5ec6-4871-a435-56f75d853276 service nova] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:09 user nova-compute[72820]: DEBUG nova.compute.manager [req-1af1a0d1-8ed2-4b8d-a06d-53771c21a2dd req-b7e83b3a-5ec6-4871-a435-56f75d853276 service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] No waiting events found dispatching network-vif-plugged-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:40:09 user nova-compute[72820]: WARNING nova.compute.manager [req-1af1a0d1-8ed2-4b8d-a06d-53771c21a2dd req-b7e83b3a-5ec6-4871-a435-56f75d853276 service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Received unexpected event network-vif-plugged-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a for instance with vm_state building and task_state spawning.
Aug 27 02:40:09 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104009.1552618, dc94e6fe-575e-44a1-bf2c-a471abcbbfe7 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:40:09 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] VM Resumed (Lifecycle Event)
Aug 27 02:40:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:40:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:40:09 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Instance spawned successfully.
Aug 27 02:40:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:40:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:40:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:40:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:40:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:40:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:40:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:40:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:40:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:40:09 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:40:09 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104009.1566978, dc94e6fe-575e-44a1-bf2c-a471abcbbfe7 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:40:09 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] VM Started (Lifecycle Event)
Aug 27 02:40:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:40:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:40:09 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:40:09 user nova-compute[72820]: INFO nova.compute.manager [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Took 6.55 seconds to spawn the instance on the hypervisor.
Aug 27 02:40:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:40:09 user nova-compute[72820]: INFO nova.compute.manager [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Took 7.44 seconds to build instance.
Aug 27 02:40:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-223fe5aa-2a40-4e15-8fef-8a52ca7f0cb1 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.534s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:13 user nova-compute[72820]: INFO nova.compute.manager [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Shelving
Aug 27 02:40:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-1e9ac8ff-77b2-4ebc-bc66-9334089f7859 req-12b17e5a-3525-4bb5-9f8d-a665070ed599 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received event network-vif-unplugged-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:40:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1e9ac8ff-77b2-4ebc-bc66-9334089f7859 req-12b17e5a-3525-4bb5-9f8d-a665070ed599 service nova] Acquiring lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1e9ac8ff-77b2-4ebc-bc66-9334089f7859 req-12b17e5a-3525-4bb5-9f8d-a665070ed599 service nova] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1e9ac8ff-77b2-4ebc-bc66-9334089f7859 req-12b17e5a-3525-4bb5-9f8d-a665070ed599 service nova] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-1e9ac8ff-77b2-4ebc-bc66-9334089f7859 req-12b17e5a-3525-4bb5-9f8d-a665070ed599 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] No waiting events found dispatching network-vif-unplugged-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:40:13 user nova-compute[72820]: WARNING nova.compute.manager [req-1e9ac8ff-77b2-4ebc-bc66-9334089f7859 req-12b17e5a-3525-4bb5-9f8d-a665070ed599 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received unexpected event network-vif-unplugged-44b914a9-6a23-44dc-9711-dd33dfdd276b for instance with vm_state active and task_state shelving.
Aug 27 02:40:14 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:40:14 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Instance destroyed successfully.
Aug 27 02:40:14 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Beginning cold snapshot process
Aug 27 02:40:14 user nova-compute[72820]: DEBUG nova.privsep.utils [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 02:40:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk /opt/stack/data/nova/instances/snapshots/tmp770phwuo/fa57f0237f8349579aa97c414e59ee46 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk /opt/stack/data/nova/instances/snapshots/tmp770phwuo/fa57f0237f8349579aa97c414e59ee46" returned: 0 in 0.757s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:15 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Snapshot extracted, beginning image upload
Aug 27 02:40:15 user nova-compute[72820]: DEBUG nova.compute.manager [req-600f1728-c952-4a6a-b717-910a99c0ce69 req-bba33953-1a40-4902-b19f-c408ce24226f service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received event network-vif-plugged-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:40:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-600f1728-c952-4a6a-b717-910a99c0ce69 req-bba33953-1a40-4902-b19f-c408ce24226f service nova] Acquiring lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-600f1728-c952-4a6a-b717-910a99c0ce69 req-bba33953-1a40-4902-b19f-c408ce24226f service nova] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-600f1728-c952-4a6a-b717-910a99c0ce69 req-bba33953-1a40-4902-b19f-c408ce24226f service nova] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:15 user nova-compute[72820]: DEBUG nova.compute.manager [req-600f1728-c952-4a6a-b717-910a99c0ce69 req-bba33953-1a40-4902-b19f-c408ce24226f service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] No waiting events found dispatching network-vif-plugged-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:40:15 user nova-compute[72820]: WARNING nova.compute.manager [req-600f1728-c952-4a6a-b717-910a99c0ce69 req-bba33953-1a40-4902-b19f-c408ce24226f service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received unexpected event network-vif-plugged-44b914a9-6a23-44dc-9711-dd33dfdd276b for instance with vm_state active and task_state shelving_image_uploading.
Aug 27 02:40:16 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:40:17 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:40:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:17 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Snapshot image upload complete
Aug 27 02:40:17 user nova-compute[72820]: DEBUG nova.compute.manager [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:40:17 user nova-compute[72820]: INFO nova.compute.manager [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Shelve offloading
Aug 27 02:40:18 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Instance destroyed successfully.
Aug 27 02:40:18 user nova-compute[72820]: DEBUG nova.compute.manager [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:40:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:40:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquired lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:40:18 user nova-compute[72820]: DEBUG nova.network.neutron [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:40:18 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:40:18 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:40:19 user nova-compute[72820]: DEBUG nova.network.neutron [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Updating instance_info_cache with network_info: [{"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:40:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Releasing lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:40:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:19 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Instance destroyed successfully.
Aug 27 02:40:19 user nova-compute[72820]: DEBUG nova.objects.instance [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'resources' on Instance uuid 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:40:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1380869967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1380869967',id=32,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOciKBBC8NJ35hgRq02smcI4uF6t4M94gsu+a5kRirwGvo1EOVp24o42AMRihJmcVfkkv/PMoLN/H5Rsi/oO2DWABm120N26knoQDRfWSEMs7kV0T76++jbrlQxgFhe0QQ==',key_name='tempest-keypair-956790269',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:38:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5387e67178b141ae94025b9fd61f0124',ramdisk_id='',reservation_id='r-3mee6amo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1913674887',owner_user_name='tempest-AttachVolumeShelveTestJSON-1913674887-project-member',shelved_at='2023-08-27T02:40:17.920470',shelved_host='user',shelved_image_id='11fc2251-c794-4e4b-bab5-bb5e04c35909'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:40:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6dbf37c8dec47aebcdc9c93ad1f3d69',uuid=7726f4c9-697d-49ac-a2ee-ed42f81d8c64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:40:19 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converting VIF {"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:40:19 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:49:83,bridge_name='br-int',has_traffic_filtering=True,id=44b914a9-6a23-44dc-9711-dd33dfdd276b,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b914a9-6a') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:40:19 user nova-compute[72820]: DEBUG os_vif [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:49:83,bridge_name='br-int',has_traffic_filtering=True,id=44b914a9-6a23-44dc-9711-dd33dfdd276b,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b914a9-6a') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:40:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44b914a9-6a, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:40:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:19 user nova-compute[72820]: DEBUG nova.compute.manager [req-086af9c1-2849-429f-ad9c-0ef1f2dc5163 req-e12bc125-b99e-4c1e-a91f-6a1adcca02e1 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received event network-changed-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:40:19 user nova-compute[72820]: DEBUG nova.compute.manager [req-086af9c1-2849-429f-ad9c-0ef1f2dc5163 req-e12bc125-b99e-4c1e-a91f-6a1adcca02e1 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Refreshing instance network info cache due to event network-changed-44b914a9-6a23-44dc-9711-dd33dfdd276b. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:40:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-086af9c1-2849-429f-ad9c-0ef1f2dc5163 req-e12bc125-b99e-4c1e-a91f-6a1adcca02e1 service nova] Acquiring lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:40:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-086af9c1-2849-429f-ad9c-0ef1f2dc5163 req-e12bc125-b99e-4c1e-a91f-6a1adcca02e1 service nova] Acquired lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:40:19 user nova-compute[72820]: DEBUG nova.network.neutron [req-086af9c1-2849-429f-ad9c-0ef1f2dc5163 req-e12bc125-b99e-4c1e-a91f-6a1adcca02e1 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Refreshing network info cache for port 44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:40:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:40:19 user nova-compute[72820]: INFO os_vif [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:49:83,bridge_name='br-int',has_traffic_filtering=True,id=44b914a9-6a23-44dc-9711-dd33dfdd276b,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b914a9-6a')
Aug 27 02:40:19 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Deleting instance files /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64_del
Aug 27 02:40:19 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Deletion of /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64_del complete
Aug 27 02:40:20 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Deleted allocations for instance 7726f4c9-697d-49ac-a2ee-ed42f81d8c64
Aug 27 02:40:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:20 user nova-compute[72820]: DEBUG nova.objects.instance [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'numa_topology' on Instance uuid 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:40:20 user nova-compute[72820]: DEBUG nova.objects.base [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Object Instance<7726f4c9-697d-49ac-a2ee-ed42f81d8c64> lazy-loaded attributes: resources,numa_topology {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:40:20 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:40:20 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:40:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:20 user nova-compute[72820]: DEBUG nova.network.neutron [req-086af9c1-2849-429f-ad9c-0ef1f2dc5163 req-e12bc125-b99e-4c1e-a91f-6a1adcca02e1 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Updated VIF entry in instance network info cache for port 44b914a9-6a23-44dc-9711-dd33dfdd276b. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:40:20 user nova-compute[72820]: DEBUG nova.network.neutron [req-086af9c1-2849-429f-ad9c-0ef1f2dc5163 req-e12bc125-b99e-4c1e-a91f-6a1adcca02e1 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Updating instance_info_cache with network_info: [{"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap44b914a9-6a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:40:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-086af9c1-2849-429f-ad9c-0ef1f2dc5163 req-e12bc125-b99e-4c1e-a91f-6a1adcca02e1 service nova] Releasing lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:40:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9d7d1157-0b62-46a1-813a-a5cd4d4b2bc9 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.962s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:21 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:40:22 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:40:22 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:40:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:23 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:40:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:23 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:40:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:40:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:40:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:40:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:25 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:40:25 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:40:25 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7509MB free_disk=24.99454116821289GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:40:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:25 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:40:25 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1591319d-3d15-4c46-b823-4edddf018b5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:40:25 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 15a1062a-ecfb-42b7-b8e5-03adbd6b8056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:40:25 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:40:25 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance b1a0ba95-2678-493d-87ba-061abf80887a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:40:25 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 8678adad-a0a3-4ba3-84f3-81984a457130 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:40:25 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 96b0b198-aadc-44cb-a54e-9cc1a08226dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:40:25 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance dc94e6fe-575e-44a1-bf2c-a471abcbbfe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:40:25 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:40:25 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:40:26 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:40:26 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:40:26 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:40:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:27 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:40:27 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:40:27 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:40:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-15a1062a-ecfb-42b7-b8e5-03adbd6b8056" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:40:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-15a1062a-ecfb-42b7-b8e5-03adbd6b8056" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:40:27 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:40:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:27 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Updating instance_info_cache with network_info: [{"id": "91420809-21b7-4f29-8db7-389b1fd06f7b", "address": "fa:16:3e:13:aa:0b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91420809-21", "ovs_interfaceid": "91420809-21b7-4f29-8db7-389b1fd06f7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:40:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-15a1062a-ecfb-42b7-b8e5-03adbd6b8056" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:40:27 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:40:29 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104014.4651008, 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:40:29 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] VM Stopped (Lifecycle Event)
Aug 27 02:40:29 user nova-compute[72820]: DEBUG nova.compute.manager [None req-77e4ae23-7c9e-4661-bc43-6b8c2b4a159a None None] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:40:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquiring lock "bd14a452-bae0-49a4-a111-24b725fd8d86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "bd14a452-bae0-49a4-a111-24b725fd8d86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:32 user nova-compute[72820]: DEBUG nova.compute.manager [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:40:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:32 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:40:32 user nova-compute[72820]: INFO nova.compute.claims [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Claim successful on node user
Aug 27 02:40:33 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG nova.network.neutron [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:40:33 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:40:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG nova.policy [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '314d3a67dbd24abb848225eaeaa33da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0977a141ee1145b3a94c5cd60571d3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:40:33 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Creating image(s)
Aug 27 02:40:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd14a452-bae0-49a4-a111-24b725fd8d86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "/opt/stack/data/nova/instances/bd14a452-bae0-49a4-a111-24b725fd8d86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "/opt/stack/data/nova/instances/bd14a452-bae0-49a4-a111-24b725fd8d86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.194s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.180s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/bd14a452-bae0-49a4-a111-24b725fd8d86/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/bd14a452-bae0-49a4-a111-24b725fd8d86/disk 1073741824" returned: 0 in 0.052s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG nova.network.neutron [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Successfully created port: 91befba3-1374-4dde-9aa9-e05a690062fd {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.188s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd14a452-bae0-49a4-a111-24b725fd8d86/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd14a452-bae0-49a4-a111-24b725fd8d86/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd14a452-bae0-49a4-a111-24b725fd8d86/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Cannot resize image /opt/stack/data/nova/instances/bd14a452-bae0-49a4-a111-24b725fd8d86/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Ensure instance console log exists: /opt/stack/data/nova/instances/bd14a452-bae0-49a4-a111-24b725fd8d86/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG nova.network.neutron [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Successfully updated port: 91befba3-1374-4dde-9aa9-e05a690062fd {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquiring lock "refresh_cache-bd14a452-bae0-49a4-a111-24b725fd8d86" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquired lock "refresh_cache-bd14a452-bae0-49a4-a111-24b725fd8d86" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG nova.network.neutron [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-adf128dd-384f-4cd6-b4b8-9e1af98b2933 req-bb479a43-7264-4e65-beb9-7ce55f9638b7 service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Received event network-changed-91befba3-1374-4dde-9aa9-e05a690062fd {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-adf128dd-384f-4cd6-b4b8-9e1af98b2933 req-bb479a43-7264-4e65-beb9-7ce55f9638b7 service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Refreshing instance network info cache due to event network-changed-91befba3-1374-4dde-9aa9-e05a690062fd. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:40:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-adf128dd-384f-4cd6-b4b8-9e1af98b2933 req-bb479a43-7264-4e65-beb9-7ce55f9638b7 service nova] Acquiring lock "refresh_cache-bd14a452-bae0-49a4-a111-24b725fd8d86" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.network.neutron [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.network.neutron [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Updating instance_info_cache with network_info: [{"id": "91befba3-1374-4dde-9aa9-e05a690062fd", "address": "fa:16:3e:cd:b0:d4", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befba3-13", "ovs_interfaceid": "91befba3-1374-4dde-9aa9-e05a690062fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Releasing lock "refresh_cache-bd14a452-bae0-49a4-a111-24b725fd8d86" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.compute.manager [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Instance network_info: |[{"id": "91befba3-1374-4dde-9aa9-e05a690062fd", "address": "fa:16:3e:cd:b0:d4", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befba3-13", "ovs_interfaceid": "91befba3-1374-4dde-9aa9-e05a690062fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-adf128dd-384f-4cd6-b4b8-9e1af98b2933 req-bb479a43-7264-4e65-beb9-7ce55f9638b7 service nova] Acquired lock "refresh_cache-bd14a452-bae0-49a4-a111-24b725fd8d86" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.network.neutron [req-adf128dd-384f-4cd6-b4b8-9e1af98b2933 req-bb479a43-7264-4e65-beb9-7ce55f9638b7 service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Refreshing network info cache for port 91befba3-1374-4dde-9aa9-e05a690062fd {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Start _get_guest_xml network_info=[{"id": "91befba3-1374-4dde-9aa9-e05a690062fd", "address": "fa:16:3e:cd:b0:d4", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befba3-13", "ovs_interfaceid": "91befba3-1374-4dde-9aa9-e05a690062fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:40:35 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:40:35 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1191778356',display_name='tempest-ServersNegativeTestJSON-server-1191778356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1191778356',id=37,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0977a141ee1145b3a94c5cd60571d3d2',ramdisk_id='',reservation_id='r-3rak3qo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1999174782',owner_user_name='tempest-ServersNegativeTestJSON-1999174782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:40:33Z,user_data=None,user_id='314d3a67dbd24abb848225eaeaa33da6',uuid=bd14a452-bae0-49a4-a111-24b725fd8d86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91befba3-1374-4dde-9aa9-e05a690062fd", "address": "fa:16:3e:cd:b0:d4", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befba3-13", "ovs_interfaceid": "91befba3-1374-4dde-9aa9-e05a690062fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Converting VIF {"id": "91befba3-1374-4dde-9aa9-e05a690062fd", "address": "fa:16:3e:cd:b0:d4", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befba3-13", "ovs_interfaceid": "91befba3-1374-4dde-9aa9-e05a690062fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b0:d4,bridge_name='br-int',has_traffic_filtering=True,id=91befba3-1374-4dde-9aa9-e05a690062fd,network=Network(5f1eaafc-a7ec-4d9d-b853-a4930adeb587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91befba3-13') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.objects.instance [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lazy-loading 'pci_devices' on Instance uuid bd14a452-bae0-49a4-a111-24b725fd8d86 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:40:35 user nova-compute[72820]:   <uuid>bd14a452-bae0-49a4-a111-24b725fd8d86</uuid>
Aug 27 02:40:35 user nova-compute[72820]:   <name>instance-00000025</name>
Aug 27 02:40:35 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:40:35 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:40:35 user nova-compute[72820]:   <metadata>
Aug 27 02:40:35 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:40:35 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:40:35 user nova-compute[72820]:       <nova:name>tempest-ServersNegativeTestJSON-server-1191778356</nova:name>
Aug 27 02:40:35 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:40:35</nova:creationTime>
Aug 27 02:40:35 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:40:35 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:40:35 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:40:35 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:40:35 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:40:35 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:40:35 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:40:35 user nova-compute[72820]:       <nova:owner>
Aug 27 02:40:35 user nova-compute[72820]:         <nova:user uuid="314d3a67dbd24abb848225eaeaa33da6">tempest-ServersNegativeTestJSON-1999174782-project-member</nova:user>
Aug 27 02:40:35 user nova-compute[72820]:         <nova:project uuid="0977a141ee1145b3a94c5cd60571d3d2">tempest-ServersNegativeTestJSON-1999174782</nova:project>
Aug 27 02:40:35 user nova-compute[72820]:       </nova:owner>
Aug 27 02:40:35 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:40:35 user nova-compute[72820]:       <nova:ports>
Aug 27 02:40:35 user nova-compute[72820]:         <nova:port uuid="91befba3-1374-4dde-9aa9-e05a690062fd">
Aug 27 02:40:35 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 02:40:35 user nova-compute[72820]:         </nova:port>
Aug 27 02:40:35 user nova-compute[72820]:       </nova:ports>
Aug 27 02:40:35 user nova-compute[72820]:     </nova:instance>
Aug 27 02:40:35 user nova-compute[72820]:   </metadata>
Aug 27 02:40:35 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:40:35 user nova-compute[72820]:     <system>
Aug 27 02:40:35 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:40:35 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:40:35 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:40:35 user nova-compute[72820]:       <entry name="serial">bd14a452-bae0-49a4-a111-24b725fd8d86</entry>
Aug 27 02:40:35 user nova-compute[72820]:       <entry name="uuid">bd14a452-bae0-49a4-a111-24b725fd8d86</entry>
Aug 27 02:40:35 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:40:35 user nova-compute[72820]:     </system>
Aug 27 02:40:35 user nova-compute[72820]:   </sysinfo>
Aug 27 02:40:35 user nova-compute[72820]:   <os>
Aug 27 02:40:35 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:40:35 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:40:35 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:40:35 user nova-compute[72820]:   </os>
Aug 27 02:40:35 user nova-compute[72820]:   <features>
Aug 27 02:40:35 user nova-compute[72820]:     <acpi/>
Aug 27 02:40:35 user nova-compute[72820]:     <apic/>
Aug 27 02:40:35 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:40:35 user nova-compute[72820]:   </features>
Aug 27 02:40:35 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:40:35 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:40:35 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:40:35 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:40:35 user nova-compute[72820]:   </clock>
Aug 27 02:40:35 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:40:35 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:40:35 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:40:35 user nova-compute[72820]:   </cpu>
Aug 27 02:40:35 user nova-compute[72820]:   <devices>
Aug 27 02:40:35 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:40:35 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:40:35 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/bd14a452-bae0-49a4-a111-24b725fd8d86/disk"/>
Aug 27 02:40:35 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:40:35 user nova-compute[72820]:     </disk>
Aug 27 02:40:35 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:40:35 user nova-compute[72820]:       <mac address="fa:16:3e:cd:b0:d4"/>
Aug 27 02:40:35 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:40:35 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:40:35 user nova-compute[72820]:       <target dev="tap91befba3-13"/>
Aug 27 02:40:35 user nova-compute[72820]:     </interface>
Aug 27 02:40:35 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:40:35 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/bd14a452-bae0-49a4-a111-24b725fd8d86/console.log" append="off"/>
Aug 27 02:40:35 user nova-compute[72820]:     </serial>
Aug 27 02:40:35 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:40:35 user nova-compute[72820]:     <video>
Aug 27 02:40:35 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:40:35 user nova-compute[72820]:     </video>
Aug 27 02:40:35 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:40:35 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:40:35 user nova-compute[72820]:     </rng>
Aug 27 02:40:35 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:40:35 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:40:35 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:40:35 user nova-compute[72820]:     </memballoon>
Aug 27 02:40:35 user nova-compute[72820]:   </devices>
Aug 27 02:40:35 user nova-compute[72820]: </domain>
Aug 27 02:40:35 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1191778356',display_name='tempest-ServersNegativeTestJSON-server-1191778356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1191778356',id=37,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0977a141ee1145b3a94c5cd60571d3d2',ramdisk_id='',reservation_id='r-3rak3qo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1999174782',owner_user_name='tempest-ServersNegativeTestJSON-1999174782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:40:33Z,user_data=None,user_id='314d3a67dbd24abb848225eaeaa33da6',uuid=bd14a452-bae0-49a4-a111-24b725fd8d86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91befba3-1374-4dde-9aa9-e05a690062fd", "address": "fa:16:3e:cd:b0:d4", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befba3-13", "ovs_interfaceid": "91befba3-1374-4dde-9aa9-e05a690062fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Converting VIF {"id": "91befba3-1374-4dde-9aa9-e05a690062fd", "address": "fa:16:3e:cd:b0:d4", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befba3-13", "ovs_interfaceid": "91befba3-1374-4dde-9aa9-e05a690062fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b0:d4,bridge_name='br-int',has_traffic_filtering=True,id=91befba3-1374-4dde-9aa9-e05a690062fd,network=Network(5f1eaafc-a7ec-4d9d-b853-a4930adeb587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91befba3-13') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG os_vif [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b0:d4,bridge_name='br-int',has_traffic_filtering=True,id=91befba3-1374-4dde-9aa9-e05a690062fd,network=Network(5f1eaafc-a7ec-4d9d-b853-a4930adeb587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91befba3-13') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91befba3-13, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91befba3-13, col_values=(('external_ids', {'iface-id': '91befba3-1374-4dde-9aa9-e05a690062fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:b0:d4', 'vm-uuid': 'bd14a452-bae0-49a4-a111-24b725fd8d86'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:35 user nova-compute[72820]: INFO os_vif [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b0:d4,bridge_name='br-int',has_traffic_filtering=True,id=91befba3-1374-4dde-9aa9-e05a690062fd,network=Network(5f1eaafc-a7ec-4d9d-b853-a4930adeb587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91befba3-13')
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] No VIF found with MAC fa:16:3e:cd:b0:d4, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.network.neutron [req-adf128dd-384f-4cd6-b4b8-9e1af98b2933 req-bb479a43-7264-4e65-beb9-7ce55f9638b7 service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Updated VIF entry in instance network info cache for port 91befba3-1374-4dde-9aa9-e05a690062fd. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG nova.network.neutron [req-adf128dd-384f-4cd6-b4b8-9e1af98b2933 req-bb479a43-7264-4e65-beb9-7ce55f9638b7 service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Updating instance_info_cache with network_info: [{"id": "91befba3-1374-4dde-9aa9-e05a690062fd", "address": "fa:16:3e:cd:b0:d4", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befba3-13", "ovs_interfaceid": "91befba3-1374-4dde-9aa9-e05a690062fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:40:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-adf128dd-384f-4cd6-b4b8-9e1af98b2933 req-bb479a43-7264-4e65-beb9-7ce55f9638b7 service nova] Releasing lock "refresh_cache-bd14a452-bae0-49a4-a111-24b725fd8d86" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:40:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-e93d8f21-249a-4d08-9524-567be016bfd2 req-200bb68c-50b4-42ab-9d04-d0de1402ebc5 service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Received event network-vif-plugged-91befba3-1374-4dde-9aa9-e05a690062fd {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:40:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e93d8f21-249a-4d08-9524-567be016bfd2 req-200bb68c-50b4-42ab-9d04-d0de1402ebc5 service nova] Acquiring lock "bd14a452-bae0-49a4-a111-24b725fd8d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e93d8f21-249a-4d08-9524-567be016bfd2 req-200bb68c-50b4-42ab-9d04-d0de1402ebc5 service nova] Lock "bd14a452-bae0-49a4-a111-24b725fd8d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e93d8f21-249a-4d08-9524-567be016bfd2 req-200bb68c-50b4-42ab-9d04-d0de1402ebc5 service nova] Lock "bd14a452-bae0-49a4-a111-24b725fd8d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:37 user nova-compute[72820]: DEBUG nova.compute.manager [req-e93d8f21-249a-4d08-9524-567be016bfd2 req-200bb68c-50b4-42ab-9d04-d0de1402ebc5 service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] No waiting events found dispatching network-vif-plugged-91befba3-1374-4dde-9aa9-e05a690062fd {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:40:37 user nova-compute[72820]: WARNING nova.compute.manager [req-e93d8f21-249a-4d08-9524-567be016bfd2 req-200bb68c-50b4-42ab-9d04-d0de1402ebc5 service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Received unexpected event network-vif-plugged-91befba3-1374-4dde-9aa9-e05a690062fd for instance with vm_state building and task_state spawning.
Aug 27 02:40:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:38 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104038.965502, bd14a452-bae0-49a4-a111-24b725fd8d86 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:40:38 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] VM Resumed (Lifecycle Event)
Aug 27 02:40:38 user nova-compute[72820]: DEBUG nova.compute.manager [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:40:38 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:40:38 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Instance spawned successfully.
Aug 27 02:40:38 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:40:38 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:40:38 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:40:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:40:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:40:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:40:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:40:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:40:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:40:39 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:40:39 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104038.9702723, bd14a452-bae0-49a4-a111-24b725fd8d86 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:40:39 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] VM Started (Lifecycle Event)
Aug 27 02:40:39 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:40:39 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:40:39 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:40:39 user nova-compute[72820]: INFO nova.compute.manager [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Took 5.68 seconds to spawn the instance on the hypervisor.
Aug 27 02:40:39 user nova-compute[72820]: DEBUG nova.compute.manager [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:40:39 user nova-compute[72820]: INFO nova.compute.manager [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Took 6.50 seconds to build instance.
Aug 27 02:40:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-341faf66-0cfe-4d4b-bcd0-0ac741153a8e tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "bd14a452-bae0-49a4-a111-24b725fd8d86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.610s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-82b1ed51-217a-4193-b22f-ed8d95f0dc0a req-8e773155-58bd-49c9-9ca3-c2566c897cb5 service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Received event network-vif-plugged-91befba3-1374-4dde-9aa9-e05a690062fd {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:40:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-82b1ed51-217a-4193-b22f-ed8d95f0dc0a req-8e773155-58bd-49c9-9ca3-c2566c897cb5 service nova] Acquiring lock "bd14a452-bae0-49a4-a111-24b725fd8d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-82b1ed51-217a-4193-b22f-ed8d95f0dc0a req-8e773155-58bd-49c9-9ca3-c2566c897cb5 service nova] Lock "bd14a452-bae0-49a4-a111-24b725fd8d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-82b1ed51-217a-4193-b22f-ed8d95f0dc0a req-8e773155-58bd-49c9-9ca3-c2566c897cb5 service nova] Lock "bd14a452-bae0-49a4-a111-24b725fd8d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-82b1ed51-217a-4193-b22f-ed8d95f0dc0a req-8e773155-58bd-49c9-9ca3-c2566c897cb5 service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] No waiting events found dispatching network-vif-plugged-91befba3-1374-4dde-9aa9-e05a690062fd {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:40:39 user nova-compute[72820]: WARNING nova.compute.manager [req-82b1ed51-217a-4193-b22f-ed8d95f0dc0a req-8e773155-58bd-49c9-9ca3-c2566c897cb5 service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Received unexpected event network-vif-plugged-91befba3-1374-4dde-9aa9-e05a690062fd for instance with vm_state active and task_state None.
Aug 27 02:40:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:57 user nova-compute[72820]: INFO nova.compute.manager [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Terminating instance
Aug 27 02:40:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-ff9f75b4-5f86-418d-84d2-195c17b12b82 req-5f5bb4e2-46fa-4004-b179-d59593688592 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received event network-vif-unplugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ff9f75b4-5f86-418d-84d2-195c17b12b82 req-5f5bb4e2-46fa-4004-b179-d59593688592 service nova] Acquiring lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ff9f75b4-5f86-418d-84d2-195c17b12b82 req-5f5bb4e2-46fa-4004-b179-d59593688592 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ff9f75b4-5f86-418d-84d2-195c17b12b82 req-5f5bb4e2-46fa-4004-b179-d59593688592 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-ff9f75b4-5f86-418d-84d2-195c17b12b82 req-5f5bb4e2-46fa-4004-b179-d59593688592 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] No waiting events found dispatching network-vif-unplugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-ff9f75b4-5f86-418d-84d2-195c17b12b82 req-5f5bb4e2-46fa-4004-b179-d59593688592 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received event network-vif-unplugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquiring lock "8678adad-a0a3-4ba3-84f3-81984a457130" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "8678adad-a0a3-4ba3-84f3-81984a457130" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquiring lock "8678adad-a0a3-4ba3-84f3-81984a457130-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "8678adad-a0a3-4ba3-84f3-81984a457130-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "8678adad-a0a3-4ba3-84f3-81984a457130-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:58 user nova-compute[72820]: INFO nova.compute.manager [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Terminating instance
Aug 27 02:40:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:40:58 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Instance destroyed successfully.
Aug 27 02:40:58 user nova-compute[72820]: DEBUG nova.objects.instance [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'resources' on Instance uuid 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1580800830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1580800830',id=29,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:37:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f023daf1767f4088bf0a23524587e662',ramdisk_id='',reservation_id='r-y9v8i9bg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:39:12Z,user_data=None,user_id='bb67e11ecdd648a89dd58b4bf416060a',uuid=53ce05c7-91a9-46f5-b4de-3c2c43642ef3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "address": "fa:16:3e:41:f5:3b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6fbe4-05", "ovs_interfaceid": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converting VIF {"id": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "address": "fa:16:3e:41:f5:3b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6fbe4-05", "ovs_interfaceid": "4aa6fbe4-05de-4a07-929c-868b2f949f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:f5:3b,bridge_name='br-int',has_traffic_filtering=True,id=4aa6fbe4-05de-4a07-929c-868b2f949f09,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa6fbe4-05') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG os_vif [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:f5:3b,bridge_name='br-int',has_traffic_filtering=True,id=4aa6fbe4-05de-4a07-929c-868b2f949f09,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa6fbe4-05') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4aa6fbe4-05, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:58 user nova-compute[72820]: INFO os_vif [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:f5:3b,bridge_name='br-int',has_traffic_filtering=True,id=4aa6fbe4-05de-4a07-929c-868b2f949f09,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa6fbe4-05')
Aug 27 02:40:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RZjWPiSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:40:58 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:40:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b90d6d4-10f3-4a66-84a7-cc73ff50ed0a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:40:58 user nova-compute[72820]: No targets found.
Aug 27 02:40:58 user nova-compute[72820]: iSNS:
Aug 27 02:40:58 user nova-compute[72820]: No targets found.
Aug 27 02:40:58 user nova-compute[72820]: STATIC:
Aug 27 02:40:58 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:40:58 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:40:58 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:40:58 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb
Aug 27 02:40:58 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:40:58 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:40:58 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b
Aug 27 02:40:58 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:40:58 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:40:58 user nova-compute[72820]: FIRMWARE:
Aug 27 02:40:58 user nova-compute[72820]: No targets found.
Aug 27 02:40:58 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:40:58 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:40:58 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[05381cb8-685c-40d4-9c5e-de8f944c0c5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb7d6e2-94f1-4059-9202-c16983655d59]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:40:58 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:40:58 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:40:58 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:40:58 user nova-compute[72820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb (non-flash)
Aug 27 02:40:58 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:40:58 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a038b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb'): ({'sdd'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Removing single pathed devices sdd {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de71300-a3f3-45cb-97ab-1cccc417cec2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:40:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb9902a-8f8b-436d-b46a-32f62d44a7b5]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Flushing IO for device /dev/sdd {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2815c851-f63b-4625-adfa-b50954206444]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f751c1e7-b7ee-4e55-8630-29f7ad5d4a7a]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6226142-f710-426b-88e2-7bf924c63c43]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e4ce3b-d643-4e1f-afbe-e0623c3e00b9]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb, portal: 172.16.0.220,3260]
Aug 27 02:40:59 user nova-compute[72820]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb, portal: 172.16.0.220,3260] successful.
Aug 27 02:40:59 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67aebe6b-380b-426e-9490-a280e9f2e1eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f68f2e9-cfda-4194-851d-bf9c7feed89a]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] <== disconnect_volume: return (381ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:40:59 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Deleting instance files /opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3_del
Aug 27 02:40:59 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Deletion of /opt/stack/data/nova/instances/53ce05c7-91a9-46f5-b4de-3c2c43642ef3_del complete
Aug 27 02:40:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-bde7fbcb-650d-417d-9a6f-85ad008bf0a8 req-e825154e-78ea-4711-bcc7-a949671af341 service nova] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Received event network-vif-unplugged-178dec21-430b-4f69-b98f-0e91ae08525c {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bde7fbcb-650d-417d-9a6f-85ad008bf0a8 req-e825154e-78ea-4711-bcc7-a949671af341 service nova] Acquiring lock "8678adad-a0a3-4ba3-84f3-81984a457130-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bde7fbcb-650d-417d-9a6f-85ad008bf0a8 req-e825154e-78ea-4711-bcc7-a949671af341 service nova] Lock "8678adad-a0a3-4ba3-84f3-81984a457130-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bde7fbcb-650d-417d-9a6f-85ad008bf0a8 req-e825154e-78ea-4711-bcc7-a949671af341 service nova] Lock "8678adad-a0a3-4ba3-84f3-81984a457130-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-bde7fbcb-650d-417d-9a6f-85ad008bf0a8 req-e825154e-78ea-4711-bcc7-a949671af341 service nova] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] No waiting events found dispatching network-vif-unplugged-178dec21-430b-4f69-b98f-0e91ae08525c {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-bde7fbcb-650d-417d-9a6f-85ad008bf0a8 req-e825154e-78ea-4711-bcc7-a949671af341 service nova] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Received event network-vif-unplugged-178dec21-430b-4f69-b98f-0e91ae08525c for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:40:59 user nova-compute[72820]: INFO nova.compute.manager [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:40:59 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Instance destroyed successfully.
Aug 27 02:40:59 user nova-compute[72820]: DEBUG nova.objects.instance [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lazy-loading 'resources' on Instance uuid 8678adad-a0a3-4ba3-84f3-81984a457130 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-17584111',display_name='tempest-VolumesActionsTest-instance-17584111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-17584111',id=34,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:39:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4bc4037270664e758e9411acbfe2d3a3',ramdisk_id='',reservation_id='r-5qac00re',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1595890573',owner_user_name='tempest-VolumesActionsTest-1595890573-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:39:17Z,user_data=None,user_id='5607a2e69fce42b7af26a8c3afdb3589',uuid=8678adad-a0a3-4ba3-84f3-81984a457130,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "178dec21-430b-4f69-b98f-0e91ae08525c", "address": "fa:16:3e:9f:6e:e0", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178dec21-43", "ovs_interfaceid": "178dec21-430b-4f69-b98f-0e91ae08525c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Converting VIF {"id": "178dec21-430b-4f69-b98f-0e91ae08525c", "address": "fa:16:3e:9f:6e:e0", "network": {"id": "ae065ae6-bfe7-4b57-81fc-8cd4df52cec9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265397365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bc4037270664e758e9411acbfe2d3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178dec21-43", "ovs_interfaceid": "178dec21-430b-4f69-b98f-0e91ae08525c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6e:e0,bridge_name='br-int',has_traffic_filtering=True,id=178dec21-430b-4f69-b98f-0e91ae08525c,network=Network(ae065ae6-bfe7-4b57-81fc-8cd4df52cec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178dec21-43') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG os_vif [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6e:e0,bridge_name='br-int',has_traffic_filtering=True,id=178dec21-430b-4f69-b98f-0e91ae08525c,network=Network(ae065ae6-bfe7-4b57-81fc-8cd4df52cec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178dec21-43') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap178dec21-43, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:40:59 user nova-compute[72820]: INFO os_vif [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6e:e0,bridge_name='br-int',has_traffic_filtering=True,id=178dec21-430b-4f69-b98f-0e91ae08525c,network=Network(ae065ae6-bfe7-4b57-81fc-8cd4df52cec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178dec21-43')
Aug 27 02:40:59 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Deleting instance files /opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130_del
Aug 27 02:40:59 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Deletion of /opt/stack/data/nova/instances/8678adad-a0a3-4ba3-84f3-81984a457130_del complete
Aug 27 02:40:59 user nova-compute[72820]: INFO nova.compute.manager [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 27 02:40:59 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:40:59 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:41:00 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:41:00 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Took 0.72 seconds to deallocate network for instance.
Aug 27 02:41:00 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:41:00 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Took 0.69 seconds to deallocate network for instance.
Aug 27 02:41:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-a78621a8-7c2b-48f8-af31-51d2c475addb req-1a2f6a08-d443-44f3-873c-98d49aea1c26 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received event network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:41:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a78621a8-7c2b-48f8-af31-51d2c475addb req-1a2f6a08-d443-44f3-873c-98d49aea1c26 service nova] Acquiring lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a78621a8-7c2b-48f8-af31-51d2c475addb req-1a2f6a08-d443-44f3-873c-98d49aea1c26 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a78621a8-7c2b-48f8-af31-51d2c475addb req-1a2f6a08-d443-44f3-873c-98d49aea1c26 service nova] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-a78621a8-7c2b-48f8-af31-51d2c475addb req-1a2f6a08-d443-44f3-873c-98d49aea1c26 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] No waiting events found dispatching network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:41:00 user nova-compute[72820]: WARNING nova.compute.manager [req-a78621a8-7c2b-48f8-af31-51d2c475addb req-1a2f6a08-d443-44f3-873c-98d49aea1c26 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received unexpected event network-vif-plugged-4aa6fbe4-05de-4a07-929c-868b2f949f09 for instance with vm_state active and task_state deleting.
Aug 27 02:41:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-a78621a8-7c2b-48f8-af31-51d2c475addb req-1a2f6a08-d443-44f3-873c-98d49aea1c26 service nova] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Received event network-vif-deleted-4aa6fbe4-05de-4a07-929c-868b2f949f09 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:41:00 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:41:00 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:41:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:00 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Deleted allocations for instance 8678adad-a0a3-4ba3-84f3-81984a457130
Aug 27 02:41:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c5a61ed8-5ca1-44d3-8bc1-883f0d1edc0c tempest-VolumesActionsTest-1595890573 tempest-VolumesActionsTest-1595890573-project-member] Lock "8678adad-a0a3-4ba3-84f3-81984a457130" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.163s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:00 user nova-compute[72820]: INFO nova.compute.manager [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Took 0.95 seconds to detach 1 volumes for instance.
Aug 27 02:41:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-1b633fd6-8eb1-4085-988a-8c44ace32e04 req-b3e6667e-8532-46c6-a828-a0c4c639f403 service nova] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Received event network-vif-plugged-178dec21-430b-4f69-b98f-0e91ae08525c {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:41:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1b633fd6-8eb1-4085-988a-8c44ace32e04 req-b3e6667e-8532-46c6-a828-a0c4c639f403 service nova] Acquiring lock "8678adad-a0a3-4ba3-84f3-81984a457130-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1b633fd6-8eb1-4085-988a-8c44ace32e04 req-b3e6667e-8532-46c6-a828-a0c4c639f403 service nova] Lock "8678adad-a0a3-4ba3-84f3-81984a457130-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1b633fd6-8eb1-4085-988a-8c44ace32e04 req-b3e6667e-8532-46c6-a828-a0c4c639f403 service nova] Lock "8678adad-a0a3-4ba3-84f3-81984a457130-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-1b633fd6-8eb1-4085-988a-8c44ace32e04 req-b3e6667e-8532-46c6-a828-a0c4c639f403 service nova] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] No waiting events found dispatching network-vif-plugged-178dec21-430b-4f69-b98f-0e91ae08525c {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:41:01 user nova-compute[72820]: WARNING nova.compute.manager [req-1b633fd6-8eb1-4085-988a-8c44ace32e04 req-b3e6667e-8532-46c6-a828-a0c4c639f403 service nova] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Received unexpected event network-vif-plugged-178dec21-430b-4f69-b98f-0e91ae08525c for instance with vm_state deleted and task_state None.
Aug 27 02:41:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-1b633fd6-8eb1-4085-988a-8c44ace32e04 req-b3e6667e-8532-46c6-a828-a0c4c639f403 service nova] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Received event network-vif-deleted-178dec21-430b-4f69-b98f-0e91ae08525c {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:41:01 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:41:01 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:41:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:01 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Deleted allocations for instance 53ce05c7-91a9-46f5-b4de-3c2c43642ef3
Aug 27 02:41:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-a2764684-4132-4c67-b9b4-5f8c95bdd792 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "53ce05c7-91a9-46f5-b4de-3c2c43642ef3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.580s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Acquiring lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:41:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:07 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:41:07 user nova-compute[72820]: INFO nova.compute.claims [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Claim successful on node user
Aug 27 02:41:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:07 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:41:07 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:41:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:41:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:41:07 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:41:07 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:41:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:41:07 user nova-compute[72820]: DEBUG nova.policy [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '983d52ab60604e21a675cca739977e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad16025d31445e4bc439e5e9b1bc1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:41:08 user nova-compute[72820]: INFO nova.virt.block_device [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Booting with volume 69166b6a-56d7-4e8d-9c76-c633f5035aab at /dev/vda
Aug 27 02:41:08 user nova-compute[72820]: DEBUG os_brick.utils [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc88f61-89c2-497f-b109-04b491f8f606]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ad3444-d33c-4b0a-a183-3bf996878c7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad2bc47-10a2-4fa1-941e-8c49c8c85b3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2518649-bba4-4e0f-af95-f31557b081fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:41:08 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:41:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[60da00c5-6471-4dac-a83e-2f2ca36e7c4e]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG os_brick.utils [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Updating existing volume attachment record: 093f6553-83ad-4e2c-931d-09a49048a034 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:41:08 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Successfully created port: 04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:41:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:10 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Successfully updated port: 04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:41:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Acquiring lock "refresh_cache-937e1fae-4b49-494b-b37b-2ff4cdc8a82b" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:41:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Acquired lock "refresh_cache-937e1fae-4b49-494b-b37b-2ff4cdc8a82b" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:41:10 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:41:10 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:41:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-ad90b7b8-a52b-4b0b-89b3-cb0cc359bf91 req-f6ec1ee5-21fb-4467-81bf-22a32a8be768 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received event network-changed-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:41:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-ad90b7b8-a52b-4b0b-89b3-cb0cc359bf91 req-f6ec1ee5-21fb-4467-81bf-22a32a8be768 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Refreshing instance network info cache due to event network-changed-04e6a150-9c11-4112-9d82-23e360ad145e. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:41:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ad90b7b8-a52b-4b0b-89b3-cb0cc359bf91 req-f6ec1ee5-21fb-4467-81bf-22a32a8be768 service nova] Acquiring lock "refresh_cache-937e1fae-4b49-494b-b37b-2ff4cdc8a82b" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:41:10 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Updating instance_info_cache with network_info: [{"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:41:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Releasing lock "refresh_cache-937e1fae-4b49-494b-b37b-2ff4cdc8a82b" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:41:10 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Instance network_info: |[{"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:41:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ad90b7b8-a52b-4b0b-89b3-cb0cc359bf91 req-f6ec1ee5-21fb-4467-81bf-22a32a8be768 service nova] Acquired lock "refresh_cache-937e1fae-4b49-494b-b37b-2ff4cdc8a82b" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:41:10 user nova-compute[72820]: DEBUG nova.network.neutron [req-ad90b7b8-a52b-4b0b-89b3-cb0cc359bf91 req-f6ec1ee5-21fb-4467-81bf-22a32a8be768 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Refreshing network info cache for port 04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:41:10 user nova-compute[72820]: DEBUG nova.network.neutron [req-ad90b7b8-a52b-4b0b-89b3-cb0cc359bf91 req-f6ec1ee5-21fb-4467-81bf-22a32a8be768 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Updated VIF entry in instance network info cache for port 04e6a150-9c11-4112-9d82-23e360ad145e. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:41:10 user nova-compute[72820]: DEBUG nova.network.neutron [req-ad90b7b8-a52b-4b0b-89b3-cb0cc359bf91 req-f6ec1ee5-21fb-4467-81bf-22a32a8be768 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Updating instance_info_cache with network_info: [{"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:41:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ad90b7b8-a52b-4b0b-89b3-cb0cc359bf91 req-f6ec1ee5-21fb-4467-81bf-22a32a8be768 service nova] Releasing lock "refresh_cache-937e1fae-4b49-494b-b37b-2ff4cdc8a82b" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:41:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-f029506e-061d-4ada-8762-59fb36eeb68e req-ccedaaf6-629f-44dd-90f2-315c7e0ccc79 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Received event network-changed-9c663cbb-4c46-4618-b58e-318aa323a440 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:41:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-f029506e-061d-4ada-8762-59fb36eeb68e req-ccedaaf6-629f-44dd-90f2-315c7e0ccc79 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Refreshing instance network info cache due to event network-changed-9c663cbb-4c46-4618-b58e-318aa323a440. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:41:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f029506e-061d-4ada-8762-59fb36eeb68e req-ccedaaf6-629f-44dd-90f2-315c7e0ccc79 service nova] Acquiring lock "refresh_cache-96b0b198-aadc-44cb-a54e-9cc1a08226dc" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:41:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f029506e-061d-4ada-8762-59fb36eeb68e req-ccedaaf6-629f-44dd-90f2-315c7e0ccc79 service nova] Acquired lock "refresh_cache-96b0b198-aadc-44cb-a54e-9cc1a08226dc" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:41:13 user nova-compute[72820]: DEBUG nova.network.neutron [req-f029506e-061d-4ada-8762-59fb36eeb68e req-ccedaaf6-629f-44dd-90f2-315c7e0ccc79 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Refreshing network info cache for port 9c663cbb-4c46-4618-b58e-318aa323a440 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:41:13 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104058.7501523, 53ce05c7-91a9-46f5-b4de-3c2c43642ef3 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:41:13 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] VM Stopped (Lifecycle Event)
Aug 27 02:41:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-dd4035b3-3d4f-45f9-a869-fd220c2e54a7 None None] [instance: 53ce05c7-91a9-46f5-b4de-3c2c43642ef3] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:41:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:14 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:41:14 user nova-compute[72820]: DEBUG nova.network.neutron [req-f029506e-061d-4ada-8762-59fb36eeb68e req-ccedaaf6-629f-44dd-90f2-315c7e0ccc79 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Updated VIF entry in instance network info cache for port 9c663cbb-4c46-4618-b58e-318aa323a440. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:41:14 user nova-compute[72820]: DEBUG nova.network.neutron [req-f029506e-061d-4ada-8762-59fb36eeb68e req-ccedaaf6-629f-44dd-90f2-315c7e0ccc79 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Updating instance_info_cache with network_info: [{"id": "9c663cbb-4c46-4618-b58e-318aa323a440", "address": "fa:16:3e:fb:46:b1", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c663cbb-4c", "ovs_interfaceid": "9c663cbb-4c46-4618-b58e-318aa323a440", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:41:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f029506e-061d-4ada-8762-59fb36eeb68e req-ccedaaf6-629f-44dd-90f2-315c7e0ccc79 service nova] Releasing lock "refresh_cache-96b0b198-aadc-44cb-a54e-9cc1a08226dc" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:41:14 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104059.348401, 8678adad-a0a3-4ba3-84f3-81984a457130 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:41:14 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] VM Stopped (Lifecycle Event)
Aug 27 02:41:14 user nova-compute[72820]: DEBUG nova.compute.manager [None req-15d78e13-ff3b-4dec-b765-7faaf8cf46f1 None None] [instance: 8678adad-a0a3-4ba3-84f3-81984a457130] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:41:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:17 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:41:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:18 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:41:19 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:41:19 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:41:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Acquiring lock "c5729613-2d22-4d9a-9751-e09dca84e0d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:19 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:41:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:19 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:41:19 user nova-compute[72820]: INFO nova.compute.claims [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Claim successful on node user
Aug 27 02:41:20 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:41:20 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:41:20 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG nova.policy [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fe498907edd433e94c14ba72df75355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac51df4fd73435c81b9f3037a5916c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:41:20 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Creating image(s)
Aug 27 02:41:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "/opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "/opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.174s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.202s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk 1073741824" returned: 0 in 0.054s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.188s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:21 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:41:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:21 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Successfully created port: 29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:41:21 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:21 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Cannot resize image /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:41:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:41:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Ensure instance console log exists: /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:41:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Successfully updated port: 29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Acquiring lock "refresh_cache-c5729613-2d22-4d9a-9751-e09dca84e0d6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Acquired lock "refresh_cache-c5729613-2d22-4d9a-9751-e09dca84e0d6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-90cc44a1-526a-4403-a25d-12b2a1a2262a req-a57ac30d-d540-4987-b263-1db2eb206dd3 service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Received event network-changed-29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-90cc44a1-526a-4403-a25d-12b2a1a2262a req-a57ac30d-d540-4987-b263-1db2eb206dd3 service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Refreshing instance network info cache due to event network-changed-29272dca-3ab8-4b49-8d58-a85d831942ef. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-90cc44a1-526a-4403-a25d-12b2a1a2262a req-a57ac30d-d540-4987-b263-1db2eb206dd3 service nova] Acquiring lock "refresh_cache-c5729613-2d22-4d9a-9751-e09dca84e0d6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.network.neutron [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Updating instance_info_cache with network_info: [{"id": "29272dca-3ab8-4b49-8d58-a85d831942ef", "address": "fa:16:3e:f1:32:45", "network": {"id": "a99debd2-2312-4c82-b0d1-d36eab74a9fb", "bridge": "br-int", "label": "tempest-TestStampPattern-1906437798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aac51df4fd73435c81b9f3037a5916c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29272dca-3a", "ovs_interfaceid": "29272dca-3ab8-4b49-8d58-a85d831942ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Releasing lock "refresh_cache-c5729613-2d22-4d9a-9751-e09dca84e0d6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Instance network_info: |[{"id": "29272dca-3ab8-4b49-8d58-a85d831942ef", "address": "fa:16:3e:f1:32:45", "network": {"id": "a99debd2-2312-4c82-b0d1-d36eab74a9fb", "bridge": "br-int", "label": "tempest-TestStampPattern-1906437798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aac51df4fd73435c81b9f3037a5916c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29272dca-3a", "ovs_interfaceid": "29272dca-3ab8-4b49-8d58-a85d831942ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-90cc44a1-526a-4403-a25d-12b2a1a2262a req-a57ac30d-d540-4987-b263-1db2eb206dd3 service nova] Acquired lock "refresh_cache-c5729613-2d22-4d9a-9751-e09dca84e0d6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.network.neutron [req-90cc44a1-526a-4403-a25d-12b2a1a2262a req-a57ac30d-d540-4987-b263-1db2eb206dd3 service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Refreshing network info cache for port 29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Start _get_guest_xml network_info=[{"id": "29272dca-3ab8-4b49-8d58-a85d831942ef", "address": "fa:16:3e:f1:32:45", "network": {"id": "a99debd2-2312-4c82-b0d1-d36eab74a9fb", "bridge": "br-int", "label": "tempest-TestStampPattern-1906437798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aac51df4fd73435c81b9f3037a5916c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29272dca-3a", "ovs_interfaceid": "29272dca-3ab8-4b49-8d58-a85d831942ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:41:22 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:41:22 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:41:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-563403657',display_name='tempest-TestStampPattern-server-563403657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-563403657',id=39,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0zAooyDHQson0E1c4ecvBYhqHsyNSYXv+t0kCdFnzDUG79nvffpMOO2DrZiwLXLyTH3dY7sHVB3U/W4MnPjR/+jLh1QwwlMVYzj0HLb4YOqzk9KyCId+Pu8REZHe3AJQ==',key_name='tempest-TestStampPattern-792127925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aac51df4fd73435c81b9f3037a5916c6',ramdisk_id='',reservation_id='r-62bagmtu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-31454635',owner_user_name='tempest-TestStampPattern-31454635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:41:20Z,user_data=None,user_id='8fe498907edd433e94c14ba72df75355',uuid=c5729613-2d22-4d9a-9751-e09dca84e0d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29272dca-3ab8-4b49-8d58-a85d831942ef", "address": "fa:16:3e:f1:32:45", "network": {"id": "a99debd2-2312-4c82-b0d1-d36eab74a9fb", "bridge": "br-int", "label": "tempest-TestStampPattern-1906437798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aac51df4fd73435c81b9f3037a5916c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29272dca-3a", "ovs_interfaceid": "29272dca-3ab8-4b49-8d58-a85d831942ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Converting VIF {"id": "29272dca-3ab8-4b49-8d58-a85d831942ef", "address": "fa:16:3e:f1:32:45", "network": {"id": "a99debd2-2312-4c82-b0d1-d36eab74a9fb", "bridge": "br-int", "label": "tempest-TestStampPattern-1906437798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aac51df4fd73435c81b9f3037a5916c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29272dca-3a", "ovs_interfaceid": "29272dca-3ab8-4b49-8d58-a85d831942ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:32:45,bridge_name='br-int',has_traffic_filtering=True,id=29272dca-3ab8-4b49-8d58-a85d831942ef,network=Network(a99debd2-2312-4c82-b0d1-d36eab74a9fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29272dca-3a') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.objects.instance [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lazy-loading 'pci_devices' on Instance uuid c5729613-2d22-4d9a-9751-e09dca84e0d6 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:41:22 user nova-compute[72820]:   <uuid>c5729613-2d22-4d9a-9751-e09dca84e0d6</uuid>
Aug 27 02:41:22 user nova-compute[72820]:   <name>instance-00000027</name>
Aug 27 02:41:22 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:41:22 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:41:22 user nova-compute[72820]:   <metadata>
Aug 27 02:41:22 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:41:22 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:41:22 user nova-compute[72820]:       <nova:name>tempest-TestStampPattern-server-563403657</nova:name>
Aug 27 02:41:22 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:41:22</nova:creationTime>
Aug 27 02:41:22 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:41:22 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:41:22 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:41:22 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:41:22 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:41:22 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:41:22 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:41:22 user nova-compute[72820]:       <nova:owner>
Aug 27 02:41:22 user nova-compute[72820]:         <nova:user uuid="8fe498907edd433e94c14ba72df75355">tempest-TestStampPattern-31454635-project-member</nova:user>
Aug 27 02:41:22 user nova-compute[72820]:         <nova:project uuid="aac51df4fd73435c81b9f3037a5916c6">tempest-TestStampPattern-31454635</nova:project>
Aug 27 02:41:22 user nova-compute[72820]:       </nova:owner>
Aug 27 02:41:22 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:41:22 user nova-compute[72820]:       <nova:ports>
Aug 27 02:41:22 user nova-compute[72820]:         <nova:port uuid="29272dca-3ab8-4b49-8d58-a85d831942ef">
Aug 27 02:41:22 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 02:41:22 user nova-compute[72820]:         </nova:port>
Aug 27 02:41:22 user nova-compute[72820]:       </nova:ports>
Aug 27 02:41:22 user nova-compute[72820]:     </nova:instance>
Aug 27 02:41:22 user nova-compute[72820]:   </metadata>
Aug 27 02:41:22 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:41:22 user nova-compute[72820]:     <system>
Aug 27 02:41:22 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:41:22 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:41:22 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:41:22 user nova-compute[72820]:       <entry name="serial">c5729613-2d22-4d9a-9751-e09dca84e0d6</entry>
Aug 27 02:41:22 user nova-compute[72820]:       <entry name="uuid">c5729613-2d22-4d9a-9751-e09dca84e0d6</entry>
Aug 27 02:41:22 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:41:22 user nova-compute[72820]:     </system>
Aug 27 02:41:22 user nova-compute[72820]:   </sysinfo>
Aug 27 02:41:22 user nova-compute[72820]:   <os>
Aug 27 02:41:22 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:41:22 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:41:22 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:41:22 user nova-compute[72820]:   </os>
Aug 27 02:41:22 user nova-compute[72820]:   <features>
Aug 27 02:41:22 user nova-compute[72820]:     <acpi/>
Aug 27 02:41:22 user nova-compute[72820]:     <apic/>
Aug 27 02:41:22 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:41:22 user nova-compute[72820]:   </features>
Aug 27 02:41:22 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:41:22 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:41:22 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:41:22 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:41:22 user nova-compute[72820]:   </clock>
Aug 27 02:41:22 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:41:22 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:41:22 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:41:22 user nova-compute[72820]:   </cpu>
Aug 27 02:41:22 user nova-compute[72820]:   <devices>
Aug 27 02:41:22 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:41:22 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:41:22 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk"/>
Aug 27 02:41:22 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:41:22 user nova-compute[72820]:     </disk>
Aug 27 02:41:22 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:41:22 user nova-compute[72820]:       <mac address="fa:16:3e:f1:32:45"/>
Aug 27 02:41:22 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:41:22 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:41:22 user nova-compute[72820]:       <target dev="tap29272dca-3a"/>
Aug 27 02:41:22 user nova-compute[72820]:     </interface>
Aug 27 02:41:22 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:41:22 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/console.log" append="off"/>
Aug 27 02:41:22 user nova-compute[72820]:     </serial>
Aug 27 02:41:22 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:41:22 user nova-compute[72820]:     <video>
Aug 27 02:41:22 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:41:22 user nova-compute[72820]:     </video>
Aug 27 02:41:22 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:41:22 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:41:22 user nova-compute[72820]:     </rng>
Aug 27 02:41:22 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:41:22 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:41:22 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:41:22 user nova-compute[72820]:     </memballoon>
Aug 27 02:41:22 user nova-compute[72820]:   </devices>
Aug 27 02:41:22 user nova-compute[72820]: </domain>
Aug 27 02:41:22 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:41:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-563403657',display_name='tempest-TestStampPattern-server-563403657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-563403657',id=39,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0zAooyDHQson0E1c4ecvBYhqHsyNSYXv+t0kCdFnzDUG79nvffpMOO2DrZiwLXLyTH3dY7sHVB3U/W4MnPjR/+jLh1QwwlMVYzj0HLb4YOqzk9KyCId+Pu8REZHe3AJQ==',key_name='tempest-TestStampPattern-792127925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aac51df4fd73435c81b9f3037a5916c6',ramdisk_id='',reservation_id='r-62bagmtu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-31454635',owner_user_name='tempest-TestStampPattern-31454635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:41:20Z,user_data=None,user_id='8fe498907edd433e94c14ba72df75355',uuid=c5729613-2d22-4d9a-9751-e09dca84e0d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29272dca-3ab8-4b49-8d58-a85d831942ef", "address": "fa:16:3e:f1:32:45", "network": {"id": "a99debd2-2312-4c82-b0d1-d36eab74a9fb", "bridge": "br-int", "label": "tempest-TestStampPattern-1906437798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aac51df4fd73435c81b9f3037a5916c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29272dca-3a", "ovs_interfaceid": "29272dca-3ab8-4b49-8d58-a85d831942ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Converting VIF {"id": "29272dca-3ab8-4b49-8d58-a85d831942ef", "address": "fa:16:3e:f1:32:45", "network": {"id": "a99debd2-2312-4c82-b0d1-d36eab74a9fb", "bridge": "br-int", "label": "tempest-TestStampPattern-1906437798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aac51df4fd73435c81b9f3037a5916c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29272dca-3a", "ovs_interfaceid": "29272dca-3ab8-4b49-8d58-a85d831942ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:32:45,bridge_name='br-int',has_traffic_filtering=True,id=29272dca-3ab8-4b49-8d58-a85d831942ef,network=Network(a99debd2-2312-4c82-b0d1-d36eab74a9fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29272dca-3a') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG os_vif [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:32:45,bridge_name='br-int',has_traffic_filtering=True,id=29272dca-3ab8-4b49-8d58-a85d831942ef,network=Network(a99debd2-2312-4c82-b0d1-d36eab74a9fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29272dca-3a') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29272dca-3a, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29272dca-3a, col_values=(('external_ids', {'iface-id': '29272dca-3ab8-4b49-8d58-a85d831942ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:32:45', 'vm-uuid': 'c5729613-2d22-4d9a-9751-e09dca84e0d6'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:22 user nova-compute[72820]: INFO os_vif [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:32:45,bridge_name='br-int',has_traffic_filtering=True,id=29272dca-3ab8-4b49-8d58-a85d831942ef,network=Network(a99debd2-2312-4c82-b0d1-d36eab74a9fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29272dca-3a')
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] No VIF found with MAC fa:16:3e:f1:32:45, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:41:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.network.neutron [req-90cc44a1-526a-4403-a25d-12b2a1a2262a req-a57ac30d-d540-4987-b263-1db2eb206dd3 service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Updated VIF entry in instance network info cache for port 29272dca-3ab8-4b49-8d58-a85d831942ef. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.network.neutron [req-90cc44a1-526a-4403-a25d-12b2a1a2262a req-a57ac30d-d540-4987-b263-1db2eb206dd3 service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Updating instance_info_cache with network_info: [{"id": "29272dca-3ab8-4b49-8d58-a85d831942ef", "address": "fa:16:3e:f1:32:45", "network": {"id": "a99debd2-2312-4c82-b0d1-d36eab74a9fb", "bridge": "br-int", "label": "tempest-TestStampPattern-1906437798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aac51df4fd73435c81b9f3037a5916c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29272dca-3a", "ovs_interfaceid": "29272dca-3ab8-4b49-8d58-a85d831942ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-90cc44a1-526a-4403-a25d-12b2a1a2262a req-a57ac30d-d540-4987-b263-1db2eb206dd3 service nova] Releasing lock "refresh_cache-c5729613-2d22-4d9a-9751-e09dca84e0d6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:41:23 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Creating image(s)
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Did not create local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Ensure instance console log exists: /opt/stack/data/nova/instances/937e1fae-4b49-494b-b37b-2ff4cdc8a82b/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Start _get_guest_xml network_info=[{"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '093f6553-83ad-4e2c-931d-09a49048a034', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxwLdQIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '937e1fae-4b49-494b-b37b-2ff4cdc8a82b', 'attached_at': '', 'detached_at': '', 'volume_id': '69166b6a-56d7-4e8d-9c76-c633f5035aab', 'serial': '69166b6a-56d7-4e8d-9c76-c633f5035aab'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:41:23 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:41:23 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxwLdQIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:41:23 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:41:23 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:41:23 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dae0def-b7bf-4b26-beee-3f0ac9953b60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:41:23 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[02caf562-493d-4595-a593-524cea68a0c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab] added
Aug 27 02:41:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea20119-148d-4787-a866-d937a5dd4ac1]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d259d88-5f44-4dd3-8e19-87760a0e9745]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zxwLdQIG {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zxwLdQIG" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec2fe2b-fb5a-45c6-9546-32cec2fb81c5]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zxwLdQIG'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde999cb-d649-4643-b70a-cbf7776110e8]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccc602e-4b56-4558-a6ec-d7fab250e062]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:41:23 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:41:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:41:23 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:41:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e038bebd-a80f-45ab-91b3-6c65b5bad941]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab, portal: 172.16.0.220,3260]
Aug 27 02:41:23 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab, portal: 172.16.0.220,3260] successful.
Aug 27 02:41:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a46036d-647f-4bfd-9bb1-7c01c664ca82]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[35149c3b-563f-436a-b4cf-b8bb121279a1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:41:23 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:41:23 user nova-compute[72820]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:41:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:41:23 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:41:23 user nova-compute[72820]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:41:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.039s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6af24cf-1839-4214-99ee-fae1555a2347]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxwLdQIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-1aa66231-5c74-4b6c-9001-8862836a9cd4 req-56ab9276-e975-4874-9331-aeb627a78129 service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Received event network-vif-plugged-29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1aa66231-5c74-4b6c-9001-8862836a9cd4 req-56ab9276-e975-4874-9331-aeb627a78129 service nova] Acquiring lock "c5729613-2d22-4d9a-9751-e09dca84e0d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1aa66231-5c74-4b6c-9001-8862836a9cd4 req-56ab9276-e975-4874-9331-aeb627a78129 service nova] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1aa66231-5c74-4b6c-9001-8862836a9cd4 req-56ab9276-e975-4874-9331-aeb627a78129 service nova] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-1aa66231-5c74-4b6c-9001-8862836a9cd4 req-56ab9276-e975-4874-9331-aeb627a78129 service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] No waiting events found dispatching network-vif-plugged-29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:41:24 user nova-compute[72820]: WARNING nova.compute.manager [req-1aa66231-5c74-4b6c-9001-8862836a9cd4 req-56ab9276-e975-4874-9331-aeb627a78129 service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Received unexpected event network-vif-plugged-29272dca-3ab8-4b49-8d58-a85d831942ef for instance with vm_state building and task_state spawning.
Aug 27 02:41:24 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd14a452-bae0-49a4-a111-24b725fd8d86/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23933363065373434', 'path': '/dev/sdc'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933363065373434', 'path': '/dev/sdc'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd14a452-bae0-49a4-a111-24b725fd8d86/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1719587291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1719587291',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL4xAW1yqP6Coj+hhVCS5IQNbL8oxWGaJMLhXbiMUMXUf8cKxypJ/lvgX61mLhj54rUE2+oPLqoH07Bp4DB/o2rEWFebI2x+kpnvVVRoO/4DZPpY3FT3cyl8sodoL2efw==',key_name='tempest-keypair-158688571',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ad16025d31445e4bc439e5e9b1bc1f0',ramdisk_id='',reservation_id='r-q8lxoffq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1903594173',owner_user_name='tempest-ServerActionsV293TestJSON-1903594173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:41:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='983d52ab60604e21a675cca739977e8c',uuid=937e1fae-4b49-494b-b37b-2ff4cdc8a82b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Converting VIF {"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:66:0b,bridge_name='br-int',has_traffic_filtering=True,id=04e6a150-9c11-4112-9d82-23e360ad145e,network=Network(73446049-4923-430b-a2d6-af3ed8feb088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e6a150-9c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG nova.objects.instance [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lazy-loading 'pci_devices' on Instance uuid 937e1fae-4b49-494b-b37b-2ff4cdc8a82b {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd14a452-bae0-49a4-a111-24b725fd8d86/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:41:24 user nova-compute[72820]:   <uuid>937e1fae-4b49-494b-b37b-2ff4cdc8a82b</uuid>
Aug 27 02:41:24 user nova-compute[72820]:   <name>instance-00000026</name>
Aug 27 02:41:24 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:41:24 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:41:24 user nova-compute[72820]:   <metadata>
Aug 27 02:41:24 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:41:24 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:41:24 user nova-compute[72820]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1719587291</nova:name>
Aug 27 02:41:24 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:41:23</nova:creationTime>
Aug 27 02:41:24 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:41:24 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:41:24 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:41:24 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:41:24 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:41:24 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:41:24 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:41:24 user nova-compute[72820]:       <nova:owner>
Aug 27 02:41:24 user nova-compute[72820]:         <nova:user uuid="983d52ab60604e21a675cca739977e8c">tempest-ServerActionsV293TestJSON-1903594173-project-member</nova:user>
Aug 27 02:41:24 user nova-compute[72820]:         <nova:project uuid="8ad16025d31445e4bc439e5e9b1bc1f0">tempest-ServerActionsV293TestJSON-1903594173</nova:project>
Aug 27 02:41:24 user nova-compute[72820]:       </nova:owner>
Aug 27 02:41:24 user nova-compute[72820]:       <nova:ports>
Aug 27 02:41:24 user nova-compute[72820]:         <nova:port uuid="04e6a150-9c11-4112-9d82-23e360ad145e">
Aug 27 02:41:24 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 02:41:24 user nova-compute[72820]:         </nova:port>
Aug 27 02:41:24 user nova-compute[72820]:       </nova:ports>
Aug 27 02:41:24 user nova-compute[72820]:     </nova:instance>
Aug 27 02:41:24 user nova-compute[72820]:   </metadata>
Aug 27 02:41:24 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:41:24 user nova-compute[72820]:     <system>
Aug 27 02:41:24 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:41:24 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:41:24 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:41:24 user nova-compute[72820]:       <entry name="serial">937e1fae-4b49-494b-b37b-2ff4cdc8a82b</entry>
Aug 27 02:41:24 user nova-compute[72820]:       <entry name="uuid">937e1fae-4b49-494b-b37b-2ff4cdc8a82b</entry>
Aug 27 02:41:24 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:41:24 user nova-compute[72820]:     </system>
Aug 27 02:41:24 user nova-compute[72820]:   </sysinfo>
Aug 27 02:41:24 user nova-compute[72820]:   <os>
Aug 27 02:41:24 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:41:24 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:41:24 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:41:24 user nova-compute[72820]:   </os>
Aug 27 02:41:24 user nova-compute[72820]:   <features>
Aug 27 02:41:24 user nova-compute[72820]:     <acpi/>
Aug 27 02:41:24 user nova-compute[72820]:     <apic/>
Aug 27 02:41:24 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:41:24 user nova-compute[72820]:   </features>
Aug 27 02:41:24 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:41:24 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:41:24 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:41:24 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:41:24 user nova-compute[72820]:   </clock>
Aug 27 02:41:24 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:41:24 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:41:24 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:41:24 user nova-compute[72820]:   </cpu>
Aug 27 02:41:24 user nova-compute[72820]:   <devices>
Aug 27 02:41:24 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:41:24 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:41:24 user nova-compute[72820]:       <source dev="/dev/sdc"/>
Aug 27 02:41:24 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:41:24 user nova-compute[72820]:       <serial>69166b6a-56d7-4e8d-9c76-c633f5035aab</serial>
Aug 27 02:41:24 user nova-compute[72820]:     </disk>
Aug 27 02:41:24 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:41:24 user nova-compute[72820]:       <mac address="fa:16:3e:60:66:0b"/>
Aug 27 02:41:24 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:41:24 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:41:24 user nova-compute[72820]:       <target dev="tap04e6a150-9c"/>
Aug 27 02:41:24 user nova-compute[72820]:     </interface>
Aug 27 02:41:24 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:41:24 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/937e1fae-4b49-494b-b37b-2ff4cdc8a82b/console.log" append="off"/>
Aug 27 02:41:24 user nova-compute[72820]:     </serial>
Aug 27 02:41:24 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:41:24 user nova-compute[72820]:     <video>
Aug 27 02:41:24 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:41:24 user nova-compute[72820]:     </video>
Aug 27 02:41:24 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:41:24 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:41:24 user nova-compute[72820]:     </rng>
Aug 27 02:41:24 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:41:24 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:41:24 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:41:24 user nova-compute[72820]:     </memballoon>
Aug 27 02:41:24 user nova-compute[72820]:   </devices>
Aug 27 02:41:24 user nova-compute[72820]: </domain>
Aug 27 02:41:24 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1719587291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1719587291',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL4xAW1yqP6Coj+hhVCS5IQNbL8oxWGaJMLhXbiMUMXUf8cKxypJ/lvgX61mLhj54rUE2+oPLqoH07Bp4DB/o2rEWFebI2x+kpnvVVRoO/4DZPpY3FT3cyl8sodoL2efw==',key_name='tempest-keypair-158688571',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ad16025d31445e4bc439e5e9b1bc1f0',ramdisk_id='',reservation_id='r-q8lxoffq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1903594173',owner_user_name='tempest-ServerActionsV293TestJSON-1903594173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:41:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='983d52ab60604e21a675cca739977e8c',uuid=937e1fae-4b49-494b-b37b-2ff4cdc8a82b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Converting VIF {"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:66:0b,bridge_name='br-int',has_traffic_filtering=True,id=04e6a150-9c11-4112-9d82-23e360ad145e,network=Network(73446049-4923-430b-a2d6-af3ed8feb088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e6a150-9c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG os_vif [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:66:0b,bridge_name='br-int',has_traffic_filtering=True,id=04e6a150-9c11-4112-9d82-23e360ad145e,network=Network(73446049-4923-430b-a2d6-af3ed8feb088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e6a150-9c') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04e6a150-9c, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04e6a150-9c, col_values=(('external_ids', {'iface-id': '04e6a150-9c11-4112-9d82-23e360ad145e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:66:0b', 'vm-uuid': '937e1fae-4b49-494b-b37b-2ff4cdc8a82b'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:24 user nova-compute[72820]: INFO os_vif [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:66:0b,bridge_name='br-int',has_traffic_filtering=True,id=04e6a150-9c11-4112-9d82-23e360ad145e,network=Network(73446049-4923-430b-a2d6-af3ed8feb088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e6a150-9c')
Aug 27 02:41:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] No VIF found with MAC fa:16:3e:60:66:0b, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:41:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd14a452-bae0-49a4-a111-24b725fd8d86/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:41:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:41:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104086.0859325, c5729613-2d22-4d9a-9751-e09dca84e0d6 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:41:26 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] VM Resumed (Lifecycle Event)
Aug 27 02:41:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:41:26 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Instance spawned successfully.
Aug 27 02:41:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:41:26 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:41:26 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104086.0863352, c5729613-2d22-4d9a-9751-e09dca84e0d6 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:41:26 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] VM Started (Lifecycle Event)
Aug 27 02:41:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG nova.compute.manager [req-b5a3427e-f3d7-444d-b3f5-9fcc39aedeac req-6556af42-f0ce-441d-acbf-db6ee49e3d5d service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Received event network-vif-plugged-29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b5a3427e-f3d7-444d-b3f5-9fcc39aedeac req-6556af42-f0ce-441d-acbf-db6ee49e3d5d service nova] Acquiring lock "c5729613-2d22-4d9a-9751-e09dca84e0d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b5a3427e-f3d7-444d-b3f5-9fcc39aedeac req-6556af42-f0ce-441d-acbf-db6ee49e3d5d service nova] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b5a3427e-f3d7-444d-b3f5-9fcc39aedeac req-6556af42-f0ce-441d-acbf-db6ee49e3d5d service nova] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG nova.compute.manager [req-b5a3427e-f3d7-444d-b3f5-9fcc39aedeac req-6556af42-f0ce-441d-acbf-db6ee49e3d5d service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] No waiting events found dispatching network-vif-plugged-29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:41:26 user nova-compute[72820]: WARNING nova.compute.manager [req-b5a3427e-f3d7-444d-b3f5-9fcc39aedeac req-6556af42-f0ce-441d-acbf-db6ee49e3d5d service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Received unexpected event network-vif-plugged-29272dca-3ab8-4b49-8d58-a85d831942ef for instance with vm_state building and task_state spawning.
Aug 27 02:41:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:41:26 user nova-compute[72820]: INFO nova.compute.manager [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Took 5.75 seconds to spawn the instance on the hypervisor.
Aug 27 02:41:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:41:26 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:41:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:26 user nova-compute[72820]: INFO nova.compute.manager [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Took 6.55 seconds to build instance.
Aug 27 02:41:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c9013851-83e5-4ea4-a201-596252544771 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.649s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104088.3659725, 937e1fae-4b49-494b-b37b-2ff4cdc8a82b => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:41:28 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] VM Resumed (Lifecycle Event)
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.manager [req-65d0c203-f19c-4cfe-acfd-c0d24ae7c1c8 req-17f9e878-a3da-4bde-b5b0-707b8c016e22 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received event network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-65d0c203-f19c-4cfe-acfd-c0d24ae7c1c8 req-17f9e878-a3da-4bde-b5b0-707b8c016e22 service nova] Acquiring lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-65d0c203-f19c-4cfe-acfd-c0d24ae7c1c8 req-17f9e878-a3da-4bde-b5b0-707b8c016e22 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-65d0c203-f19c-4cfe-acfd-c0d24ae7c1c8 req-17f9e878-a3da-4bde-b5b0-707b8c016e22 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.manager [req-65d0c203-f19c-4cfe-acfd-c0d24ae7c1c8 req-17f9e878-a3da-4bde-b5b0-707b8c016e22 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] No waiting events found dispatching network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:41:28 user nova-compute[72820]: WARNING nova.compute.manager [req-65d0c203-f19c-4cfe-acfd-c0d24ae7c1c8 req-17f9e878-a3da-4bde-b5b0-707b8c016e22 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received unexpected event network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e for instance with vm_state building and task_state spawning.
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.manager [req-65d0c203-f19c-4cfe-acfd-c0d24ae7c1c8 req-17f9e878-a3da-4bde-b5b0-707b8c016e22 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received event network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-65d0c203-f19c-4cfe-acfd-c0d24ae7c1c8 req-17f9e878-a3da-4bde-b5b0-707b8c016e22 service nova] Acquiring lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-65d0c203-f19c-4cfe-acfd-c0d24ae7c1c8 req-17f9e878-a3da-4bde-b5b0-707b8c016e22 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-65d0c203-f19c-4cfe-acfd-c0d24ae7c1c8 req-17f9e878-a3da-4bde-b5b0-707b8c016e22 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.manager [req-65d0c203-f19c-4cfe-acfd-c0d24ae7c1c8 req-17f9e878-a3da-4bde-b5b0-707b8c016e22 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] No waiting events found dispatching network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:41:28 user nova-compute[72820]: WARNING nova.compute.manager [req-65d0c203-f19c-4cfe-acfd-c0d24ae7c1c8 req-17f9e878-a3da-4bde-b5b0-707b8c016e22 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received unexpected event network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e for instance with vm_state building and task_state spawning.
Aug 27 02:41:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "518f2efd-99dc-42fb-afdd-da6e174857d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "518f2efd-99dc-42fb-afdd-da6e174857d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:41:28 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Instance spawned successfully.
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:41:28 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:41:28 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7729MB free_disk=24.95203399658203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:41:28 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104088.366854, 937e1fae-4b49-494b-b37b-2ff4cdc8a82b => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:41:28 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] VM Started (Lifecycle Event)
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:41:28 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:41:28 user nova-compute[72820]: INFO nova.compute.manager [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Took 5.28 seconds to spawn the instance on the hypervisor.
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1591319d-3d15-4c46-b823-4edddf018b5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 15a1062a-ecfb-42b7-b8e5-03adbd6b8056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance b1a0ba95-2678-493d-87ba-061abf80887a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 96b0b198-aadc-44cb-a54e-9cc1a08226dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance dc94e6fe-575e-44a1-bf2c-a471abcbbfe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance bd14a452-bae0-49a4-a111-24b725fd8d86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 937e1fae-4b49-494b-b37b-2ff4cdc8a82b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance c5729613-2d22-4d9a-9751-e09dca84e0d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:41:28 user nova-compute[72820]: INFO nova.compute.manager [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Took 21.40 seconds to build instance.
Aug 27 02:41:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f581b0b2-9024-4eca-ba98-e3f6c579659f tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.527s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 518f2efd-99dc-42fb-afdd-da6e174857d1 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing inventories for resource provider a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Updating ProviderTree inventory for provider a962b30a-2750-431c-be10-075d0f991065 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Updating inventory in ProviderTree for provider a962b30a-2750-431c-be10-075d0f991065 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 02:41:28 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing aggregate associations for resource provider a962b30a-2750-431c-be10-075d0f991065, aggregates: None {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 02:41:29 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing trait associations for resource provider a962b30a-2750-431c-be10-075d0f991065, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 02:41:29 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:41:29 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:41:29 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:41:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.758s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.568s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:29 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:41:29 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 02:41:29 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:41:29 user nova-compute[72820]: INFO nova.compute.claims [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Claim successful on node user
Aug 27 02:41:29 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] There are 0 instances to clean {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 02:41:29 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:41:29 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:41:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:29 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:41:29 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:41:29 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:41:29 user nova-compute[72820]: DEBUG nova.network.neutron [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:41:29 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:41:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:29 user nova-compute[72820]: INFO nova.virt.block_device [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Booting with volume snapshot a0cb52be-fbde-4367-8a9e-508ab42a60e5 at /dev/vda
Aug 27 02:41:29 user nova-compute[72820]: DEBUG nova.policy [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '878038feacda4094b5d2c9e3814c8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f02ddcfa2b4571a4d7cacf1287aebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:41:30 user nova-compute[72820]: DEBUG nova.network.neutron [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Successfully created port: 75680cbe-4346-4821-a887-7dec1340d2e9 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:41:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:41:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:41:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:41:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Didn't find any instances for network info cache update. {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 02:41:31 user nova-compute[72820]: DEBUG nova.network.neutron [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Successfully updated port: 75680cbe-4346-4821-a887-7dec1340d2e9 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:41:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "refresh_cache-518f2efd-99dc-42fb-afdd-da6e174857d1" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:41:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquired lock "refresh_cache-518f2efd-99dc-42fb-afdd-da6e174857d1" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:41:31 user nova-compute[72820]: DEBUG nova.network.neutron [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:41:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-1f64e79a-a800-4f19-aa50-2d5f39150e82 req-8a1dd3ed-3870-4597-a8da-a6ef102d3a61 service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Received event network-changed-75680cbe-4346-4821-a887-7dec1340d2e9 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:41:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-1f64e79a-a800-4f19-aa50-2d5f39150e82 req-8a1dd3ed-3870-4597-a8da-a6ef102d3a61 service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Refreshing instance network info cache due to event network-changed-75680cbe-4346-4821-a887-7dec1340d2e9. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:41:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1f64e79a-a800-4f19-aa50-2d5f39150e82 req-8a1dd3ed-3870-4597-a8da-a6ef102d3a61 service nova] Acquiring lock "refresh_cache-518f2efd-99dc-42fb-afdd-da6e174857d1" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:41:31 user nova-compute[72820]: DEBUG nova.network.neutron [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:41:31 user nova-compute[72820]: DEBUG nova.network.neutron [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Updating instance_info_cache with network_info: [{"id": "75680cbe-4346-4821-a887-7dec1340d2e9", "address": "fa:16:3e:42:58:5b", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75680cbe-43", "ovs_interfaceid": "75680cbe-4346-4821-a887-7dec1340d2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:41:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Releasing lock "refresh_cache-518f2efd-99dc-42fb-afdd-da6e174857d1" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:41:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Instance network_info: |[{"id": "75680cbe-4346-4821-a887-7dec1340d2e9", "address": "fa:16:3e:42:58:5b", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75680cbe-43", "ovs_interfaceid": "75680cbe-4346-4821-a887-7dec1340d2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:41:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1f64e79a-a800-4f19-aa50-2d5f39150e82 req-8a1dd3ed-3870-4597-a8da-a6ef102d3a61 service nova] Acquired lock "refresh_cache-518f2efd-99dc-42fb-afdd-da6e174857d1" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:41:31 user nova-compute[72820]: DEBUG nova.network.neutron [req-1f64e79a-a800-4f19-aa50-2d5f39150e82 req-8a1dd3ed-3870-4597-a8da-a6ef102d3a61 service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Refreshing network info cache for port 75680cbe-4346-4821-a887-7dec1340d2e9 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:41:32 user nova-compute[72820]: DEBUG nova.network.neutron [req-1f64e79a-a800-4f19-aa50-2d5f39150e82 req-8a1dd3ed-3870-4597-a8da-a6ef102d3a61 service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Updated VIF entry in instance network info cache for port 75680cbe-4346-4821-a887-7dec1340d2e9. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:41:32 user nova-compute[72820]: DEBUG nova.network.neutron [req-1f64e79a-a800-4f19-aa50-2d5f39150e82 req-8a1dd3ed-3870-4597-a8da-a6ef102d3a61 service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Updating instance_info_cache with network_info: [{"id": "75680cbe-4346-4821-a887-7dec1340d2e9", "address": "fa:16:3e:42:58:5b", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75680cbe-43", "ovs_interfaceid": "75680cbe-4346-4821-a887-7dec1340d2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:41:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1f64e79a-a800-4f19-aa50-2d5f39150e82 req-8a1dd3ed-3870-4597-a8da-a6ef102d3a61 service nova] Releasing lock "refresh_cache-518f2efd-99dc-42fb-afdd-da6e174857d1" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:41:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:39 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:41:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG os_brick.utils [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbf64fa-28a1-480f-8807-25cf155b34cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[168c1787-cf18-44a1-83f1-df36aa14295e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[011b6498-9700-4937-8ac3-5b980c255bb7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ec5915-0ff1-4dc3-bb12-b2ac959a95da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:41:40 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:41:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e286fa-b9db-42d4-be7d-1ea9a4ee6492]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG os_brick.utils [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:41:40 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Updating existing volume attachment record: 7b2bf025-cd2f-489c-aeea-e78098481ce8 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:41:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:48 user nova-compute[72820]: INFO nova.compute.manager [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Terminating instance
Aug 27 02:41:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:41:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:49 user nova-compute[72820]: DEBUG nova.compute.manager [req-be7b6d82-8104-4788-b1f5-c650b6a0cd2b req-954c25f4-dadf-432a-898d-9af2159d4d65 service nova] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Received event network-vif-unplugged-91420809-21b7-4f29-8db7-389b1fd06f7b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:41:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-be7b6d82-8104-4788-b1f5-c650b6a0cd2b req-954c25f4-dadf-432a-898d-9af2159d4d65 service nova] Acquiring lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-be7b6d82-8104-4788-b1f5-c650b6a0cd2b req-954c25f4-dadf-432a-898d-9af2159d4d65 service nova] Lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-be7b6d82-8104-4788-b1f5-c650b6a0cd2b req-954c25f4-dadf-432a-898d-9af2159d4d65 service nova] Lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:49 user nova-compute[72820]: DEBUG nova.compute.manager [req-be7b6d82-8104-4788-b1f5-c650b6a0cd2b req-954c25f4-dadf-432a-898d-9af2159d4d65 service nova] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] No waiting events found dispatching network-vif-unplugged-91420809-21b7-4f29-8db7-389b1fd06f7b {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:41:49 user nova-compute[72820]: DEBUG nova.compute.manager [req-be7b6d82-8104-4788-b1f5-c650b6a0cd2b req-954c25f4-dadf-432a-898d-9af2159d4d65 service nova] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Received event network-vif-unplugged-91420809-21b7-4f29-8db7-389b1fd06f7b for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:41:49 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Instance destroyed successfully.
Aug 27 02:41:49 user nova-compute[72820]: DEBUG nova.objects.instance [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'resources' on Instance uuid 15a1062a-ecfb-42b7-b8e5-03adbd6b8056 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:41:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:32:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-126401999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-126401999',id=27,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:32:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f023daf1767f4088bf0a23524587e662',ramdisk_id='',reservation_id='r-5xg29lxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:34:22Z,user_data=None,user_id='bb67e11ecdd648a89dd58b4bf416060a',uuid=15a1062a-ecfb-42b7-b8e5-03adbd6b8056,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91420809-21b7-4f29-8db7-389b1fd06f7b", "address": "fa:16:3e:13:aa:0b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91420809-21", "ovs_interfaceid": "91420809-21b7-4f29-8db7-389b1fd06f7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:41:49 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converting VIF {"id": "91420809-21b7-4f29-8db7-389b1fd06f7b", "address": "fa:16:3e:13:aa:0b", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91420809-21", "ovs_interfaceid": "91420809-21b7-4f29-8db7-389b1fd06f7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:41:49 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:aa:0b,bridge_name='br-int',has_traffic_filtering=True,id=91420809-21b7-4f29-8db7-389b1fd06f7b,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91420809-21') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:41:49 user nova-compute[72820]: DEBUG os_vif [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:aa:0b,bridge_name='br-int',has_traffic_filtering=True,id=91420809-21b7-4f29-8db7-389b1fd06f7b,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91420809-21') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:41:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91420809-21, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:41:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:41:49 user nova-compute[72820]: INFO os_vif [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:aa:0b,bridge_name='br-int',has_traffic_filtering=True,id=91420809-21b7-4f29-8db7-389b1fd06f7b,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91420809-21')
Aug 27 02:41:49 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Deleting instance files /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056_del
Aug 27 02:41:49 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Deletion of /opt/stack/data/nova/instances/15a1062a-ecfb-42b7-b8e5-03adbd6b8056_del complete
Aug 27 02:41:49 user nova-compute[72820]: INFO nova.compute.manager [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 27 02:41:49 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:41:49 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:41:49 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:41:50 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:41:50 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Took 0.69 seconds to deallocate network for instance.
Aug 27 02:41:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:50 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:41:50 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:41:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:50 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Deleted allocations for instance 15a1062a-ecfb-42b7-b8e5-03adbd6b8056
Aug 27 02:41:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-053fb9ae-a00e-47a5-9191-860aa904dc13 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.916s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-35d38e89-a575-44d7-b649-98d9fa3c9353 req-1f00b5d9-7229-40d9-9826-6b632bd629a8 service nova] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Received event network-vif-plugged-91420809-21b7-4f29-8db7-389b1fd06f7b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:41:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-35d38e89-a575-44d7-b649-98d9fa3c9353 req-1f00b5d9-7229-40d9-9826-6b632bd629a8 service nova] Acquiring lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-35d38e89-a575-44d7-b649-98d9fa3c9353 req-1f00b5d9-7229-40d9-9826-6b632bd629a8 service nova] Lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-35d38e89-a575-44d7-b649-98d9fa3c9353 req-1f00b5d9-7229-40d9-9826-6b632bd629a8 service nova] Lock "15a1062a-ecfb-42b7-b8e5-03adbd6b8056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-35d38e89-a575-44d7-b649-98d9fa3c9353 req-1f00b5d9-7229-40d9-9826-6b632bd629a8 service nova] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] No waiting events found dispatching network-vif-plugged-91420809-21b7-4f29-8db7-389b1fd06f7b {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:41:51 user nova-compute[72820]: WARNING nova.compute.manager [req-35d38e89-a575-44d7-b649-98d9fa3c9353 req-1f00b5d9-7229-40d9-9826-6b632bd629a8 service nova] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Received unexpected event network-vif-plugged-91420809-21b7-4f29-8db7-389b1fd06f7b for instance with vm_state deleted and task_state None.
Aug 27 02:41:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-35d38e89-a575-44d7-b649-98d9fa3c9353 req-1f00b5d9-7229-40d9-9826-6b632bd629a8 service nova] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Received event network-vif-deleted-91420809-21b7-4f29-8db7-389b1fd06f7b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:41:52 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Creating image(s)
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Did not create local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Ensure instance console log exists: /opt/stack/data/nova/instances/518f2efd-99dc-42fb-afdd-da6e174857d1/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Start _get_guest_xml network_info=[{"id": "75680cbe-4346-4821-a887-7dec1340d2e9", "address": "fa:16:3e:42:58:5b", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75680cbe-43", "ovs_interfaceid": "75680cbe-4346-4821-a887-7dec1340d2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-27T02:41:16Z,direct_url=<?>,disk_format='qcow2',id=e7691d68-6948-421d-adaf-b55c3c3241b6,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-848337512',owner='84f02ddcfa2b4571a4d7cacf1287aebd',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-27T02:41:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7b2bf025-cd2f-489c-aeea-e78098481ce8', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SsDHevFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '518f2efd-99dc-42fb-afdd-da6e174857d1', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef1ac523-a563-4f36-88a9-d0667d7f3af5', 'serial': 'ef1ac523-a563-4f36-88a9-d0667d7f3af5'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:41:52 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:41:52 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-27T02:41:16Z,direct_url=<?>,disk_format='qcow2',id=e7691d68-6948-421d-adaf-b55c3c3241b6,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-848337512',owner='84f02ddcfa2b4571a4d7cacf1287aebd',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-27T02:41:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SsDHevFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:41:52 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:41:52 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:41:52 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa86b88f-92d3-4bea-9c43-c4652aac5160]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:41:52 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1a87ee-6e90-4809-9939-203ec6d128f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5] added
Aug 27 02:41:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8e7fbb-b27b-4c48-81bb-7c4cc1508b0b]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec1bfb8-e7a7-4a18-b2e7-643b881e86df]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SsDHevFJ {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SsDHevFJ" returned: 0 in 0.096s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[75619047-4afe-4d25-9c32-9c4fc58a85ef]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SsDHevFJ'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4472fe-e17d-484e-8501-ec0180bb9964]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6454e3-03ec-4e02-aab1-418c3abb6cea]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:41:52 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:41:52 user nova-compute[72820]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:41:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:41:52 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:41:52 user nova-compute[72820]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:41:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f588a7e-4725-40e6-a419-aa6b9268ce27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5, portal: 172.16.0.220,3260]
Aug 27 02:41:52 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5, portal: 172.16.0.220,3260] successful.
Aug 27 02:41:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1723251e-4769-42a6-90a9-5f6a5ac85a94]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6147cd-712a-43b3-87c0-3c766417f54a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:41:52 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:41:52 user nova-compute[72820]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:41:52 user nova-compute[72820]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)
Aug 27 02:41:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:41:52 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:41:52 user nova-compute[72820]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:41:52 user nova-compute[72820]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)
Aug 27 02:41:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[db92abc9-3010-4025-b31c-8fb0904bd5a5]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: None {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:41:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-2c55fc23-81d1-402c-9289-de7322b74b74 req-7e14b42d-1dea-4097-86cf-d47b7eb10fb7 service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Received event network-changed-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-2c55fc23-81d1-402c-9289-de7322b74b74 req-7e14b42d-1dea-4097-86cf-d47b7eb10fb7 service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Refreshing instance network info cache due to event network-changed-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2c55fc23-81d1-402c-9289-de7322b74b74 req-7e14b42d-1dea-4097-86cf-d47b7eb10fb7 service nova] Acquiring lock "refresh_cache-dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2c55fc23-81d1-402c-9289-de7322b74b74 req-7e14b42d-1dea-4097-86cf-d47b7eb10fb7 service nova] Acquired lock "refresh_cache-dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG nova.network.neutron [req-2c55fc23-81d1-402c-9289-de7322b74b74 req-7e14b42d-1dea-4097-86cf-d47b7eb10fb7 service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Refreshing network info cache for port 8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SsDHevFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '26137303161613261', 'path': '/dev/sdd'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137303161613261', 'path': '/dev/sdd'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-80109924',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-80109924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-80109924',id=40,image_ref='e7691d68-6948-421d-adaf-b55c3c3241b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKboPXnG/ryIeax3Mg85PsNYitSiD9WxpPgzUHxiYOiNxUoZYS8LCY1vNtK/d/bq4lWZtZirVJsZIMDIcy3QxeFvKSKDiIQj2XrgMj7rVh9Stkv8v5eEYib/sOFxXPa6OQ==',key_name='tempest-keypair-860138360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84f02ddcfa2b4571a4d7cacf1287aebd',ramdisk_id='',reservation_id='r-0jngs4r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-631676638',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-631676638',owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:41:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='878038feacda4094b5d2c9e3814c8bf0',uuid=518f2efd-99dc-42fb-afdd-da6e174857d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75680cbe-4346-4821-a887-7dec1340d2e9", "address": "fa:16:3e:42:58:5b", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75680cbe-43", "ovs_interfaceid": "75680cbe-4346-4821-a887-7dec1340d2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converting VIF {"id": "75680cbe-4346-4821-a887-7dec1340d2e9", "address": "fa:16:3e:42:58:5b", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75680cbe-43", "ovs_interfaceid": "75680cbe-4346-4821-a887-7dec1340d2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:58:5b,bridge_name='br-int',has_traffic_filtering=True,id=75680cbe-4346-4821-a887-7dec1340d2e9,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75680cbe-43') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG nova.objects.instance [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lazy-loading 'pci_devices' on Instance uuid 518f2efd-99dc-42fb-afdd-da6e174857d1 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:41:53 user nova-compute[72820]:   <uuid>518f2efd-99dc-42fb-afdd-da6e174857d1</uuid>
Aug 27 02:41:53 user nova-compute[72820]:   <name>instance-00000028</name>
Aug 27 02:41:53 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:41:53 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:41:53 user nova-compute[72820]:   <metadata>
Aug 27 02:41:53 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:41:53 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:41:53 user nova-compute[72820]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-80109924</nova:name>
Aug 27 02:41:53 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:41:52</nova:creationTime>
Aug 27 02:41:53 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:41:53 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:41:53 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:41:53 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:41:53 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:41:53 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:41:53 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:41:53 user nova-compute[72820]:       <nova:owner>
Aug 27 02:41:53 user nova-compute[72820]:         <nova:user uuid="878038feacda4094b5d2c9e3814c8bf0">tempest-TestVolumeBootPattern-631676638-project-member</nova:user>
Aug 27 02:41:53 user nova-compute[72820]:         <nova:project uuid="84f02ddcfa2b4571a4d7cacf1287aebd">tempest-TestVolumeBootPattern-631676638</nova:project>
Aug 27 02:41:53 user nova-compute[72820]:       </nova:owner>
Aug 27 02:41:53 user nova-compute[72820]:       <nova:root type="image" uuid="e7691d68-6948-421d-adaf-b55c3c3241b6"/>
Aug 27 02:41:53 user nova-compute[72820]:       <nova:ports>
Aug 27 02:41:53 user nova-compute[72820]:         <nova:port uuid="75680cbe-4346-4821-a887-7dec1340d2e9">
Aug 27 02:41:53 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 02:41:53 user nova-compute[72820]:         </nova:port>
Aug 27 02:41:53 user nova-compute[72820]:       </nova:ports>
Aug 27 02:41:53 user nova-compute[72820]:     </nova:instance>
Aug 27 02:41:53 user nova-compute[72820]:   </metadata>
Aug 27 02:41:53 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:41:53 user nova-compute[72820]:     <system>
Aug 27 02:41:53 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:41:53 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:41:53 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:41:53 user nova-compute[72820]:       <entry name="serial">518f2efd-99dc-42fb-afdd-da6e174857d1</entry>
Aug 27 02:41:53 user nova-compute[72820]:       <entry name="uuid">518f2efd-99dc-42fb-afdd-da6e174857d1</entry>
Aug 27 02:41:53 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:41:53 user nova-compute[72820]:     </system>
Aug 27 02:41:53 user nova-compute[72820]:   </sysinfo>
Aug 27 02:41:53 user nova-compute[72820]:   <os>
Aug 27 02:41:53 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:41:53 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:41:53 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:41:53 user nova-compute[72820]:   </os>
Aug 27 02:41:53 user nova-compute[72820]:   <features>
Aug 27 02:41:53 user nova-compute[72820]:     <acpi/>
Aug 27 02:41:53 user nova-compute[72820]:     <apic/>
Aug 27 02:41:53 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:41:53 user nova-compute[72820]:   </features>
Aug 27 02:41:53 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:41:53 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:41:53 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:41:53 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:41:53 user nova-compute[72820]:   </clock>
Aug 27 02:41:53 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:41:53 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:41:53 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:41:53 user nova-compute[72820]:   </cpu>
Aug 27 02:41:53 user nova-compute[72820]:   <devices>
Aug 27 02:41:53 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:41:53 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:41:53 user nova-compute[72820]:       <source dev="/dev/sdd"/>
Aug 27 02:41:53 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:41:53 user nova-compute[72820]:       <serial>ef1ac523-a563-4f36-88a9-d0667d7f3af5</serial>
Aug 27 02:41:53 user nova-compute[72820]:     </disk>
Aug 27 02:41:53 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:41:53 user nova-compute[72820]:       <mac address="fa:16:3e:42:58:5b"/>
Aug 27 02:41:53 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:41:53 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:41:53 user nova-compute[72820]:       <target dev="tap75680cbe-43"/>
Aug 27 02:41:53 user nova-compute[72820]:     </interface>
Aug 27 02:41:53 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:41:53 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/518f2efd-99dc-42fb-afdd-da6e174857d1/console.log" append="off"/>
Aug 27 02:41:53 user nova-compute[72820]:     </serial>
Aug 27 02:41:53 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:41:53 user nova-compute[72820]:     <video>
Aug 27 02:41:53 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:41:53 user nova-compute[72820]:     </video>
Aug 27 02:41:53 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:41:53 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:41:53 user nova-compute[72820]:     </rng>
Aug 27 02:41:53 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:41:53 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:41:53 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:41:53 user nova-compute[72820]:     </memballoon>
Aug 27 02:41:53 user nova-compute[72820]:   </devices>
Aug 27 02:41:53 user nova-compute[72820]: </domain>
Aug 27 02:41:53 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-80109924',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-80109924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-80109924',id=40,image_ref='e7691d68-6948-421d-adaf-b55c3c3241b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKboPXnG/ryIeax3Mg85PsNYitSiD9WxpPgzUHxiYOiNxUoZYS8LCY1vNtK/d/bq4lWZtZirVJsZIMDIcy3QxeFvKSKDiIQj2XrgMj7rVh9Stkv8v5eEYib/sOFxXPa6OQ==',key_name='tempest-keypair-860138360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84f02ddcfa2b4571a4d7cacf1287aebd',ramdisk_id='',reservation_id='r-0jngs4r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-631676638',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-631676638',owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:41:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='878038feacda4094b5d2c9e3814c8bf0',uuid=518f2efd-99dc-42fb-afdd-da6e174857d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75680cbe-4346-4821-a887-7dec1340d2e9", "address": "fa:16:3e:42:58:5b", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75680cbe-43", "ovs_interfaceid": "75680cbe-4346-4821-a887-7dec1340d2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converting VIF {"id": "75680cbe-4346-4821-a887-7dec1340d2e9", "address": "fa:16:3e:42:58:5b", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75680cbe-43", "ovs_interfaceid": "75680cbe-4346-4821-a887-7dec1340d2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:58:5b,bridge_name='br-int',has_traffic_filtering=True,id=75680cbe-4346-4821-a887-7dec1340d2e9,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75680cbe-43') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG os_vif [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:58:5b,bridge_name='br-int',has_traffic_filtering=True,id=75680cbe-4346-4821-a887-7dec1340d2e9,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75680cbe-43') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75680cbe-43, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap75680cbe-43, col_values=(('external_ids', {'iface-id': '75680cbe-4346-4821-a887-7dec1340d2e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:58:5b', 'vm-uuid': '518f2efd-99dc-42fb-afdd-da6e174857d1'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:53 user nova-compute[72820]: INFO os_vif [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:58:5b,bridge_name='br-int',has_traffic_filtering=True,id=75680cbe-4346-4821-a887-7dec1340d2e9,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75680cbe-43')
Aug 27 02:41:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:41:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] No VIF found with MAC fa:16:3e:42:58:5b, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:41:54 user nova-compute[72820]: DEBUG nova.network.neutron [req-2c55fc23-81d1-402c-9289-de7322b74b74 req-7e14b42d-1dea-4097-86cf-d47b7eb10fb7 service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Updated VIF entry in instance network info cache for port 8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:41:54 user nova-compute[72820]: DEBUG nova.network.neutron [req-2c55fc23-81d1-402c-9289-de7322b74b74 req-7e14b42d-1dea-4097-86cf-d47b7eb10fb7 service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Updating instance_info_cache with network_info: [{"id": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "address": "fa:16:3e:a3:f9:24", "network": {"id": "f4a9038d-1157-4fde-86e7-fb932a428e31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1722086374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce56ca2340b84b4785f0f8132f15296b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba5dbcd-5f", "ovs_interfaceid": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:41:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2c55fc23-81d1-402c-9289-de7322b74b74 req-7e14b42d-1dea-4097-86cf-d47b7eb10fb7 service nova] Releasing lock "refresh_cache-dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:41:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-421f0ec2-54b2-4d75-97d4-5fed29d0fd73 req-c816c918-41dd-41af-a471-f88007478d8b service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Received event network-vif-plugged-75680cbe-4346-4821-a887-7dec1340d2e9 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:41:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-421f0ec2-54b2-4d75-97d4-5fed29d0fd73 req-c816c918-41dd-41af-a471-f88007478d8b service nova] Acquiring lock "518f2efd-99dc-42fb-afdd-da6e174857d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-421f0ec2-54b2-4d75-97d4-5fed29d0fd73 req-c816c918-41dd-41af-a471-f88007478d8b service nova] Lock "518f2efd-99dc-42fb-afdd-da6e174857d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-421f0ec2-54b2-4d75-97d4-5fed29d0fd73 req-c816c918-41dd-41af-a471-f88007478d8b service nova] Lock "518f2efd-99dc-42fb-afdd-da6e174857d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-421f0ec2-54b2-4d75-97d4-5fed29d0fd73 req-c816c918-41dd-41af-a471-f88007478d8b service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] No waiting events found dispatching network-vif-plugged-75680cbe-4346-4821-a887-7dec1340d2e9 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:41:55 user nova-compute[72820]: WARNING nova.compute.manager [req-421f0ec2-54b2-4d75-97d4-5fed29d0fd73 req-c816c918-41dd-41af-a471-f88007478d8b service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Received unexpected event network-vif-plugged-75680cbe-4346-4821-a887-7dec1340d2e9 for instance with vm_state building and task_state spawning.
Aug 27 02:41:57 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104117.1620188, 518f2efd-99dc-42fb-afdd-da6e174857d1 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:41:57 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] VM Resumed (Lifecycle Event)
Aug 27 02:41:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:41:57 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:41:57 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Instance spawned successfully.
Aug 27 02:41:57 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:41:57 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:41:57 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:41:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:41:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:41:57 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:41:57 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104117.1629372, 518f2efd-99dc-42fb-afdd-da6e174857d1 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:41:57 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] VM Started (Lifecycle Event)
Aug 27 02:41:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:41:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:41:57 user nova-compute[72820]: INFO nova.compute.manager [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Took 5.01 seconds to spawn the instance on the hypervisor.
Aug 27 02:41:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:41:57 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:41:57 user nova-compute[72820]: INFO nova.compute.manager [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Took 28.66 seconds to build instance.
Aug 27 02:41:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7261bf83-c9b9-4563-921b-e26b2c1b6652 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "518f2efd-99dc-42fb-afdd-da6e174857d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.793s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-9aef9ffe-522a-42f3-927a-84e8bd9d7056 req-d923183f-58b2-47be-82e4-fd3257260fbf service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Received event network-vif-plugged-75680cbe-4346-4821-a887-7dec1340d2e9 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:41:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9aef9ffe-522a-42f3-927a-84e8bd9d7056 req-d923183f-58b2-47be-82e4-fd3257260fbf service nova] Acquiring lock "518f2efd-99dc-42fb-afdd-da6e174857d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9aef9ffe-522a-42f3-927a-84e8bd9d7056 req-d923183f-58b2-47be-82e4-fd3257260fbf service nova] Lock "518f2efd-99dc-42fb-afdd-da6e174857d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9aef9ffe-522a-42f3-927a-84e8bd9d7056 req-d923183f-58b2-47be-82e4-fd3257260fbf service nova] Lock "518f2efd-99dc-42fb-afdd-da6e174857d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-9aef9ffe-522a-42f3-927a-84e8bd9d7056 req-d923183f-58b2-47be-82e4-fd3257260fbf service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] No waiting events found dispatching network-vif-plugged-75680cbe-4346-4821-a887-7dec1340d2e9 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:41:57 user nova-compute[72820]: WARNING nova.compute.manager [req-9aef9ffe-522a-42f3-927a-84e8bd9d7056 req-d923183f-58b2-47be-82e4-fd3257260fbf service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Received unexpected event network-vif-plugged-75680cbe-4346-4821-a887-7dec1340d2e9 for instance with vm_state active and task_state None.
Aug 27 02:41:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:41:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Acquiring lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:58 user nova-compute[72820]: DEBUG nova.objects.instance [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lazy-loading 'flavor' on Instance uuid dc94e6fe-575e-44a1-bf2c-a471abcbbfe7 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:41:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Acquiring lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:41:59 user nova-compute[72820]: INFO nova.compute.manager [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Attaching volume b8d07fb7-3532-45b6-b492-f82bb2b2cc97 to /dev/vdb
Aug 27 02:41:59 user nova-compute[72820]: DEBUG os_brick.utils [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5548bd-7061-40f4-aeea-5e055f4f29ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd68cbdf-92fd-41a9-a405-3ccab1003f06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c3dc58-dc1a-451a-ac34-3610a0559b71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d92957-23d9-4189-9677-80d01241cba9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:41:59 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:41:59 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4321bc03-b697-46f1-a603-6b9f7281022a]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG os_brick.utils [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:41:59 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Updating existing volume attachment record: c0507c78-9757-4640-bfd7-9c122097c5b5 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:42:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:04 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104109.387458, 15a1062a-ecfb-42b7-b8e5-03adbd6b8056 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:42:04 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] VM Stopped (Lifecycle Event)
Aug 27 02:42:04 user nova-compute[72820]: DEBUG nova.compute.manager [None req-48594fa3-4ce6-436f-acd3-34896452e4bf None None] [instance: 15a1062a-ecfb-42b7-b8e5-03adbd6b8056] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:42:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:06 user nova-compute[72820]: INFO nova.compute.manager [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Unshelving
Aug 27 02:42:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:06 user nova-compute[72820]: DEBUG nova.objects.instance [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'pci_requests' on Instance uuid 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:42:06 user nova-compute[72820]: DEBUG nova.objects.instance [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'numa_topology' on Instance uuid 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:42:06 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:42:06 user nova-compute[72820]: INFO nova.compute.claims [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Claim successful on node user
Aug 27 02:42:07 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:42:07 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:42:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:07 user nova-compute[72820]: INFO nova.network.neutron [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Updating port 44b914a9-6a23-44dc-9711-dd33dfdd276b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 27 02:42:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:42:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquired lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:42:08 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:42:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:42:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-c14df143-4d2e-40a6-a340-501a3bfd8a0c req-2ab278e4-a1a1-47e5-b84d-179621ad8f9a service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received event network-changed-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:42:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-c14df143-4d2e-40a6-a340-501a3bfd8a0c req-2ab278e4-a1a1-47e5-b84d-179621ad8f9a service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Refreshing instance network info cache due to event network-changed-44b914a9-6a23-44dc-9711-dd33dfdd276b. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:42:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c14df143-4d2e-40a6-a340-501a3bfd8a0c req-2ab278e4-a1a1-47e5-b84d-179621ad8f9a service nova] Acquiring lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:42:09 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Updating instance_info_cache with network_info: [{"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:42:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Releasing lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:42:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:42:09 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Creating image(s)
Aug 27 02:42:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "/opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "/opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "/opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:09 user nova-compute[72820]: DEBUG nova.objects.instance [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:42:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c14df143-4d2e-40a6-a340-501a3bfd8a0c req-2ab278e4-a1a1-47e5-b84d-179621ad8f9a service nova] Acquired lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:42:09 user nova-compute[72820]: DEBUG nova.network.neutron [req-c14df143-4d2e-40a6-a340-501a3bfd8a0c req-2ab278e4-a1a1-47e5-b84d-179621ad8f9a service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Refreshing network info cache for port 44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:42:09 user nova-compute[72820]: DEBUG nova.objects.base [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Object Instance<7726f4c9-697d-49ac-a2ee-ed42f81d8c64> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:42:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "16966179790c70105691b5dcec1d7910988cf5a4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "16966179790c70105691b5dcec1d7910988cf5a4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.056s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:10 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4.part --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4.part --force-share --output=json" returned: 0 in 0.206s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:11 user nova-compute[72820]: DEBUG nova.virt.images [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] 11fc2251-c794-4e4b-bab5-bb5e04c35909 was qcow2, converting to raw {{(pid=72820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 02:42:11 user nova-compute[72820]: DEBUG nova.privsep.utils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 02:42:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4.part /opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4.converted {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:11 user nova-compute[72820]: DEBUG nova.network.neutron [req-c14df143-4d2e-40a6-a340-501a3bfd8a0c req-2ab278e4-a1a1-47e5-b84d-179621ad8f9a service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Updated VIF entry in instance network info cache for port 44b914a9-6a23-44dc-9711-dd33dfdd276b. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:42:11 user nova-compute[72820]: DEBUG nova.network.neutron [req-c14df143-4d2e-40a6-a340-501a3bfd8a0c req-2ab278e4-a1a1-47e5-b84d-179621ad8f9a service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Updating instance_info_cache with network_info: [{"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:42:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4.part /opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4.converted" returned: 0 in 0.290s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4.converted --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c14df143-4d2e-40a6-a340-501a3bfd8a0c req-2ab278e4-a1a1-47e5-b84d-179621ad8f9a service nova] Releasing lock "refresh_cache-7726f4c9-697d-49ac-a2ee-ed42f81d8c64" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:42:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4.converted --force-share --output=json" returned: 0 in 0.212s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "16966179790c70105691b5dcec1d7910988cf5a4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.750s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4 --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4 --force-share --output=json" returned: 0 in 0.187s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "16966179790c70105691b5dcec1d7910988cf5a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "16966179790c70105691b5dcec1d7910988cf5a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:11 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4 --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4 --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4,backing_fmt=raw /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4,backing_fmt=raw /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk 1073741824" returned: 0 in 0.066s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "16966179790c70105691b5dcec1d7910988cf5a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4 --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4 --force-share --output=json" returned: 0 in 0.182s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG nova.objects.instance [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'migration_context' on Instance uuid 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG nova.objects.base [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Object Instance<7726f4c9-697d-49ac-a2ee-ed42f81d8c64> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:42:12 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Rebasing disk image.
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThbVigSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:42:12 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:42:12 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:42:12 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46ccebd-0ca7-43b2-949b-a26a15340d45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:42:12 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0af2047-bde8-404d-ba57-9084d2484eff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97] added
Aug 27 02:42:12 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[472e981e-95ee-4fb8-8a4a-650ed4a40e0c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.262s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d -F raw /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[072f0010-d155-4188-8061-6f75fae61559]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ThbVigSW {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ThbVigSW" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c777a39b-a9d2-4269-a05d-199a145d1817]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ThbVigSW'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c46b0f-5275-48f1-a627-fb4248d67286]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7a7470-577f-4497-a02a-025be6da51e8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eca8031-e36c-4cdc-b1b0-40e3596f06c6 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:42:12 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:42:12 user nova-compute[72820]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:42:12 user nova-compute[72820]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)
Aug 27 02:42:12 user nova-compute[72820]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eca8031-e36c-4cdc-b1b0-40e3596f06c6 (non-flash)
Aug 27 02:42:12 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:42:12 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:42:12 user nova-compute[72820]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:42:12 user nova-compute[72820]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)
Aug 27 02:42:12 user nova-compute[72820]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eca8031-e36c-4cdc-b1b0-40e3596f06c6 (non-flash)
Aug 27 02:42:12 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[52896d7d-de8f-41e0-b947-9ad242fd0991]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97, portal: 172.16.0.220,3260]
Aug 27 02:42:12 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97, portal: 172.16.0.220,3260] successful.
Aug 27 02:42:12 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f3bd84-498b-4a26-b2e5-d9af6664d800]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2225e972-28f9-433d-8bd5-bd22207f9ce4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eca8031-e36c-4cdc-b1b0-40e3596f06c6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:42:12 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:42:12 user nova-compute[72820]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:42:12 user nova-compute[72820]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)
Aug 27 02:42:12 user nova-compute[72820]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eca8031-e36c-4cdc-b1b0-40e3596f06c6 (non-flash)
Aug 27 02:42:12 user nova-compute[72820]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 (non-flash)
Aug 27 02:42:12 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:42:12 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:42:12 user nova-compute[72820]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:42:12 user nova-compute[72820]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)
Aug 27 02:42:12 user nova-compute[72820]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eca8031-e36c-4cdc-b1b0-40e3596f06c6 (non-flash)
Aug 27 02:42:12 user nova-compute[72820]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 (non-flash)
Aug 27 02:42:12 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] HCTL ('38', '-', '-', 0) found on session 44 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:42:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.050s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4bd144-b88a-43b0-a5cb-b77611bac97a]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:13 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Searching for a device in session 44 and hctl ['38', '*', '*', 0] yield: None {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:42:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:14 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Searching for a device in session 44 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:42:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThbVigSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:42:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:42:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] <== connect_volume: return (1469ms) {'type': 'block', 'scsi_wwn': '26565653266316233', 'path': '/dev/sdg'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:42:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565653266316233', 'path': '/dev/sdg'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:42:14 user nova-compute[72820]: DEBUG nova.objects.instance [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lazy-loading 'flavor' on Instance uuid dc94e6fe-575e-44a1-bf2c-a471abcbbfe7 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:42:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:42:14 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:42:14 user nova-compute[72820]:   <source dev="/dev/sdg"/>
Aug 27 02:42:14 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:42:14 user nova-compute[72820]:   <serial>b8d07fb7-3532-45b6-b492-f82bb2b2cc97</serial>
Aug 27 02:42:14 user nova-compute[72820]: </disk>
Aug 27 02:42:14 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:42:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:42:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:42:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] No VIF found with MAC fa:16:3e:a3:f9:24, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:42:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9c73130a-f296-41fd-b5fd-7b3bfa137514 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.770s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d -F raw /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk" returned: 0 in 2.433s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Ensure instance console log exists: /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Start _get_guest_xml network_info=[{"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d1e8b884ed4ba80d3d21969dabf4ce63',container_format='bare',created_at=2023-08-27T02:40:13Z,direct_url=<?>,disk_format='qcow2',id=11fc2251-c794-4e4b-bab5-bb5e04c35909,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1380869967-shelved',owner='5387e67178b141ae94025b9fd61f0124',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T02:40:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:42:15 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:42:15 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d1e8b884ed4ba80d3d21969dabf4ce63',container_format='bare',created_at=2023-08-27T02:40:13Z,direct_url=<?>,disk_format='qcow2',id=11fc2251-c794-4e4b-bab5-bb5e04c35909,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1380869967-shelved',owner='5387e67178b141ae94025b9fd61f0124',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T02:40:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.objects.instance [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.objects.base [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Object Instance<7726f4c9-697d-49ac-a2ee-ed42f81d8c64> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T02:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1380869967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1380869967',id=32,image_ref='11fc2251-c794-4e4b-bab5-bb5e04c35909',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-956790269',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:38:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5387e67178b141ae94025b9fd61f0124',ramdisk_id='',reservation_id='r-3mee6amo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1913674887',owner_user_name='tempest-AttachVolumeShelveTestJSON-1913674887-project-member',shelved_at='2023-08-27T02:40:17.920470',shelved_host='user',shelved_image_id='11fc2251-c794-4e4b-bab5-bb5e04c35909'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:42:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6dbf37c8dec47aebcdc9c93ad1f3d69',uuid=7726f4c9-697d-49ac-a2ee-ed42f81d8c64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converting VIF {"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:49:83,bridge_name='br-int',has_traffic_filtering=True,id=44b914a9-6a23-44dc-9711-dd33dfdd276b,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b914a9-6a') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.objects.instance [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'pci_devices' on Instance uuid 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.objects.base [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Object Instance<7726f4c9-697d-49ac-a2ee-ed42f81d8c64> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:42:15 user nova-compute[72820]:   <uuid>7726f4c9-697d-49ac-a2ee-ed42f81d8c64</uuid>
Aug 27 02:42:15 user nova-compute[72820]:   <name>instance-00000020</name>
Aug 27 02:42:15 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:42:15 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:42:15 user nova-compute[72820]:   <metadata>
Aug 27 02:42:15 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:42:15 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:42:15 user nova-compute[72820]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1380869967</nova:name>
Aug 27 02:42:15 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:42:15</nova:creationTime>
Aug 27 02:42:15 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:42:15 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:42:15 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:42:15 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:42:15 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:42:15 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:42:15 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:42:15 user nova-compute[72820]:       <nova:owner>
Aug 27 02:42:15 user nova-compute[72820]:         <nova:user uuid="e6dbf37c8dec47aebcdc9c93ad1f3d69">tempest-AttachVolumeShelveTestJSON-1913674887-project-member</nova:user>
Aug 27 02:42:15 user nova-compute[72820]:         <nova:project uuid="5387e67178b141ae94025b9fd61f0124">tempest-AttachVolumeShelveTestJSON-1913674887</nova:project>
Aug 27 02:42:15 user nova-compute[72820]:       </nova:owner>
Aug 27 02:42:15 user nova-compute[72820]:       <nova:root type="image" uuid="11fc2251-c794-4e4b-bab5-bb5e04c35909"/>
Aug 27 02:42:15 user nova-compute[72820]:       <nova:ports>
Aug 27 02:42:15 user nova-compute[72820]:         <nova:port uuid="44b914a9-6a23-44dc-9711-dd33dfdd276b">
Aug 27 02:42:15 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 02:42:15 user nova-compute[72820]:         </nova:port>
Aug 27 02:42:15 user nova-compute[72820]:       </nova:ports>
Aug 27 02:42:15 user nova-compute[72820]:     </nova:instance>
Aug 27 02:42:15 user nova-compute[72820]:   </metadata>
Aug 27 02:42:15 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:42:15 user nova-compute[72820]:     <system>
Aug 27 02:42:15 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:42:15 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:42:15 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:42:15 user nova-compute[72820]:       <entry name="serial">7726f4c9-697d-49ac-a2ee-ed42f81d8c64</entry>
Aug 27 02:42:15 user nova-compute[72820]:       <entry name="uuid">7726f4c9-697d-49ac-a2ee-ed42f81d8c64</entry>
Aug 27 02:42:15 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:42:15 user nova-compute[72820]:     </system>
Aug 27 02:42:15 user nova-compute[72820]:   </sysinfo>
Aug 27 02:42:15 user nova-compute[72820]:   <os>
Aug 27 02:42:15 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:42:15 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:42:15 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:42:15 user nova-compute[72820]:   </os>
Aug 27 02:42:15 user nova-compute[72820]:   <features>
Aug 27 02:42:15 user nova-compute[72820]:     <acpi/>
Aug 27 02:42:15 user nova-compute[72820]:     <apic/>
Aug 27 02:42:15 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:42:15 user nova-compute[72820]:   </features>
Aug 27 02:42:15 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:42:15 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:42:15 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:42:15 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:42:15 user nova-compute[72820]:   </clock>
Aug 27 02:42:15 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:42:15 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:42:15 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:42:15 user nova-compute[72820]:   </cpu>
Aug 27 02:42:15 user nova-compute[72820]:   <devices>
Aug 27 02:42:15 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:42:15 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:42:15 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk"/>
Aug 27 02:42:15 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:42:15 user nova-compute[72820]:     </disk>
Aug 27 02:42:15 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:42:15 user nova-compute[72820]:       <mac address="fa:16:3e:6c:49:83"/>
Aug 27 02:42:15 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:42:15 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:42:15 user nova-compute[72820]:       <target dev="tap44b914a9-6a"/>
Aug 27 02:42:15 user nova-compute[72820]:     </interface>
Aug 27 02:42:15 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:42:15 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/console.log" append="off"/>
Aug 27 02:42:15 user nova-compute[72820]:     </serial>
Aug 27 02:42:15 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:42:15 user nova-compute[72820]:     <video>
Aug 27 02:42:15 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:42:15 user nova-compute[72820]:     </video>
Aug 27 02:42:15 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:42:15 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:42:15 user nova-compute[72820]:     </rng>
Aug 27 02:42:15 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:42:15 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:42:15 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:42:15 user nova-compute[72820]:     </memballoon>
Aug 27 02:42:15 user nova-compute[72820]:   </devices>
Aug 27 02:42:15 user nova-compute[72820]: </domain>
Aug 27 02:42:15 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T02:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1380869967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1380869967',id=32,image_ref='11fc2251-c794-4e4b-bab5-bb5e04c35909',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-956790269',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:38:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5387e67178b141ae94025b9fd61f0124',ramdisk_id='',reservation_id='r-3mee6amo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1913674887',owner_user_name='tempest-AttachVolumeShelveTestJSON-1913674887-project-member',shelved_at='2023-08-27T02:40:17.920470',shelved_host='user',shelved_image_id='11fc2251-c794-4e4b-bab5-bb5e04c35909'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:42:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6dbf37c8dec47aebcdc9c93ad1f3d69',uuid=7726f4c9-697d-49ac-a2ee-ed42f81d8c64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converting VIF {"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:49:83,bridge_name='br-int',has_traffic_filtering=True,id=44b914a9-6a23-44dc-9711-dd33dfdd276b,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b914a9-6a') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG os_vif [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:49:83,bridge_name='br-int',has_traffic_filtering=True,id=44b914a9-6a23-44dc-9711-dd33dfdd276b,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b914a9-6a') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44b914a9-6a, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap44b914a9-6a, col_values=(('external_ids', {'iface-id': '44b914a9-6a23-44dc-9711-dd33dfdd276b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:49:83', 'vm-uuid': '7726f4c9-697d-49ac-a2ee-ed42f81d8c64'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:15 user nova-compute[72820]: INFO os_vif [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:49:83,bridge_name='br-int',has_traffic_filtering=True,id=44b914a9-6a23-44dc-9711-dd33dfdd276b,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b914a9-6a')
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:42:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] No VIF found with MAC fa:16:3e:6c:49:83, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:42:16 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:42:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Acquiring lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:16 user nova-compute[72820]: INFO nova.compute.manager [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Detaching volume b8d07fb7-3532-45b6-b492-f82bb2b2cc97
Aug 27 02:42:16 user nova-compute[72820]: INFO nova.virt.block_device [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Attempting to driver detach volume b8d07fb7-3532-45b6-b492-f82bb2b2cc97 from mountpoint /dev/vdb
Aug 27 02:42:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Attempting to detach device vdb from instance dc94e6fe-575e-44a1-bf2c-a471abcbbfe7 from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:42:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:42:16 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:42:16 user nova-compute[72820]:   <source dev="/dev/sdg"/>
Aug 27 02:42:16 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:42:16 user nova-compute[72820]:   <serial>b8d07fb7-3532-45b6-b492-f82bb2b2cc97</serial>
Aug 27 02:42:16 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:42:16 user nova-compute[72820]: </disk>
Aug 27 02:42:16 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:42:16 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Successfully detached device vdb from instance dc94e6fe-575e-44a1-bf2c-a471abcbbfe7 from the persistent domain config.
Aug 27 02:42:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dc94e6fe-575e-44a1-bf2c-a471abcbbfe7 from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:42:16 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:42:16 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:42:16 user nova-compute[72820]:   <source dev="/dev/sdg"/>
Aug 27 02:42:16 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:42:16 user nova-compute[72820]:   <serial>b8d07fb7-3532-45b6-b492-f82bb2b2cc97</serial>
Aug 27 02:42:16 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:42:16 user nova-compute[72820]: </disk>
Aug 27 02:42:16 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG nova.compute.manager [req-e0ab1022-38a8-4f95-95de-575d3e3a7fb8 req-f367d354-47fa-403a-9bdf-614fc04ce332 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received event network-vif-plugged-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e0ab1022-38a8-4f95-95de-575d3e3a7fb8 req-f367d354-47fa-403a-9bdf-614fc04ce332 service nova] Acquiring lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e0ab1022-38a8-4f95-95de-575d3e3a7fb8 req-f367d354-47fa-403a-9bdf-614fc04ce332 service nova] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e0ab1022-38a8-4f95-95de-575d3e3a7fb8 req-f367d354-47fa-403a-9bdf-614fc04ce332 service nova] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG nova.compute.manager [req-e0ab1022-38a8-4f95-95de-575d3e3a7fb8 req-f367d354-47fa-403a-9bdf-614fc04ce332 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] No waiting events found dispatching network-vif-plugged-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:42:17 user nova-compute[72820]: WARNING nova.compute.manager [req-e0ab1022-38a8-4f95-95de-575d3e3a7fb8 req-f367d354-47fa-403a-9bdf-614fc04ce332 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received unexpected event network-vif-plugged-44b914a9-6a23-44dc-9711-dd33dfdd276b for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 02:42:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693104137.491071, dc94e6fe-575e-44a1-bf2c-a471abcbbfe7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dc94e6fe-575e-44a1-bf2c-a471abcbbfe7 {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:17 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Successfully detached device vdb from instance dc94e6fe-575e-44a1-bf2c-a471abcbbfe7 from the live domain config.
Aug 27 02:42:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThbVigSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:42:17 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[119ce573-7516-412d-9c66-3e83a80c71f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8eca8031-e36c-4cdc-b1b0-40e3596f06c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:42:17 user nova-compute[72820]: No targets found.
Aug 27 02:42:17 user nova-compute[72820]: iSNS:
Aug 27 02:42:17 user nova-compute[72820]: No targets found.
Aug 27 02:42:17 user nova-compute[72820]: STATIC:
Aug 27 02:42:17 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97
Aug 27 02:42:17 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:42:17 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:42:17 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:8eca8031-e36c-4cdc-b1b0-40e3596f06c6
Aug 27 02:42:17 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:42:17 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:42:17 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5
Aug 27 02:42:17 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:42:17 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:42:17 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:42:17 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:42:17 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:42:17 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab
Aug 27 02:42:17 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:42:17 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:42:17 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b
Aug 27 02:42:17 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:42:17 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:42:17 user nova-compute[72820]: FIRMWARE:
Aug 27 02:42:17 user nova-compute[72820]: No targets found.
Aug 27 02:42:17 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:42:17 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:42:17 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed6a6fa-0bdc-4871-8dde-67773d629152]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8eca8031-e36c-4cdc-b1b0-40e3596f06c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c32985-ec7a-4c90-bbac-c7d71bc5e7b2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eca8031-e36c-4cdc-b1b0-40e3596f06c6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:42:17 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:42:17 user nova-compute[72820]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:42:17 user nova-compute[72820]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)
Aug 27 02:42:17 user nova-compute[72820]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eca8031-e36c-4cdc-b1b0-40e3596f06c6 (non-flash)
Aug 27 02:42:17 user nova-compute[72820]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 (non-flash)
Aug 27 02:42:17 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:42:17 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:42:17 user nova-compute[72820]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:42:17 user nova-compute[72820]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)
Aug 27 02:42:17 user nova-compute[72820]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eca8031-e36c-4cdc-b1b0-40e3596f06c6 (non-flash)
Aug 27 02:42:17 user nova-compute[72820]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 (non-flash)
Aug 27 02:42:17 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c06996c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97'): ({'sdg'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Removing single pathed devices sdg {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a025fadb-5141-4d49-908c-5c35873f6b97]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ff8de3-a3ac-4468-a9c5-95b3b6b8bbc7]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Flushing IO for device /dev/sdg {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be3003f-bc79-4c69-846c-596b165a5ea5]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.066s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6be5f5-0e7f-489a-8da2-a9f03547ed80]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] SCSI volumes sdg have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[50639098-d16d-4cad-aa92-9d488dc1aa67]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[945f39eb-3044-4589-b0d8-7b23a302a9bd]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97, portal: 172.16.0.220,3260]
Aug 27 02:42:17 user nova-compute[72820]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97, portal: 172.16.0.220,3260] successful.
Aug 27 02:42:17 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d07fb7-3532-45b6-b492-f82bb2b2cc97 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[db871b69-c425-43a3-9970-e186f147a06a]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] <== disconnect_volume: return (458ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:42:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:42:18 user nova-compute[72820]: DEBUG nova.objects.instance [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lazy-loading 'flavor' on Instance uuid dc94e6fe-575e-44a1-bf2c-a471abcbbfe7 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:42:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-67b0bf48-cbb5-4416-a183-041d5795f733 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.343s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:19 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:42:19 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:42:19 user nova-compute[72820]: DEBUG nova.compute.manager [req-82437684-32b7-441e-aa15-67d753f16f02 req-b29b2a68-b03a-4e01-9bc6-755257816766 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received event network-vif-plugged-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:42:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-82437684-32b7-441e-aa15-67d753f16f02 req-b29b2a68-b03a-4e01-9bc6-755257816766 service nova] Acquiring lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-82437684-32b7-441e-aa15-67d753f16f02 req-b29b2a68-b03a-4e01-9bc6-755257816766 service nova] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-82437684-32b7-441e-aa15-67d753f16f02 req-b29b2a68-b03a-4e01-9bc6-755257816766 service nova] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:19 user nova-compute[72820]: DEBUG nova.compute.manager [req-82437684-32b7-441e-aa15-67d753f16f02 req-b29b2a68-b03a-4e01-9bc6-755257816766 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] No waiting events found dispatching network-vif-plugged-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:42:19 user nova-compute[72820]: WARNING nova.compute.manager [req-82437684-32b7-441e-aa15-67d753f16f02 req-b29b2a68-b03a-4e01-9bc6-755257816766 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received unexpected event network-vif-plugged-44b914a9-6a23-44dc-9711-dd33dfdd276b for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 02:42:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:21 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104141.1042314, 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:42:21 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] VM Resumed (Lifecycle Event)
Aug 27 02:42:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:42:21 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:42:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:42:21 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Instance spawned successfully.
Aug 27 02:42:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:42:21 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:42:21 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104141.107759, 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:42:21 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] VM Started (Lifecycle Event)
Aug 27 02:42:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:42:21 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:42:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:42:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:42:21 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:42:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:42:22 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:42:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5a254ee-0cb4-45b8-bc51-d54f63c6ce22 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.640s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquiring lock "bd14a452-bae0-49a4-a111-24b725fd8d86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "bd14a452-bae0-49a4-a111-24b725fd8d86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquiring lock "bd14a452-bae0-49a4-a111-24b725fd8d86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "bd14a452-bae0-49a4-a111-24b725fd8d86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "bd14a452-bae0-49a4-a111-24b725fd8d86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:22 user nova-compute[72820]: INFO nova.compute.manager [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Terminating instance
Aug 27 02:42:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG nova.compute.manager [req-46b7545e-b015-43b8-a92d-1b809b6b5ea8 req-3195061c-46de-4401-99b8-998f29577db8 service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Received event network-vif-unplugged-91befba3-1374-4dde-9aa9-e05a690062fd {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46b7545e-b015-43b8-a92d-1b809b6b5ea8 req-3195061c-46de-4401-99b8-998f29577db8 service nova] Acquiring lock "bd14a452-bae0-49a4-a111-24b725fd8d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46b7545e-b015-43b8-a92d-1b809b6b5ea8 req-3195061c-46de-4401-99b8-998f29577db8 service nova] Lock "bd14a452-bae0-49a4-a111-24b725fd8d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-46b7545e-b015-43b8-a92d-1b809b6b5ea8 req-3195061c-46de-4401-99b8-998f29577db8 service nova] Lock "bd14a452-bae0-49a4-a111-24b725fd8d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG nova.compute.manager [req-46b7545e-b015-43b8-a92d-1b809b6b5ea8 req-3195061c-46de-4401-99b8-998f29577db8 service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] No waiting events found dispatching network-vif-unplugged-91befba3-1374-4dde-9aa9-e05a690062fd {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG nova.compute.manager [req-46b7545e-b015-43b8-a92d-1b809b6b5ea8 req-3195061c-46de-4401-99b8-998f29577db8 service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Received event network-vif-unplugged-91befba3-1374-4dde-9aa9-e05a690062fd for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:23 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Instance destroyed successfully.
Aug 27 02:42:23 user nova-compute[72820]: DEBUG nova.objects.instance [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lazy-loading 'resources' on Instance uuid bd14a452-bae0-49a4-a111-24b725fd8d86 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1191778356',display_name='tempest-ServersNegativeTestJSON-server-1191778356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1191778356',id=37,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:40:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0977a141ee1145b3a94c5cd60571d3d2',ramdisk_id='',reservation_id='r-3rak3qo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1999174782',owner_user_name='tempest-ServersNegativeTestJSON-1999174782-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:40:39Z,user_data=None,user_id='314d3a67dbd24abb848225eaeaa33da6',uuid=bd14a452-bae0-49a4-a111-24b725fd8d86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91befba3-1374-4dde-9aa9-e05a690062fd", "address": "fa:16:3e:cd:b0:d4", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befba3-13", "ovs_interfaceid": "91befba3-1374-4dde-9aa9-e05a690062fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Converting VIF {"id": "91befba3-1374-4dde-9aa9-e05a690062fd", "address": "fa:16:3e:cd:b0:d4", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befba3-13", "ovs_interfaceid": "91befba3-1374-4dde-9aa9-e05a690062fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b0:d4,bridge_name='br-int',has_traffic_filtering=True,id=91befba3-1374-4dde-9aa9-e05a690062fd,network=Network(5f1eaafc-a7ec-4d9d-b853-a4930adeb587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91befba3-13') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG os_vif [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b0:d4,bridge_name='br-int',has_traffic_filtering=True,id=91befba3-1374-4dde-9aa9-e05a690062fd,network=Network(5f1eaafc-a7ec-4d9d-b853-a4930adeb587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91befba3-13') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91befba3-13, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:42:23 user nova-compute[72820]: INFO os_vif [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b0:d4,bridge_name='br-int',has_traffic_filtering=True,id=91befba3-1374-4dde-9aa9-e05a690062fd,network=Network(5f1eaafc-a7ec-4d9d-b853-a4930adeb587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91befba3-13')
Aug 27 02:42:23 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Deleting instance files /opt/stack/data/nova/instances/bd14a452-bae0-49a4-a111-24b725fd8d86_del
Aug 27 02:42:23 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Deletion of /opt/stack/data/nova/instances/bd14a452-bae0-49a4-a111-24b725fd8d86_del complete
Aug 27 02:42:23 user nova-compute[72820]: INFO nova.compute.manager [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 27 02:42:23 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:42:23 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:42:24 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:42:24 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:42:24 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Took 0.74 seconds to deallocate network for instance.
Aug 27 02:42:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-3b77b06e-5532-48ec-98dc-ecf820c3a023 req-892ec14d-6ef0-4269-be8b-02b1b114019f service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Received event network-vif-deleted-91befba3-1374-4dde-9aa9-e05a690062fd {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:42:24 user nova-compute[72820]: INFO nova.compute.manager [req-3b77b06e-5532-48ec-98dc-ecf820c3a023 req-892ec14d-6ef0-4269-be8b-02b1b114019f service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Neutron deleted interface 91befba3-1374-4dde-9aa9-e05a690062fd; detaching it from the instance and deleting it from the info cache
Aug 27 02:42:24 user nova-compute[72820]: DEBUG nova.network.neutron [req-3b77b06e-5532-48ec-98dc-ecf820c3a023 req-892ec14d-6ef0-4269-be8b-02b1b114019f service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:42:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-3b77b06e-5532-48ec-98dc-ecf820c3a023 req-892ec14d-6ef0-4269-be8b-02b1b114019f service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Detach interface failed, port_id=91befba3-1374-4dde-9aa9-e05a690062fd, reason: Instance bd14a452-bae0-49a4-a111-24b725fd8d86 could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 02:42:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:24 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:42:24 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:42:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:25 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Deleted allocations for instance bd14a452-bae0-49a4-a111-24b725fd8d86
Aug 27 02:42:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-35343d1b-27fa-4cdd-acdb-4d975570df9a tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "bd14a452-bae0-49a4-a111-24b725fd8d86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.273s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:25 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:42:25 user nova-compute[72820]: DEBUG nova.compute.manager [req-0e5eeb5b-ac0b-41ed-9abb-127ee9fb813f req-d6acdb51-5988-4c05-8af0-cd8a28e08464 service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Received event network-vif-plugged-91befba3-1374-4dde-9aa9-e05a690062fd {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:42:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0e5eeb5b-ac0b-41ed-9abb-127ee9fb813f req-d6acdb51-5988-4c05-8af0-cd8a28e08464 service nova] Acquiring lock "bd14a452-bae0-49a4-a111-24b725fd8d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0e5eeb5b-ac0b-41ed-9abb-127ee9fb813f req-d6acdb51-5988-4c05-8af0-cd8a28e08464 service nova] Lock "bd14a452-bae0-49a4-a111-24b725fd8d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-0e5eeb5b-ac0b-41ed-9abb-127ee9fb813f req-d6acdb51-5988-4c05-8af0-cd8a28e08464 service nova] Lock "bd14a452-bae0-49a4-a111-24b725fd8d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:25 user nova-compute[72820]: DEBUG nova.compute.manager [req-0e5eeb5b-ac0b-41ed-9abb-127ee9fb813f req-d6acdb51-5988-4c05-8af0-cd8a28e08464 service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] No waiting events found dispatching network-vif-plugged-91befba3-1374-4dde-9aa9-e05a690062fd {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:42:25 user nova-compute[72820]: WARNING nova.compute.manager [req-0e5eeb5b-ac0b-41ed-9abb-127ee9fb813f req-d6acdb51-5988-4c05-8af0-cd8a28e08464 service nova] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Received unexpected event network-vif-plugged-91befba3-1374-4dde-9aa9-e05a690062fd for instance with vm_state deleted and task_state None.
Aug 27 02:42:26 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:42:26 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:42:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:26 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:42:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:42:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:42:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:42:27 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:28 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:42:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:29 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:42:29 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:42:29 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7484MB free_disk=25.03942108154297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:42:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:29 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:42:29 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 1591319d-3d15-4c46-b823-4edddf018b5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:42:29 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance b1a0ba95-2678-493d-87ba-061abf80887a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:42:29 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 96b0b198-aadc-44cb-a54e-9cc1a08226dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:42:29 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance dc94e6fe-575e-44a1-bf2c-a471abcbbfe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:42:29 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 937e1fae-4b49-494b-b37b-2ff4cdc8a82b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:42:29 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance c5729613-2d22-4d9a-9751-e09dca84e0d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:42:29 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 518f2efd-99dc-42fb-afdd-da6e174857d1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:42:29 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:42:29 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:42:29 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:42:29 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:42:29 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:42:29 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:42:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:32 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:42:32 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:42:32 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 02:42:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:42:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:42:32 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:42:32 user nova-compute[72820]: DEBUG nova.objects.instance [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lazy-loading 'info_cache' on Instance uuid f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:42:33 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Updating instance_info_cache with network_info: [{"id": "b330a8f4-0812-4964-bd70-10d41689406a", "address": "fa:16:3e:a4:9d:95", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb330a8f4-08", "ovs_interfaceid": "b330a8f4-0812-4964-bd70-10d41689406a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:42:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:42:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:42:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:42:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:38 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104143.7587998, bd14a452-bae0-49a4-a111-24b725fd8d86 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:42:38 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] VM Stopped (Lifecycle Event)
Aug 27 02:42:38 user nova-compute[72820]: DEBUG nova.compute.manager [None req-65864e14-ecde-4fe5-8c8a-3c9eb277159f None None] [instance: bd14a452-bae0-49a4-a111-24b725fd8d86] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:42:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "1591319d-3d15-4c46-b823-4edddf018b5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:39 user nova-compute[72820]: INFO nova.compute.manager [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Terminating instance
Aug 27 02:42:39 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:42:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-e32ac27b-8eb2-4533-a1d6-96d511c8b0b0 req-0041afa6-69a6-4ff4-bba6-7744faaed9b6 service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-unplugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:42:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e32ac27b-8eb2-4533-a1d6-96d511c8b0b0 req-0041afa6-69a6-4ff4-bba6-7744faaed9b6 service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e32ac27b-8eb2-4533-a1d6-96d511c8b0b0 req-0041afa6-69a6-4ff4-bba6-7744faaed9b6 service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e32ac27b-8eb2-4533-a1d6-96d511c8b0b0 req-0041afa6-69a6-4ff4-bba6-7744faaed9b6 service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-e32ac27b-8eb2-4533-a1d6-96d511c8b0b0 req-0041afa6-69a6-4ff4-bba6-7744faaed9b6 service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-unplugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:42:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-e32ac27b-8eb2-4533-a1d6-96d511c8b0b0 req-0041afa6-69a6-4ff4-bba6-7744faaed9b6 service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-unplugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:42:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:40 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Instance destroyed successfully.
Aug 27 02:42:40 user nova-compute[72820]: DEBUG nova.objects.instance [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'resources' on Instance uuid 1591319d-3d15-4c46-b823-4edddf018b5f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:26:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-485924818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-485924818',id=17,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f023daf1767f4088bf0a23524587e662',ramdisk_id='',reservation_id='r-pt18thix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:30:37Z,user_data=None,user_id='bb67e11ecdd648a89dd58b4bf416060a',uuid=1591319d-3d15-4c46-b823-4edddf018b5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "address": "fa:16:3e:05:00:70", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb04bdd2-29", "ovs_interfaceid": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converting VIF {"id": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "address": "fa:16:3e:05:00:70", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb04bdd2-29", "ovs_interfaceid": "db04bdd2-29ba-41ba-a78f-ab10b81ae54e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:00:70,bridge_name='br-int',has_traffic_filtering=True,id=db04bdd2-29ba-41ba-a78f-ab10b81ae54e,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb04bdd2-29') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_vif [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:00:70,bridge_name='br-int',has_traffic_filtering=True,id=db04bdd2-29ba-41ba-a78f-ab10b81ae54e,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb04bdd2-29') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb04bdd2-29, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:40 user nova-compute[72820]: INFO os_vif [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:00:70,bridge_name='br-int',has_traffic_filtering=True,id=db04bdd2-29ba-41ba-a78f-ab10b81ae54e,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb04bdd2-29')
Aug 27 02:42:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozvteOKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:42:40 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[efebf58b-7a36-4fbf-a57f-e8e049b6140d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:42:40 user nova-compute[72820]: No targets found.
Aug 27 02:42:40 user nova-compute[72820]: iSNS:
Aug 27 02:42:40 user nova-compute[72820]: No targets found.
Aug 27 02:42:40 user nova-compute[72820]: STATIC:
Aug 27 02:42:40 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5
Aug 27 02:42:40 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:42:40 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:42:40 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851
Aug 27 02:42:40 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:42:40 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:42:40 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab
Aug 27 02:42:40 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:42:40 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:42:40 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b
Aug 27 02:42:40 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:42:40 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:42:40 user nova-compute[72820]: FIRMWARE:
Aug 27 02:42:40 user nova-compute[72820]: No targets found.
Aug 27 02:42:40 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:42:40 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:42:40 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c75f672-304a-4b6b-9ef9-4b120485c4b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab68a5b-9931-493d-9f01-985ff5423352]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:42:40 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:42:40 user nova-compute[72820]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:42:40 user nova-compute[72820]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)
Aug 27 02:42:40 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 (non-flash)
Aug 27 02:42:40 user nova-compute[72820]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:42:40 user nova-compute[72820]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:42:40 user nova-compute[72820]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)
Aug 27 02:42:40 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a05e48b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851'): ({'sdf'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Removing single pathed devices sdf {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4992798b-351b-464d-9dbb-8fa7660f078b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e6bfe6-dabd-419c-980b-95fba1ed6c86]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Flushing IO for device /dev/sdf {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cd0ab9-2d78-4830-a794-98e4f9494328]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba5c0e3-7f84-4c86-b0ba-9dfe32296db7]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] SCSI volumes sdf have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e66959-d6da-4a0d-ac35-d76cc475d748]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0926fdf4-5b5e-4c3b-ad10-a2085973e74c]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851, portal: 172.16.0.220,3260]
Aug 27 02:42:40 user nova-compute[72820]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851, portal: 172.16.0.220,3260] successful.
Aug 27 02:42:40 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa627586-2d95-40aa-b153-081b588b0851 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7333ca4-d71e-44e4-92c5-269671037884]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] <== disconnect_volume: return (366ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:42:40 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Deleting instance files /opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f_del
Aug 27 02:42:40 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Deletion of /opt/stack/data/nova/instances/1591319d-3d15-4c46-b823-4edddf018b5f_del complete
Aug 27 02:42:40 user nova-compute[72820]: INFO nova.compute.manager [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 27 02:42:40 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:41 user nova-compute[72820]: DEBUG nova.compute.manager [req-e59ea82a-6c6c-4ac1-877e-8dcbae999bfd req-ad2ce025-581a-4fdf-81d4-2ffde868af5f service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:42:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e59ea82a-6c6c-4ac1-877e-8dcbae999bfd req-ad2ce025-581a-4fdf-81d4-2ffde868af5f service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e59ea82a-6c6c-4ac1-877e-8dcbae999bfd req-ad2ce025-581a-4fdf-81d4-2ffde868af5f service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e59ea82a-6c6c-4ac1-877e-8dcbae999bfd req-ad2ce025-581a-4fdf-81d4-2ffde868af5f service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:41 user nova-compute[72820]: DEBUG nova.compute.manager [req-e59ea82a-6c6c-4ac1-877e-8dcbae999bfd req-ad2ce025-581a-4fdf-81d4-2ffde868af5f service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:42:41 user nova-compute[72820]: WARNING nova.compute.manager [req-e59ea82a-6c6c-4ac1-877e-8dcbae999bfd req-ad2ce025-581a-4fdf-81d4-2ffde868af5f service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received unexpected event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with vm_state active and task_state deleting.
Aug 27 02:42:41 user nova-compute[72820]: DEBUG nova.compute.manager [req-e59ea82a-6c6c-4ac1-877e-8dcbae999bfd req-ad2ce025-581a-4fdf-81d4-2ffde868af5f service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:42:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e59ea82a-6c6c-4ac1-877e-8dcbae999bfd req-ad2ce025-581a-4fdf-81d4-2ffde868af5f service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e59ea82a-6c6c-4ac1-877e-8dcbae999bfd req-ad2ce025-581a-4fdf-81d4-2ffde868af5f service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e59ea82a-6c6c-4ac1-877e-8dcbae999bfd req-ad2ce025-581a-4fdf-81d4-2ffde868af5f service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:41 user nova-compute[72820]: DEBUG nova.compute.manager [req-e59ea82a-6c6c-4ac1-877e-8dcbae999bfd req-ad2ce025-581a-4fdf-81d4-2ffde868af5f service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:42:41 user nova-compute[72820]: WARNING nova.compute.manager [req-e59ea82a-6c6c-4ac1-877e-8dcbae999bfd req-ad2ce025-581a-4fdf-81d4-2ffde868af5f service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received unexpected event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with vm_state active and task_state deleting.
Aug 27 02:42:41 user nova-compute[72820]: DEBUG nova.compute.manager [req-e59ea82a-6c6c-4ac1-877e-8dcbae999bfd req-ad2ce025-581a-4fdf-81d4-2ffde868af5f service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:42:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e59ea82a-6c6c-4ac1-877e-8dcbae999bfd req-ad2ce025-581a-4fdf-81d4-2ffde868af5f service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e59ea82a-6c6c-4ac1-877e-8dcbae999bfd req-ad2ce025-581a-4fdf-81d4-2ffde868af5f service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e59ea82a-6c6c-4ac1-877e-8dcbae999bfd req-ad2ce025-581a-4fdf-81d4-2ffde868af5f service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:41 user nova-compute[72820]: DEBUG nova.compute.manager [req-e59ea82a-6c6c-4ac1-877e-8dcbae999bfd req-ad2ce025-581a-4fdf-81d4-2ffde868af5f service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:42:41 user nova-compute[72820]: WARNING nova.compute.manager [req-e59ea82a-6c6c-4ac1-877e-8dcbae999bfd req-ad2ce025-581a-4fdf-81d4-2ffde868af5f service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received unexpected event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with vm_state active and task_state deleting.
Aug 27 02:42:42 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:42:42 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Took 1.47 seconds to deallocate network for instance.
Aug 27 02:42:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:43 user nova-compute[72820]: INFO nova.compute.manager [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Took 0.99 seconds to detach 1 volumes for instance.
Aug 27 02:42:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:43 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:42:43 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:42:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:43 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Deleted allocations for instance 1591319d-3d15-4c46-b823-4edddf018b5f
Aug 27 02:42:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2669de8b-9234-4bbc-906e-2b27d279010c tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "1591319d-3d15-4c46-b823-4edddf018b5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.255s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:44 user nova-compute[72820]: DEBUG nova.compute.manager [req-d17d4d21-a416-476b-bef3-5ef1c4a2c018 req-eadb0804-5f71-46bf-a517-e5d62a4edb1e service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:42:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d17d4d21-a416-476b-bef3-5ef1c4a2c018 req-eadb0804-5f71-46bf-a517-e5d62a4edb1e service nova] Acquiring lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:42:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d17d4d21-a416-476b-bef3-5ef1c4a2c018 req-eadb0804-5f71-46bf-a517-e5d62a4edb1e service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:42:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d17d4d21-a416-476b-bef3-5ef1c4a2c018 req-eadb0804-5f71-46bf-a517-e5d62a4edb1e service nova] Lock "1591319d-3d15-4c46-b823-4edddf018b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:42:44 user nova-compute[72820]: DEBUG nova.compute.manager [req-d17d4d21-a416-476b-bef3-5ef1c4a2c018 req-eadb0804-5f71-46bf-a517-e5d62a4edb1e service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] No waiting events found dispatching network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:42:44 user nova-compute[72820]: WARNING nova.compute.manager [req-d17d4d21-a416-476b-bef3-5ef1c4a2c018 req-eadb0804-5f71-46bf-a517-e5d62a4edb1e service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received unexpected event network-vif-plugged-db04bdd2-29ba-41ba-a78f-ab10b81ae54e for instance with vm_state deleted and task_state None.
Aug 27 02:42:44 user nova-compute[72820]: DEBUG nova.compute.manager [req-d17d4d21-a416-476b-bef3-5ef1c4a2c018 req-eadb0804-5f71-46bf-a517-e5d62a4edb1e service nova] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Received event network-vif-deleted-db04bdd2-29ba-41ba-a78f-ab10b81ae54e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:42:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:55 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104160.3195777, 1591319d-3d15-4c46-b823-4edddf018b5f => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:42:55 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] VM Stopped (Lifecycle Event)
Aug 27 02:42:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-02573a4d-efce-4b08-81dc-36d48d831b2d None None] [instance: 1591319d-3d15-4c46-b823-4edddf018b5f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:42:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:42:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-2e9d16b4-20d1-4cbc-84e0-64e421e49a65 req-70af6113-c1b4-4b54-a713-bd10f3d3cc33 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received event network-changed-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:42:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-2e9d16b4-20d1-4cbc-84e0-64e421e49a65 req-70af6113-c1b4-4b54-a713-bd10f3d3cc33 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Refreshing instance network info cache due to event network-changed-04e6a150-9c11-4112-9d82-23e360ad145e. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:42:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2e9d16b4-20d1-4cbc-84e0-64e421e49a65 req-70af6113-c1b4-4b54-a713-bd10f3d3cc33 service nova] Acquiring lock "refresh_cache-937e1fae-4b49-494b-b37b-2ff4cdc8a82b" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:42:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2e9d16b4-20d1-4cbc-84e0-64e421e49a65 req-70af6113-c1b4-4b54-a713-bd10f3d3cc33 service nova] Acquired lock "refresh_cache-937e1fae-4b49-494b-b37b-2ff4cdc8a82b" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:42:58 user nova-compute[72820]: DEBUG nova.network.neutron [req-2e9d16b4-20d1-4cbc-84e0-64e421e49a65 req-70af6113-c1b4-4b54-a713-bd10f3d3cc33 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Refreshing network info cache for port 04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:42:59 user nova-compute[72820]: DEBUG nova.network.neutron [req-2e9d16b4-20d1-4cbc-84e0-64e421e49a65 req-70af6113-c1b4-4b54-a713-bd10f3d3cc33 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Updated VIF entry in instance network info cache for port 04e6a150-9c11-4112-9d82-23e360ad145e. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:42:59 user nova-compute[72820]: DEBUG nova.network.neutron [req-2e9d16b4-20d1-4cbc-84e0-64e421e49a65 req-70af6113-c1b4-4b54-a713-bd10f3d3cc33 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Updating instance_info_cache with network_info: [{"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:42:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2e9d16b4-20d1-4cbc-84e0-64e421e49a65 req-70af6113-c1b4-4b54-a713-bd10f3d3cc33 service nova] Releasing lock "refresh_cache-937e1fae-4b49-494b-b37b-2ff4cdc8a82b" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:42:59 user nova-compute[72820]: INFO nova.compute.manager [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Rebuilding instance
Aug 27 02:43:00 user nova-compute[72820]: DEBUG nova.compute.manager [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-ea14e522-4516-41a6-a1b7-bfc9de6267ae req-e6a4f4f1-f454-4166-bd4f-198af32a2512 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received event network-vif-unplugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ea14e522-4516-41a6-a1b7-bfc9de6267ae req-e6a4f4f1-f454-4166-bd4f-198af32a2512 service nova] Acquiring lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ea14e522-4516-41a6-a1b7-bfc9de6267ae req-e6a4f4f1-f454-4166-bd4f-198af32a2512 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ea14e522-4516-41a6-a1b7-bfc9de6267ae req-e6a4f4f1-f454-4166-bd4f-198af32a2512 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-ea14e522-4516-41a6-a1b7-bfc9de6267ae req-e6a4f4f1-f454-4166-bd4f-198af32a2512 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] No waiting events found dispatching network-vif-unplugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:43:00 user nova-compute[72820]: WARNING nova.compute.manager [req-ea14e522-4516-41a6-a1b7-bfc9de6267ae req-e6a4f4f1-f454-4166-bd4f-198af32a2512 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received unexpected event network-vif-unplugged-04e6a150-9c11-4112-9d82-23e360ad145e for instance with vm_state active and task_state rebuilding.
Aug 27 02:43:00 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Instance destroyed successfully.
Aug 27 02:43:00 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Instance destroyed successfully.
Aug 27 02:43:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-461244386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1719587291',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL4xAW1yqP6Coj+hhVCS5IQNbL8oxWGaJMLhXbiMUMXUf8cKxypJ/lvgX61mLhj54rUE2+oPLqoH07Bp4DB/o2rEWFebI2x+kpnvVVRoO/4DZPpY3FT3cyl8sodoL2efw==',key_name='tempest-keypair-158688571',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:41:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ad16025d31445e4bc439e5e9b1bc1f0',ramdisk_id='',reservation_id='r-q8lxoffq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1903594173',owner_user_name='tempest-ServerActionsV293TestJSON-1903594173-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:43:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='983d52ab60604e21a675cca739977e8c',uuid=937e1fae-4b49-494b-b37b-2ff4cdc8a82b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Converting VIF {"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:66:0b,bridge_name='br-int',has_traffic_filtering=True,id=04e6a150-9c11-4112-9d82-23e360ad145e,network=Network(73446049-4923-430b-a2d6-af3ed8feb088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e6a150-9c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG os_vif [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:66:0b,bridge_name='br-int',has_traffic_filtering=True,id=04e6a150-9c11-4112-9d82-23e360ad145e,network=Network(73446049-4923-430b-a2d6-af3ed8feb088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e6a150-9c') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04e6a150-9c, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:00 user nova-compute[72820]: INFO os_vif [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:66:0b,bridge_name='br-int',has_traffic_filtering=True,id=04e6a150-9c11-4112-9d82-23e360ad145e,network=Network(73446049-4923-430b-a2d6-af3ed8feb088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e6a150-9c')
Aug 27 02:43:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxwLdQIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:43:00 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 02:43:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b82240-f54a-4933-a87b-d62e79fd3080]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:43:00 user nova-compute[72820]: No targets found.
Aug 27 02:43:00 user nova-compute[72820]: iSNS:
Aug 27 02:43:00 user nova-compute[72820]: No targets found.
Aug 27 02:43:00 user nova-compute[72820]: STATIC:
Aug 27 02:43:00 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5
Aug 27 02:43:00 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:43:00 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:43:00 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab
Aug 27 02:43:00 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:43:00 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:43:00 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b
Aug 27 02:43:00 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:43:00 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:43:00 user nova-compute[72820]: FIRMWARE:
Aug 27 02:43:00 user nova-compute[72820]: No targets found.
Aug 27 02:43:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:43:00 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:43:00 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b784a83-7307-4cb2-b5a2-75a3094d57a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafc3d64-2e4f-477e-bd32-34b8bb18e963]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:43:00 user nova-compute[72820]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:43:00 user nova-compute[72820]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)
Aug 27 02:43:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:43:00 user nova-compute[72820]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:43:00 user nova-compute[72820]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)
Aug 27 02:43:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c05fa9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab'): ({'sdc'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Removing single pathed devices sdc {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2666ecfb-a28f-479d-b570-72bc5b1b7cfb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4950fd6f-a7a3-4624-8e95-f4f856230bc7]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Flushing IO for device /dev/sdc {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:43:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[40eb066b-26e1-4202-a850-d66642945e67]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef83813d-6f75-4de3-99e4-7a695fcb37e0]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c8f259b5', '/dev/disk/by-id/scsi-1SCST_BIOc8f259b5-9360e744d001911f', '/dev/disk/by-id/scsi-23933363065373434') {{(pid=84057) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 02:43:01 user nova-compute[72820]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_c8f259b5
Aug 27 02:43:01 user nova-compute[72820]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOc8f259b5-9360e744d001911f
Aug 27 02:43:01 user nova-compute[72820]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23933363065373434
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5581cc6-ed7b-45c8-89b9-e9c17ab224ab]: (4, None) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11a1a58-b2e8-4ae2-b917-293e4029776b]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d61ee39-a287-4e02-a2c2-f25b3bae3813]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab, portal: 172.16.0.220,3260]
Aug 27 02:43:01 user nova-compute[72820]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab, portal: 172.16.0.220,3260] successful.
Aug 27 02:43:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11d570f-8b43-4592-afeb-7521a0768651]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] <== disconnect_volume: return (321ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:43:01 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Deleting instance files /opt/stack/data/nova/instances/937e1fae-4b49-494b-b37b-2ff4cdc8a82b_del
Aug 27 02:43:01 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Deletion of /opt/stack/data/nova/instances/937e1fae-4b49-494b-b37b-2ff4cdc8a82b_del complete
Aug 27 02:43:01 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 937e1fae-4b49-494b-b37b-2ff4cdc8a82b could not be found.
Aug 27 02:43:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxwLdQIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:43:01 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd32d3b-baed-423b-9b26-cac68c65363f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:43:01 user nova-compute[72820]: No targets found.
Aug 27 02:43:01 user nova-compute[72820]: iSNS:
Aug 27 02:43:01 user nova-compute[72820]: No targets found.
Aug 27 02:43:01 user nova-compute[72820]: STATIC:
Aug 27 02:43:01 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5
Aug 27 02:43:01 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:43:01 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:43:01 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b
Aug 27 02:43:01 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:43:01 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:43:01 user nova-compute[72820]: FIRMWARE:
Aug 27 02:43:01 user nova-compute[72820]: No targets found.
Aug 27 02:43:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:43:01 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:43:01 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f83c0c0-fd50-4c76-8dfa-96851d53e23f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2aec411-5188-408e-b9b0-76c5e166618a]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:43:01 user nova-compute[72820]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)
Aug 27 02:43:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:43:01 user nova-compute[72820]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)
Aug 27 02:43:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a0422e60>, {}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Disconnecting from: [] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] <== disconnect_volume: return (71ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:43:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:43:02 user nova-compute[72820]: DEBUG nova.compute.manager [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Preparing to wait for external event volume-reimaged-69166b6a-56d7-4e8d-9c76-c633f5035aab {{(pid=72820) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 27 02:43:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Acquiring lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:02 user nova-compute[72820]: DEBUG nova.compute.manager [req-6e6f4979-4ab5-4510-ba79-063e1aa963ca req-1ec615f0-5551-4499-bbc0-dd89cfe8324a service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received event network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6e6f4979-4ab5-4510-ba79-063e1aa963ca req-1ec615f0-5551-4499-bbc0-dd89cfe8324a service nova] Acquiring lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6e6f4979-4ab5-4510-ba79-063e1aa963ca req-1ec615f0-5551-4499-bbc0-dd89cfe8324a service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6e6f4979-4ab5-4510-ba79-063e1aa963ca req-1ec615f0-5551-4499-bbc0-dd89cfe8324a service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:02 user nova-compute[72820]: DEBUG nova.compute.manager [req-6e6f4979-4ab5-4510-ba79-063e1aa963ca req-1ec615f0-5551-4499-bbc0-dd89cfe8324a service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] No event matching network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e in dict_keys([('volume-reimaged', '69166b6a-56d7-4e8d-9c76-c633f5035aab')]) {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 27 02:43:02 user nova-compute[72820]: WARNING nova.compute.manager [req-6e6f4979-4ab5-4510-ba79-063e1aa963ca req-1ec615f0-5551-4499-bbc0-dd89cfe8324a service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received unexpected event network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e for instance with vm_state active and task_state rebuilding.
Aug 27 02:43:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-271dd5fb-ce8b-4fd2-b4e8-528aab5346af req-18a40c6c-99c1-405e-a6cb-3d486bf31f9b service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Received event network-changed-29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-271dd5fb-ce8b-4fd2-b4e8-528aab5346af req-18a40c6c-99c1-405e-a6cb-3d486bf31f9b service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Refreshing instance network info cache due to event network-changed-29272dca-3ab8-4b49-8d58-a85d831942ef. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:43:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-271dd5fb-ce8b-4fd2-b4e8-528aab5346af req-18a40c6c-99c1-405e-a6cb-3d486bf31f9b service nova] Acquiring lock "refresh_cache-c5729613-2d22-4d9a-9751-e09dca84e0d6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:43:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-271dd5fb-ce8b-4fd2-b4e8-528aab5346af req-18a40c6c-99c1-405e-a6cb-3d486bf31f9b service nova] Acquired lock "refresh_cache-c5729613-2d22-4d9a-9751-e09dca84e0d6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:43:11 user nova-compute[72820]: DEBUG nova.network.neutron [req-271dd5fb-ce8b-4fd2-b4e8-528aab5346af req-18a40c6c-99c1-405e-a6cb-3d486bf31f9b service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Refreshing network info cache for port 29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:43:12 user nova-compute[72820]: DEBUG nova.network.neutron [req-271dd5fb-ce8b-4fd2-b4e8-528aab5346af req-18a40c6c-99c1-405e-a6cb-3d486bf31f9b service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Updated VIF entry in instance network info cache for port 29272dca-3ab8-4b49-8d58-a85d831942ef. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:43:12 user nova-compute[72820]: DEBUG nova.network.neutron [req-271dd5fb-ce8b-4fd2-b4e8-528aab5346af req-18a40c6c-99c1-405e-a6cb-3d486bf31f9b service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Updating instance_info_cache with network_info: [{"id": "29272dca-3ab8-4b49-8d58-a85d831942ef", "address": "fa:16:3e:f1:32:45", "network": {"id": "a99debd2-2312-4c82-b0d1-d36eab74a9fb", "bridge": "br-int", "label": "tempest-TestStampPattern-1906437798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aac51df4fd73435c81b9f3037a5916c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29272dca-3a", "ovs_interfaceid": "29272dca-3ab8-4b49-8d58-a85d831942ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:43:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-271dd5fb-ce8b-4fd2-b4e8-528aab5346af req-18a40c6c-99c1-405e-a6cb-3d486bf31f9b service nova] Releasing lock "refresh_cache-c5729613-2d22-4d9a-9751-e09dca84e0d6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:43:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Acquiring lock "c5729613-2d22-4d9a-9751-e09dca84e0d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:13 user nova-compute[72820]: DEBUG nova.objects.instance [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lazy-loading 'flavor' on Instance uuid c5729613-2d22-4d9a-9751-e09dca84e0d6 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:43:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Acquiring lock "c5729613-2d22-4d9a-9751-e09dca84e0d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:13 user nova-compute[72820]: INFO nova.compute.manager [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Attaching volume 2ae27a40-da73-4bca-9177-e9c10c3bd501 to /dev/vdb
Aug 27 02:43:13 user nova-compute[72820]: DEBUG os_brick.utils [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:43:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da54ad2-7c57-4298-89fe-2395a70ec2b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c127d9cf-11b3-4341-8cf0-5fd3d7e73d36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a745d0b8-630c-4c1a-8bff-8e974acaadb3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[09de14a0-d404-4124-bdba-228de6c8901e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:43:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:43:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:43:14 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:43:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed380b1-c339-442a-8960-dbb0a433d6d0]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:43:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:43:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:43:14 user nova-compute[72820]: DEBUG os_brick.utils [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:43:14 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Updating existing volume attachment record: 39de1998-4959-48b5-84f0-008921189644 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:43:15 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104180.8290975, 937e1fae-4b49-494b-b37b-2ff4cdc8a82b => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:43:15 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] VM Stopped (Lifecycle Event)
Aug 27 02:43:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:15 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3cbf520f-189b-475f-b3ad-affbb10ef6f4 None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:43:17 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:43:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Acquiring lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Acquiring lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:17 user nova-compute[72820]: INFO nova.compute.manager [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Terminating instance
Aug 27 02:43:17 user nova-compute[72820]: DEBUG nova.compute.manager [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG nova.compute.manager [req-64b73136-cb03-4f6a-9ab3-4ffa73689878 req-55d1e570-f86d-42f2-803b-9527294d76bb service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Received event network-vif-unplugged-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-64b73136-cb03-4f6a-9ab3-4ffa73689878 req-55d1e570-f86d-42f2-803b-9527294d76bb service nova] Acquiring lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-64b73136-cb03-4f6a-9ab3-4ffa73689878 req-55d1e570-f86d-42f2-803b-9527294d76bb service nova] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-64b73136-cb03-4f6a-9ab3-4ffa73689878 req-55d1e570-f86d-42f2-803b-9527294d76bb service nova] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG nova.compute.manager [req-64b73136-cb03-4f6a-9ab3-4ffa73689878 req-55d1e570-f86d-42f2-803b-9527294d76bb service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] No waiting events found dispatching network-vif-unplugged-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG nova.compute.manager [req-64b73136-cb03-4f6a-9ab3-4ffa73689878 req-55d1e570-f86d-42f2-803b-9527294d76bb service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Received event network-vif-unplugged-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:18 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Instance destroyed successfully.
Aug 27 02:43:18 user nova-compute[72820]: DEBUG nova.objects.instance [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lazy-loading 'resources' on Instance uuid dc94e6fe-575e-44a1-bf2c-a471abcbbfe7 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1025065636',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1025065636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1025065',id=36,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrRUwD26sBtNnmuf/cpDBlFLiKDz9epWhUxJ88pOSz541DQuZOXokwoK6I0IjbIizk/Pl9LdFWTgmlM3wxyLHxYKc/wMMx+S3pOKlSf3QB/mGV4A7nBHZJt1/iqHSSqYQ==',key_name='tempest-keypair-1499900525',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:40:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce56ca2340b84b4785f0f8132f15296b',ramdisk_id='',reservation_id='r-656hfzov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1778950119',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:40:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33e98854926f4e1580b450ad5debdce3',uuid=dc94e6fe-575e-44a1-bf2c-a471abcbbfe7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "address": "fa:16:3e:a3:f9:24", "network": {"id": "f4a9038d-1157-4fde-86e7-fb932a428e31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1722086374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce56ca2340b84b4785f0f8132f15296b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba5dbcd-5f", "ovs_interfaceid": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Converting VIF {"id": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "address": "fa:16:3e:a3:f9:24", "network": {"id": "f4a9038d-1157-4fde-86e7-fb932a428e31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1722086374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce56ca2340b84b4785f0f8132f15296b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba5dbcd-5f", "ovs_interfaceid": "8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:f9:24,bridge_name='br-int',has_traffic_filtering=True,id=8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a,network=Network(f4a9038d-1157-4fde-86e7-fb932a428e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba5dbcd-5f') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG os_vif [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:f9:24,bridge_name='br-int',has_traffic_filtering=True,id=8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a,network=Network(f4a9038d-1157-4fde-86e7-fb932a428e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba5dbcd-5f') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ba5dbcd-5f, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:18 user nova-compute[72820]: INFO os_vif [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:f9:24,bridge_name='br-int',has_traffic_filtering=True,id=8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a,network=Network(f4a9038d-1157-4fde-86e7-fb932a428e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba5dbcd-5f')
Aug 27 02:43:18 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Deleting instance files /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7_del
Aug 27 02:43:18 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Deletion of /opt/stack/data/nova/instances/dc94e6fe-575e-44a1-bf2c-a471abcbbfe7_del complete
Aug 27 02:43:18 user nova-compute[72820]: INFO nova.compute.manager [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 27 02:43:18 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:43:18 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:43:19 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:43:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:20 user nova-compute[72820]: DEBUG nova.compute.manager [req-f5e30f56-894b-47f9-80ad-6b6abfcf55d9 req-aea8e1ed-baf7-4a07-b01e-632e8994e6bc service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Received event network-vif-plugged-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f5e30f56-894b-47f9-80ad-6b6abfcf55d9 req-aea8e1ed-baf7-4a07-b01e-632e8994e6bc service nova] Acquiring lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f5e30f56-894b-47f9-80ad-6b6abfcf55d9 req-aea8e1ed-baf7-4a07-b01e-632e8994e6bc service nova] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f5e30f56-894b-47f9-80ad-6b6abfcf55d9 req-aea8e1ed-baf7-4a07-b01e-632e8994e6bc service nova] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:20 user nova-compute[72820]: DEBUG nova.compute.manager [req-f5e30f56-894b-47f9-80ad-6b6abfcf55d9 req-aea8e1ed-baf7-4a07-b01e-632e8994e6bc service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] No waiting events found dispatching network-vif-plugged-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:43:20 user nova-compute[72820]: WARNING nova.compute.manager [req-f5e30f56-894b-47f9-80ad-6b6abfcf55d9 req-aea8e1ed-baf7-4a07-b01e-632e8994e6bc service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Received unexpected event network-vif-plugged-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a for instance with vm_state active and task_state deleting.
Aug 27 02:43:20 user nova-compute[72820]: DEBUG nova.compute.manager [req-f5e30f56-894b-47f9-80ad-6b6abfcf55d9 req-aea8e1ed-baf7-4a07-b01e-632e8994e6bc service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Received event network-vif-plugged-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f5e30f56-894b-47f9-80ad-6b6abfcf55d9 req-aea8e1ed-baf7-4a07-b01e-632e8994e6bc service nova] Acquiring lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f5e30f56-894b-47f9-80ad-6b6abfcf55d9 req-aea8e1ed-baf7-4a07-b01e-632e8994e6bc service nova] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f5e30f56-894b-47f9-80ad-6b6abfcf55d9 req-aea8e1ed-baf7-4a07-b01e-632e8994e6bc service nova] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:20 user nova-compute[72820]: DEBUG nova.compute.manager [req-f5e30f56-894b-47f9-80ad-6b6abfcf55d9 req-aea8e1ed-baf7-4a07-b01e-632e8994e6bc service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] No waiting events found dispatching network-vif-plugged-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:43:20 user nova-compute[72820]: WARNING nova.compute.manager [req-f5e30f56-894b-47f9-80ad-6b6abfcf55d9 req-aea8e1ed-baf7-4a07-b01e-632e8994e6bc service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Received unexpected event network-vif-plugged-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a for instance with vm_state active and task_state deleting.
Aug 27 02:43:21 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:43:21 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Took 2.16 seconds to deallocate network for instance.
Aug 27 02:43:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:21 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:43:21 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:43:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:43:21 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:43:21 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:43:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.678s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:21 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Deleted allocations for instance dc94e6fe-575e-44a1-bf2c-a471abcbbfe7
Aug 27 02:43:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "518f2efd-99dc-42fb-afdd-da6e174857d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "518f2efd-99dc-42fb-afdd-da6e174857d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "518f2efd-99dc-42fb-afdd-da6e174857d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "518f2efd-99dc-42fb-afdd-da6e174857d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "518f2efd-99dc-42fb-afdd-da6e174857d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:21 user nova-compute[72820]: INFO nova.compute.manager [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Terminating instance
Aug 27 02:43:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-709d2434-63a7-40a9-b9c1-78e75247e065 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119 tempest-TestServerVolumeAttachScenarioOldVersion-1778950119-project-member] Lock "dc94e6fe-575e-44a1-bf2c-a471abcbbfe7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.063s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-a4ba9ab9-508f-4312-b4ab-52e15267d3ed req-2c5057a8-89fa-4efc-9c9d-cde753fff518 service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Received event network-vif-unplugged-75680cbe-4346-4821-a887-7dec1340d2e9 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a4ba9ab9-508f-4312-b4ab-52e15267d3ed req-2c5057a8-89fa-4efc-9c9d-cde753fff518 service nova] Acquiring lock "518f2efd-99dc-42fb-afdd-da6e174857d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a4ba9ab9-508f-4312-b4ab-52e15267d3ed req-2c5057a8-89fa-4efc-9c9d-cde753fff518 service nova] Lock "518f2efd-99dc-42fb-afdd-da6e174857d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a4ba9ab9-508f-4312-b4ab-52e15267d3ed req-2c5057a8-89fa-4efc-9c9d-cde753fff518 service nova] Lock "518f2efd-99dc-42fb-afdd-da6e174857d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-a4ba9ab9-508f-4312-b4ab-52e15267d3ed req-2c5057a8-89fa-4efc-9c9d-cde753fff518 service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] No waiting events found dispatching network-vif-unplugged-75680cbe-4346-4821-a887-7dec1340d2e9 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-a4ba9ab9-508f-4312-b4ab-52e15267d3ed req-2c5057a8-89fa-4efc-9c9d-cde753fff518 service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Received event network-vif-unplugged-75680cbe-4346-4821-a887-7dec1340d2e9 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-41406361-8a79-4660-a0e6-8c0be9d37fec req-d031ce0f-7e9f-49d9-b9ae-3da2f20b2ef7 service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Received event network-changed-75680cbe-4346-4821-a887-7dec1340d2e9 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-41406361-8a79-4660-a0e6-8c0be9d37fec req-d031ce0f-7e9f-49d9-b9ae-3da2f20b2ef7 service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Refreshing instance network info cache due to event network-changed-75680cbe-4346-4821-a887-7dec1340d2e9. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-41406361-8a79-4660-a0e6-8c0be9d37fec req-d031ce0f-7e9f-49d9-b9ae-3da2f20b2ef7 service nova] Acquiring lock "refresh_cache-518f2efd-99dc-42fb-afdd-da6e174857d1" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-41406361-8a79-4660-a0e6-8c0be9d37fec req-d031ce0f-7e9f-49d9-b9ae-3da2f20b2ef7 service nova] Acquired lock "refresh_cache-518f2efd-99dc-42fb-afdd-da6e174857d1" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG nova.network.neutron [req-41406361-8a79-4660-a0e6-8c0be9d37fec req-d031ce0f-7e9f-49d9-b9ae-3da2f20b2ef7 service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Refreshing network info cache for port 75680cbe-4346-4821-a887-7dec1340d2e9 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:43:22 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Instance destroyed successfully.
Aug 27 02:43:22 user nova-compute[72820]: DEBUG nova.objects.instance [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lazy-loading 'resources' on Instance uuid 518f2efd-99dc-42fb-afdd-da6e174857d1 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-80109924',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-80109924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-80109924',id=40,image_ref='e7691d68-6948-421d-adaf-b55c3c3241b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKboPXnG/ryIeax3Mg85PsNYitSiD9WxpPgzUHxiYOiNxUoZYS8LCY1vNtK/d/bq4lWZtZirVJsZIMDIcy3QxeFvKSKDiIQj2XrgMj7rVh9Stkv8v5eEYib/sOFxXPa6OQ==',key_name='tempest-keypair-860138360',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:41:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84f02ddcfa2b4571a4d7cacf1287aebd',ramdisk_id='',reservation_id='r-0jngs4r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-631676638',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-631676638',owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:41:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='878038feacda4094b5d2c9e3814c8bf0',uuid=518f2efd-99dc-42fb-afdd-da6e174857d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75680cbe-4346-4821-a887-7dec1340d2e9", "address": "fa:16:3e:42:58:5b", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75680cbe-43", "ovs_interfaceid": "75680cbe-4346-4821-a887-7dec1340d2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converting VIF {"id": "75680cbe-4346-4821-a887-7dec1340d2e9", "address": "fa:16:3e:42:58:5b", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75680cbe-43", "ovs_interfaceid": "75680cbe-4346-4821-a887-7dec1340d2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:58:5b,bridge_name='br-int',has_traffic_filtering=True,id=75680cbe-4346-4821-a887-7dec1340d2e9,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75680cbe-43') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG os_vif [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:58:5b,bridge_name='br-int',has_traffic_filtering=True,id=75680cbe-4346-4821-a887-7dec1340d2e9,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75680cbe-43') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75680cbe-43, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:43:22 user nova-compute[72820]: INFO os_vif [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:58:5b,bridge_name='br-int',has_traffic_filtering=True,id=75680cbe-4346-4821-a887-7dec1340d2e9,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75680cbe-43')
Aug 27 02:43:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SsDHevFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:43:22 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:43:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4673a991-aef5-4a8d-a774-fa28de8666b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:43:22 user nova-compute[72820]: No targets found.
Aug 27 02:43:22 user nova-compute[72820]: iSNS:
Aug 27 02:43:22 user nova-compute[72820]: No targets found.
Aug 27 02:43:22 user nova-compute[72820]: STATIC:
Aug 27 02:43:22 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5
Aug 27 02:43:22 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:43:22 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:43:22 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab
Aug 27 02:43:22 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:43:22 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:43:22 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b
Aug 27 02:43:22 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:43:22 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:43:22 user nova-compute[72820]: FIRMWARE:
Aug 27 02:43:22 user nova-compute[72820]: No targets found.
Aug 27 02:43:22 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:43:22 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:43:22 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b70e6a-667e-48dc-90e6-af96ce370bed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dd8a36-74d9-4d4b-9ff1-7512f1b364c6]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:43:22 user nova-compute[72820]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)
Aug 27 02:43:22 user nova-compute[72820]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:43:22 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:43:22 user nova-compute[72820]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 (non-flash)
Aug 27 02:43:22 user nova-compute[72820]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:43:22 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c02ec790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5'): ({'sdd'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Removing single pathed devices sdd {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6108b2e6-4996-45d7-9130-8e43d99ed40b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9564c61b-e1a2-4bea-8e62-ed0e332feec0]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Flushing IO for device /dev/sdd {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e9477e-0c95-41c7-b61a-6b0b530e1f37]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:43:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98e1e39-8699-4869-a235-d127228194f3]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO33cdec42-a701aa2a6b5dc74b', '/dev/disk/by-id/scsi-26137303161613261', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_33cdec42') {{(pid=84057) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[00775524-4aa0-490b-818a-aae61ed8760f]: (4, None) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.107s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[71efa9d2-fd63-4664-8e04-c366d3cc3d4f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG nova.network.neutron [req-41406361-8a79-4660-a0e6-8c0be9d37fec req-d031ce0f-7e9f-49d9-b9ae-3da2f20b2ef7 service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Updated VIF entry in instance network info cache for port 75680cbe-4346-4821-a887-7dec1340d2e9. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG nova.network.neutron [req-41406361-8a79-4660-a0e6-8c0be9d37fec req-d031ce0f-7e9f-49d9-b9ae-3da2f20b2ef7 service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Updating instance_info_cache with network_info: [{"id": "75680cbe-4346-4821-a887-7dec1340d2e9", "address": "fa:16:3e:42:58:5b", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75680cbe-43", "ovs_interfaceid": "75680cbe-4346-4821-a887-7dec1340d2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.203s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e7e5a6-300c-407d-9cd9-5259ea63a885]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5, portal: 172.16.0.220,3260]
Aug 27 02:43:23 user nova-compute[72820]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5, portal: 172.16.0.220,3260] successful.
Aug 27 02:43:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-41406361-8a79-4660-a0e6-8c0be9d37fec req-d031ce0f-7e9f-49d9-b9ae-3da2f20b2ef7 service nova] Releasing lock "refresh_cache-518f2efd-99dc-42fb-afdd-da6e174857d1" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG nova.compute.manager [req-41406361-8a79-4660-a0e6-8c0be9d37fec req-d031ce0f-7e9f-49d9-b9ae-3da2f20b2ef7 service nova] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Received event network-vif-deleted-8ba5dbcd-5f6c-4f9b-aadb-972ff4ef5e3a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef1ac523-a563-4f36-88a9-d0667d7f3af5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b79689d-11ba-4070-b7c7-5e80403b63c8]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.561s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] <== disconnect_volume: return (563ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:43:23 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Deleting instance files /opt/stack/data/nova/instances/518f2efd-99dc-42fb-afdd-da6e174857d1_del
Aug 27 02:43:23 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Deletion of /opt/stack/data/nova/instances/518f2efd-99dc-42fb-afdd-da6e174857d1_del complete
Aug 27 02:43:23 user nova-compute[72820]: INFO nova.compute.manager [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Took 1.58 seconds to destroy the instance on the hypervisor.
Aug 27 02:43:23 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:43:23 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:43:24 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:43:24 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:43:24 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Took 0.89 seconds to deallocate network for instance.
Aug 27 02:43:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-bbab08aa-7e9b-464f-9265-55d31cabd777 req-28446416-04d6-4106-863d-95c5f2f3b62f service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Received event network-vif-plugged-75680cbe-4346-4821-a887-7dec1340d2e9 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bbab08aa-7e9b-464f-9265-55d31cabd777 req-28446416-04d6-4106-863d-95c5f2f3b62f service nova] Acquiring lock "518f2efd-99dc-42fb-afdd-da6e174857d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bbab08aa-7e9b-464f-9265-55d31cabd777 req-28446416-04d6-4106-863d-95c5f2f3b62f service nova] Lock "518f2efd-99dc-42fb-afdd-da6e174857d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-bbab08aa-7e9b-464f-9265-55d31cabd777 req-28446416-04d6-4106-863d-95c5f2f3b62f service nova] Lock "518f2efd-99dc-42fb-afdd-da6e174857d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-bbab08aa-7e9b-464f-9265-55d31cabd777 req-28446416-04d6-4106-863d-95c5f2f3b62f service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] No waiting events found dispatching network-vif-plugged-75680cbe-4346-4821-a887-7dec1340d2e9 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:43:24 user nova-compute[72820]: WARNING nova.compute.manager [req-bbab08aa-7e9b-464f-9265-55d31cabd777 req-28446416-04d6-4106-863d-95c5f2f3b62f service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Received unexpected event network-vif-plugged-75680cbe-4346-4821-a887-7dec1340d2e9 for instance with vm_state active and task_state deleting.
Aug 27 02:43:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-e0a21618-8e02-4ab1-beb2-680798b00965 req-e6e78f17-0329-47be-a628-b6fd28ffb182 service nova] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Received event network-vif-deleted-75680cbe-4346-4821-a887-7dec1340d2e9 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.volume.cinder [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Update attachment failed for attachment 39de1998-4959-48b5-84f0-008921189644. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:2ae27a40-da73-4bca-9177-e9c10c3bd501 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:2ae27a40-da73-4bca-9177-e9c10c3bd501/luns failed with code: 500 of type:Unknown reason:Unknown.).). (HTTP 500) (Request-ID: req-86829761-6dd0-4b67-9a8e-e57c5f85c0b0) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:2ae27a40-da73-4bca-9177-e9c10c3bd501 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:2ae27a40-da73-4bca-9177-e9c10c3bd501/luns failed with code: 500 of type:Unknown reason:Unknown.).). (HTTP 500) (Request-ID: req-86829761-6dd0-4b67-9a8e-e57c5f85c0b0)
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Failed to attach 2ae27a40-da73-4bca-9177-e9c10c3bd501 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:2ae27a40-da73-4bca-9177-e9c10c3bd501 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:2ae27a40-da73-4bca-9177-e9c10c3bd501/luns failed with code: 500 of type:Unknown reason:Unknown.).). (HTTP 500) (Request-ID: req-86829761-6dd0-4b67-9a8e-e57c5f85c0b0)
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Traceback (most recent call last):
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]     ret_val = method(obj, context, *args, **kwargs)
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]     self._do_attach(context, instance, volume, volume_api,
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]     self._volume_attach(context, volume, connector, instance,
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]     connection_info = volume_api.attachment_update(
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]     res = method(self, ctx, *args, **kwargs)
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]     with excutils.save_and_reraise_exception():
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]     self.force_reraise()
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]     raise self.value
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]     context, '3.44', skip_version_check=True).attachments.update(
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]     return method.func(obj, *args, **kwargs)
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]     resp = self._update('/attachments/%s' % id, body)
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]     return self._cs_request(url, 'PUT', **kwargs)
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]     return self.request(url, method, **kwargs)
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6]     raise exceptions.from_response(resp, body)
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:2ae27a40-da73-4bca-9177-e9c10c3bd501 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:2ae27a40-da73-4bca-9177-e9c10c3bd501/luns failed with code: 500 of type:Unknown reason:Unknown.).). (HTTP 500) (Request-ID: req-86829761-6dd0-4b67-9a8e-e57c5f85c0b0)
Aug 27 02:43:24 user nova-compute[72820]: ERROR nova.compute.manager [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] 
Aug 27 02:43:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.074s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 req-39d11729-5189-4e8e-ac9e-2ca3213b9be3 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received event volume-reimaged-69166b6a-56d7-4e8d-9c76-c633f5035aab {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 req-39d11729-5189-4e8e-ac9e-2ca3213b9be3 service nova] Acquiring lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 req-39d11729-5189-4e8e-ac9e-2ca3213b9be3 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 req-39d11729-5189-4e8e-ac9e-2ca3213b9be3 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 req-39d11729-5189-4e8e-ac9e-2ca3213b9be3 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Processing event volume-reimaged-69166b6a-56d7-4e8d-9c76-c633f5035aab {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 27 02:43:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Instance event wait completed in 22 seconds for volume-reimaged {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:43:25 user nova-compute[72820]: INFO nova.virt.block_device [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Booting with volume 69166b6a-56d7-4e8d-9c76-c633f5035aab at /dev/vda
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server [None req-15f0c630-31c8-48b0-aa6c-a0ec4128b8bf tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:2ae27a40-da73-4bca-9177-e9c10c3bd501 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:2ae27a40-da73-4bca-9177-e9c10c3bd501/luns failed with code: 500 of type:Unknown reason:Unknown.).). (HTTP 500) (Request-ID: req-86829761-6dd0-4b67-9a8e-e57c5f85c0b0)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:2ae27a40-da73-4bca-9177-e9c10c3bd501 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:2ae27a40-da73-4bca-9177-e9c10c3bd501/luns failed with code: 500 of type:Unknown reason:Unknown.).). (HTTP 500) (Request-ID: req-86829761-6dd0-4b67-9a8e-e57c5f85c0b0)
Aug 27 02:43:25 user nova-compute[72820]: ERROR oslo_messaging.rpc.server 
Aug 27 02:43:25 user nova-compute[72820]: DEBUG os_brick.utils [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[664c1009-07de-430a-9ff0-016cf816c18c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0406cb8b-67bd-471e-9529-c2b3df371de8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aba612e-3448-485a-bc29-573e9c03eba5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b327ce0-484a-4f50-b511-94e6fcb1ee5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:43:25 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:43:25 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[404dfe9f-754d-4f87-9601-fda0f4effe66]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG os_brick.utils [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Updating existing volume attachment record: eada33f3-eaf7-432b-b1b7-26b0cb3919ce {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:43:25 user nova-compute[72820]: INFO nova.compute.manager [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Took 1.09 seconds to detach 1 volumes for instance.
Aug 27 02:43:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Deleting volume: ef1ac523-a563-4f36-88a9-d0667d7f3af5 {{(pid=72820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:43:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:25 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Deleted allocations for instance 518f2efd-99dc-42fb-afdd-da6e174857d1
Aug 27 02:43:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c416fa92-61ba-48f0-8539-891ef69d1ba2 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "518f2efd-99dc-42fb-afdd-da6e174857d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.086s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:27 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:43:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:28 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:43:28 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:43:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:28 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:43:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:28 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:29 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:43:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:30 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:43:30 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:43:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=7981MB free_disk=25.064369201660156GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:30 user nova-compute[72820]: INFO nova.compute.manager [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Terminating instance
Aug 27 02:43:30 user nova-compute[72820]: DEBUG nova.compute.manager [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance b1a0ba95-2678-493d-87ba-061abf80887a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 96b0b198-aadc-44cb-a54e-9cc1a08226dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 937e1fae-4b49-494b-b37b-2ff4cdc8a82b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance c5729613-2d22-4d9a-9751-e09dca84e0d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-158fef03-5fe5-4599-8945-2d8bb18a4fe3 req-7026a18b-c07c-42ab-9add-b0f5a91941bf service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Received event network-vif-unplugged-b330a8f4-0812-4964-bd70-10d41689406a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-158fef03-5fe5-4599-8945-2d8bb18a4fe3 req-7026a18b-c07c-42ab-9add-b0f5a91941bf service nova] Acquiring lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-158fef03-5fe5-4599-8945-2d8bb18a4fe3 req-7026a18b-c07c-42ab-9add-b0f5a91941bf service nova] Lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-158fef03-5fe5-4599-8945-2d8bb18a4fe3 req-7026a18b-c07c-42ab-9add-b0f5a91941bf service nova] Lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-158fef03-5fe5-4599-8945-2d8bb18a4fe3 req-7026a18b-c07c-42ab-9add-b0f5a91941bf service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] No waiting events found dispatching network-vif-unplugged-b330a8f4-0812-4964-bd70-10d41689406a {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:43:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-158fef03-5fe5-4599-8945-2d8bb18a4fe3 req-7026a18b-c07c-42ab-9add-b0f5a91941bf service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Received event network-vif-unplugged-b330a8f4-0812-4964-bd70-10d41689406a for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:43:31 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Instance destroyed successfully.
Aug 27 02:43:31 user nova-compute[72820]: DEBUG nova.objects.instance [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lazy-loading 'resources' on Instance uuid f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:43:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2054462033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2054462033',id=12,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:23:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f023daf1767f4088bf0a23524587e662',ramdisk_id='',reservation_id='r-tco0mpab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:25:46Z,user_data=None,user_id='bb67e11ecdd648a89dd58b4bf416060a',uuid=f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b330a8f4-0812-4964-bd70-10d41689406a", "address": "fa:16:3e:a4:9d:95", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb330a8f4-08", "ovs_interfaceid": "b330a8f4-0812-4964-bd70-10d41689406a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:43:31 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converting VIF {"id": "b330a8f4-0812-4964-bd70-10d41689406a", "address": "fa:16:3e:a4:9d:95", "network": {"id": "fe55c93c-d4e7-4f5f-9fff-d4762923a601", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-107984476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f023daf1767f4088bf0a23524587e662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb330a8f4-08", "ovs_interfaceid": "b330a8f4-0812-4964-bd70-10d41689406a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:43:31 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:9d:95,bridge_name='br-int',has_traffic_filtering=True,id=b330a8f4-0812-4964-bd70-10d41689406a,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb330a8f4-08') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:43:31 user nova-compute[72820]: DEBUG os_vif [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:9d:95,bridge_name='br-int',has_traffic_filtering=True,id=b330a8f4-0812-4964-bd70-10d41689406a,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb330a8f4-08') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:43:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb330a8f4-08, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:43:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:43:31 user nova-compute[72820]: INFO os_vif [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:9d:95,bridge_name='br-int',has_traffic_filtering=True,id=b330a8f4-0812-4964-bd70-10d41689406a,network=Network(fe55c93c-d4e7-4f5f-9fff-d4762923a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb330a8f4-08')
Aug 27 02:43:31 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Deleting instance files /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3_del
Aug 27 02:43:31 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Deletion of /opt/stack/data/nova/instances/f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3_del complete
Aug 27 02:43:31 user nova-compute[72820]: INFO nova.compute.manager [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 27 02:43:31 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:43:31 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:43:31 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:43:31 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:43:31 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Took 0.47 seconds to deallocate network for instance.
Aug 27 02:43:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-b9c5fe4c-40c5-46fd-8c06-d5d6dfe5655c req-d8e585b4-db11-442d-8470-d5dd370416eb service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Received event network-vif-deleted-b330a8f4-0812-4964-bd70-10d41689406a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:31 user nova-compute[72820]: INFO nova.compute.manager [req-b9c5fe4c-40c5-46fd-8c06-d5d6dfe5655c req-d8e585b4-db11-442d-8470-d5dd370416eb service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Neutron deleted interface b330a8f4-0812-4964-bd70-10d41689406a; detaching it from the instance and deleting it from the info cache
Aug 27 02:43:31 user nova-compute[72820]: DEBUG nova.network.neutron [req-b9c5fe4c-40c5-46fd-8c06-d5d6dfe5655c req-d8e585b4-db11-442d-8470-d5dd370416eb service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:43:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-b9c5fe4c-40c5-46fd-8c06-d5d6dfe5655c req-d8e585b4-db11-442d-8470-d5dd370416eb service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Detach interface failed, port_id=b330a8f4-0812-4964-bd70-10d41689406a, reason: Instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 02:43:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:32 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:43:32 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:43:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:32 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Deleted allocations for instance f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3
Aug 27 02:43:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-53d1614f-c039-4721-9e37-a3203f9c2dd0 tempest-ServerBootFromVolumeStableRescueTest-2088708325 tempest-ServerBootFromVolumeStableRescueTest-2088708325-project-member] Lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.782s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-4f174ca9-d12b-45c8-893c-550693227ada req-9b443309-c008-4efe-a8a9-274529322132 service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Received event network-vif-plugged-b330a8f4-0812-4964-bd70-10d41689406a {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4f174ca9-d12b-45c8-893c-550693227ada req-9b443309-c008-4efe-a8a9-274529322132 service nova] Acquiring lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4f174ca9-d12b-45c8-893c-550693227ada req-9b443309-c008-4efe-a8a9-274529322132 service nova] Lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4f174ca9-d12b-45c8-893c-550693227ada req-9b443309-c008-4efe-a8a9-274529322132 service nova] Lock "f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-4f174ca9-d12b-45c8-893c-550693227ada req-9b443309-c008-4efe-a8a9-274529322132 service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] No waiting events found dispatching network-vif-plugged-b330a8f4-0812-4964-bd70-10d41689406a {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:43:32 user nova-compute[72820]: WARNING nova.compute.manager [req-4f174ca9-d12b-45c8-893c-550693227ada req-9b443309-c008-4efe-a8a9-274529322132 service nova] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Received unexpected event network-vif-plugged-b330a8f4-0812-4964-bd70-10d41689406a for instance with vm_state deleted and task_state None.
Aug 27 02:43:33 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:43:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:43:33 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104198.795189, dc94e6fe-575e-44a1-bf2c-a471abcbbfe7 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:43:33 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] VM Stopped (Lifecycle Event)
Aug 27 02:43:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5f4f2657-0227-403b-bfb5-39b4b2f16a93 None None] [instance: dc94e6fe-575e-44a1-bf2c-a471abcbbfe7] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:43:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-b1a0ba95-2678-493d-87ba-061abf80887a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:43:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-b1a0ba95-2678-493d-87ba-061abf80887a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:43:33 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:43:34 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Updating instance_info_cache with network_info: [{"id": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "address": "fa:16:3e:36:09:99", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a90a590-7f", "ovs_interfaceid": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:43:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-b1a0ba95-2678-493d-87ba-061abf80887a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:43:34 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:43:36 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Creating image(s)
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Did not create local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Ensure instance console log exists: /opt/stack/data/nova/instances/937e1fae-4b49-494b-b37b-2ff4cdc8a82b/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Start _get_guest_xml network_info=[{"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'eada33f3-eaf7-432b-b1b7-26b0cb3919ce', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxwLdQIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '937e1fae-4b49-494b-b37b-2ff4cdc8a82b', 'attached_at': '', 'detached_at': '', 'volume_id': '69166b6a-56d7-4e8d-9c76-c633f5035aab', 'serial': '69166b6a-56d7-4e8d-9c76-c633f5035aab'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:43:36 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 02:43:36 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.objects.instance [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lazy-loading 'vcpu_model' on Instance uuid 937e1fae-4b49-494b-b37b-2ff4cdc8a82b {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxwLdQIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:43:36 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:43:36 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:43:36 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae1c230-2b19-4b12-b071-f3d3ce3d9b1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:43:36 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd56213c-c860-4d1e-9745-9f5eb1faba3b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab] added
Aug 27 02:43:36 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9f6ecf-8492-46d0-b261-c4face9c6a06]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[032f5bbb-b5b5-4868-9539-07ce944bcc83]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zxwLdQIG {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zxwLdQIG" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[761c532e-f021-476f-91ff-5bae40de2691]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zxwLdQIG'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb69cf47-1cd3-4439-a307-05eb61a20448]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[42862939-1f0e-4d5d-871f-dec2193207d2]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:43:36 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:43:36 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4158d82b-0ee9-4b96-970d-f11f90f19254]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab, portal: 172.16.0.220,3260]
Aug 27 02:43:36 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab, portal: 172.16.0.220,3260] successful.
Aug 27 02:43:36 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[459ff574-5e17-4c11-91db-21cf814b38a3]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[521c7dc4-3820-4ab8-ac25-329fb8dc7c06]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:43:36 user nova-compute[72820]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:43:36 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:43:36 user nova-compute[72820]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:43:36 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec46036-3611-4fc0-827f-942b97736a3a]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:43:36 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:43:37 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104202.750782, 518f2efd-99dc-42fb-afdd-da6e174857d1 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:43:37 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] VM Stopped (Lifecycle Event)
Aug 27 02:43:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-0da4a5d8-0454-49c6-97f5-ee0e75e920c2 None None] [instance: 518f2efd-99dc-42fb-afdd-da6e174857d1] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:43:37 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:43:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxwLdQIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:43:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:43:37 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23933363065373434', 'path': '/dev/sdc'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:43:37 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933363065373434', 'path': '/dev/sdc'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:43:38 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T02:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-461244386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1719587291',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL4xAW1yqP6Coj+hhVCS5IQNbL8oxWGaJMLhXbiMUMXUf8cKxypJ/lvgX61mLhj54rUE2+oPLqoH07Bp4DB/o2rEWFebI2x+kpnvVVRoO/4DZPpY3FT3cyl8sodoL2efw==',key_name='tempest-keypair-158688571',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:41:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ad16025d31445e4bc439e5e9b1bc1f0',ramdisk_id='',reservation_id='r-q8lxoffq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1903594173',owner_user_name='tempest-ServerActionsV293TestJSON-1903594173-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:43:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='983d52ab60604e21a675cca739977e8c',uuid=937e1fae-4b49-494b-b37b-2ff4cdc8a82b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:43:38 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Converting VIF {"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:43:38 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:66:0b,bridge_name='br-int',has_traffic_filtering=True,id=04e6a150-9c11-4112-9d82-23e360ad145e,network=Network(73446049-4923-430b-a2d6-af3ed8feb088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e6a150-9c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:43:38 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:43:38 user nova-compute[72820]:   <uuid>937e1fae-4b49-494b-b37b-2ff4cdc8a82b</uuid>
Aug 27 02:43:38 user nova-compute[72820]:   <name>instance-00000026</name>
Aug 27 02:43:38 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:43:38 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:43:38 user nova-compute[72820]:   <metadata>
Aug 27 02:43:38 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:43:38 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:43:38 user nova-compute[72820]:       <nova:name>tempest-ServerActionsV293TestJSON-server-461244386</nova:name>
Aug 27 02:43:38 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:43:36</nova:creationTime>
Aug 27 02:43:38 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:43:38 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:43:38 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:43:38 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:43:38 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:43:38 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:43:38 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:43:38 user nova-compute[72820]:       <nova:owner>
Aug 27 02:43:38 user nova-compute[72820]:         <nova:user uuid="983d52ab60604e21a675cca739977e8c">tempest-ServerActionsV293TestJSON-1903594173-project-member</nova:user>
Aug 27 02:43:38 user nova-compute[72820]:         <nova:project uuid="8ad16025d31445e4bc439e5e9b1bc1f0">tempest-ServerActionsV293TestJSON-1903594173</nova:project>
Aug 27 02:43:38 user nova-compute[72820]:       </nova:owner>
Aug 27 02:43:38 user nova-compute[72820]:       <nova:ports>
Aug 27 02:43:38 user nova-compute[72820]:         <nova:port uuid="04e6a150-9c11-4112-9d82-23e360ad145e">
Aug 27 02:43:38 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 02:43:38 user nova-compute[72820]:         </nova:port>
Aug 27 02:43:38 user nova-compute[72820]:       </nova:ports>
Aug 27 02:43:38 user nova-compute[72820]:     </nova:instance>
Aug 27 02:43:38 user nova-compute[72820]:   </metadata>
Aug 27 02:43:38 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:43:38 user nova-compute[72820]:     <system>
Aug 27 02:43:38 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:43:38 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:43:38 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:43:38 user nova-compute[72820]:       <entry name="serial">937e1fae-4b49-494b-b37b-2ff4cdc8a82b</entry>
Aug 27 02:43:38 user nova-compute[72820]:       <entry name="uuid">937e1fae-4b49-494b-b37b-2ff4cdc8a82b</entry>
Aug 27 02:43:38 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:43:38 user nova-compute[72820]:     </system>
Aug 27 02:43:38 user nova-compute[72820]:   </sysinfo>
Aug 27 02:43:38 user nova-compute[72820]:   <os>
Aug 27 02:43:38 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:43:38 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:43:38 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:43:38 user nova-compute[72820]:   </os>
Aug 27 02:43:38 user nova-compute[72820]:   <features>
Aug 27 02:43:38 user nova-compute[72820]:     <acpi/>
Aug 27 02:43:38 user nova-compute[72820]:     <apic/>
Aug 27 02:43:38 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:43:38 user nova-compute[72820]:   </features>
Aug 27 02:43:38 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:43:38 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:43:38 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:43:38 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:43:38 user nova-compute[72820]:   </clock>
Aug 27 02:43:38 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:43:38 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:43:38 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:43:38 user nova-compute[72820]:   </cpu>
Aug 27 02:43:38 user nova-compute[72820]:   <devices>
Aug 27 02:43:38 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:43:38 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:43:38 user nova-compute[72820]:       <source dev="/dev/sdc"/>
Aug 27 02:43:38 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:43:38 user nova-compute[72820]:       <serial>69166b6a-56d7-4e8d-9c76-c633f5035aab</serial>
Aug 27 02:43:38 user nova-compute[72820]:     </disk>
Aug 27 02:43:38 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:43:38 user nova-compute[72820]:       <mac address="fa:16:3e:60:66:0b"/>
Aug 27 02:43:38 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:43:38 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:43:38 user nova-compute[72820]:       <target dev="tap04e6a150-9c"/>
Aug 27 02:43:38 user nova-compute[72820]:     </interface>
Aug 27 02:43:38 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:43:38 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/937e1fae-4b49-494b-b37b-2ff4cdc8a82b/console.log" append="off"/>
Aug 27 02:43:38 user nova-compute[72820]:     </serial>
Aug 27 02:43:38 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:43:38 user nova-compute[72820]:     <video>
Aug 27 02:43:38 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:43:38 user nova-compute[72820]:     </video>
Aug 27 02:43:38 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:43:38 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:43:38 user nova-compute[72820]:     </rng>
Aug 27 02:43:38 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:43:38 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:43:38 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:43:38 user nova-compute[72820]:     </memballoon>
Aug 27 02:43:38 user nova-compute[72820]:   </devices>
Aug 27 02:43:38 user nova-compute[72820]: </domain>
Aug 27 02:43:38 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:43:38 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T02:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-461244386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1719587291',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL4xAW1yqP6Coj+hhVCS5IQNbL8oxWGaJMLhXbiMUMXUf8cKxypJ/lvgX61mLhj54rUE2+oPLqoH07Bp4DB/o2rEWFebI2x+kpnvVVRoO/4DZPpY3FT3cyl8sodoL2efw==',key_name='tempest-keypair-158688571',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:41:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ad16025d31445e4bc439e5e9b1bc1f0',ramdisk_id='',reservation_id='r-q8lxoffq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1903594173',owner_user_name='tempest-ServerActionsV293TestJSON-1903594173-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:43:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='983d52ab60604e21a675cca739977e8c',uuid=937e1fae-4b49-494b-b37b-2ff4cdc8a82b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:43:38 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Converting VIF {"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:43:38 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:66:0b,bridge_name='br-int',has_traffic_filtering=True,id=04e6a150-9c11-4112-9d82-23e360ad145e,network=Network(73446049-4923-430b-a2d6-af3ed8feb088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e6a150-9c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:43:38 user nova-compute[72820]: DEBUG os_vif [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:66:0b,bridge_name='br-int',has_traffic_filtering=True,id=04e6a150-9c11-4112-9d82-23e360ad145e,network=Network(73446049-4923-430b-a2d6-af3ed8feb088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e6a150-9c') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:43:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:43:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:43:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04e6a150-9c, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:43:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04e6a150-9c, col_values=(('external_ids', {'iface-id': '04e6a150-9c11-4112-9d82-23e360ad145e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:66:0b', 'vm-uuid': '937e1fae-4b49-494b-b37b-2ff4cdc8a82b'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:43:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:43:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:38 user nova-compute[72820]: INFO os_vif [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:66:0b,bridge_name='br-int',has_traffic_filtering=True,id=04e6a150-9c11-4112-9d82-23e360ad145e,network=Network(73446049-4923-430b-a2d6-af3ed8feb088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e6a150-9c')
Aug 27 02:43:38 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:43:38 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] No VIF found with MAC fa:16:3e:60:66:0b, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:43:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-10c10118-c15b-4dd1-a11d-3de04ec847a7 req-7dedbebc-38de-4913-8c25-77972d90d4a6 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received event network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-10c10118-c15b-4dd1-a11d-3de04ec847a7 req-7dedbebc-38de-4913-8c25-77972d90d4a6 service nova] Acquiring lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-10c10118-c15b-4dd1-a11d-3de04ec847a7 req-7dedbebc-38de-4913-8c25-77972d90d4a6 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-10c10118-c15b-4dd1-a11d-3de04ec847a7 req-7dedbebc-38de-4913-8c25-77972d90d4a6 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-10c10118-c15b-4dd1-a11d-3de04ec847a7 req-7dedbebc-38de-4913-8c25-77972d90d4a6 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] No waiting events found dispatching network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:43:39 user nova-compute[72820]: WARNING nova.compute.manager [req-10c10118-c15b-4dd1-a11d-3de04ec847a7 req-7dedbebc-38de-4913-8c25-77972d90d4a6 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received unexpected event network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e for instance with vm_state active and task_state rebuild_spawning.
Aug 27 02:43:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104221.5239804, 937e1fae-4b49-494b-b37b-2ff4cdc8a82b => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:43:41 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] VM Resumed (Lifecycle Event)
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:43:41 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Instance spawned successfully.
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:43:41 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104221.5259097, 937e1fae-4b49-494b-b37b-2ff4cdc8a82b => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:43:41 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] VM Started (Lifecycle Event)
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:43:41 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.compute.manager [req-e2e68430-dbc3-41a6-a6c5-d7730367637e req-862813a0-813d-415f-ad24-bccbed342531 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received event network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e2e68430-dbc3-41a6-a6c5-d7730367637e req-862813a0-813d-415f-ad24-bccbed342531 service nova] Acquiring lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e2e68430-dbc3-41a6-a6c5-d7730367637e req-862813a0-813d-415f-ad24-bccbed342531 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e2e68430-dbc3-41a6-a6c5-d7730367637e req-862813a0-813d-415f-ad24-bccbed342531 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.compute.manager [req-e2e68430-dbc3-41a6-a6c5-d7730367637e req-862813a0-813d-415f-ad24-bccbed342531 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] No waiting events found dispatching network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:43:41 user nova-compute[72820]: WARNING nova.compute.manager [req-e2e68430-dbc3-41a6-a6c5-d7730367637e req-862813a0-813d-415f-ad24-bccbed342531 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received unexpected event network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e for instance with vm_state active and task_state rebuild_spawning.
Aug 27 02:43:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG nova.objects.instance [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72820) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 27 02:43:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-620cbc66-e66e-48ad-bbef-0cbfe0553e96 tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.079s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:46 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104211.2407544, f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:43:46 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] VM Stopped (Lifecycle Event)
Aug 27 02:43:46 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3ba62132-d09a-4a78-b744-c810bae968a4 None None] [instance: f2ff3f10-4d6d-4013-8ecb-319b2d2df9c3] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:43:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:43:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:43:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:43:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:43:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:57 user nova-compute[72820]: INFO nova.compute.manager [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Terminating instance
Aug 27 02:43:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:43:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-06e96b79-fb19-405b-a408-59c3b0e9f532 req-6f0e7a5f-d113-4c84-80ec-77dd84df7bf8 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received event network-vif-unplugged-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-06e96b79-fb19-405b-a408-59c3b0e9f532 req-6f0e7a5f-d113-4c84-80ec-77dd84df7bf8 service nova] Acquiring lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-06e96b79-fb19-405b-a408-59c3b0e9f532 req-6f0e7a5f-d113-4c84-80ec-77dd84df7bf8 service nova] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-06e96b79-fb19-405b-a408-59c3b0e9f532 req-6f0e7a5f-d113-4c84-80ec-77dd84df7bf8 service nova] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-06e96b79-fb19-405b-a408-59c3b0e9f532 req-6f0e7a5f-d113-4c84-80ec-77dd84df7bf8 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] No waiting events found dispatching network-vif-unplugged-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:43:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-06e96b79-fb19-405b-a408-59c3b0e9f532 req-6f0e7a5f-d113-4c84-80ec-77dd84df7bf8 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received event network-vif-unplugged-44b914a9-6a23-44dc-9711-dd33dfdd276b for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:43:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:58 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Instance destroyed successfully.
Aug 27 02:43:58 user nova-compute[72820]: DEBUG nova.objects.instance [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lazy-loading 'resources' on Instance uuid 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:43:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T02:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1380869967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1380869967',id=32,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOciKBBC8NJ35hgRq02smcI4uF6t4M94gsu+a5kRirwGvo1EOVp24o42AMRihJmcVfkkv/PMoLN/H5Rsi/oO2DWABm120N26knoQDRfWSEMs7kV0T76++jbrlQxgFhe0QQ==',key_name='tempest-keypair-956790269',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5387e67178b141ae94025b9fd61f0124',ramdisk_id='',reservation_id='r-3mee6amo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1913674887',owner_user_name='tempest-AttachVolumeShelveTestJSON-1913674887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:42:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6dbf37c8dec47aebcdc9c93ad1f3d69',uuid=7726f4c9-697d-49ac-a2ee-ed42f81d8c64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:43:58 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converting VIF {"id": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "address": "fa:16:3e:6c:49:83", "network": {"id": "29d2fb0a-8f34-47c9-bbba-d394a93a5495", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1441101950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5387e67178b141ae94025b9fd61f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b914a9-6a", "ovs_interfaceid": "44b914a9-6a23-44dc-9711-dd33dfdd276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:43:58 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:49:83,bridge_name='br-int',has_traffic_filtering=True,id=44b914a9-6a23-44dc-9711-dd33dfdd276b,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b914a9-6a') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:43:58 user nova-compute[72820]: DEBUG os_vif [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:49:83,bridge_name='br-int',has_traffic_filtering=True,id=44b914a9-6a23-44dc-9711-dd33dfdd276b,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b914a9-6a') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:43:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44b914a9-6a, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:43:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:43:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:43:58 user nova-compute[72820]: INFO os_vif [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:49:83,bridge_name='br-int',has_traffic_filtering=True,id=44b914a9-6a23-44dc-9711-dd33dfdd276b,network=Network(29d2fb0a-8f34-47c9-bbba-d394a93a5495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b914a9-6a')
Aug 27 02:43:58 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Deleting instance files /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64_del
Aug 27 02:43:58 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Deletion of /opt/stack/data/nova/instances/7726f4c9-697d-49ac-a2ee-ed42f81d8c64_del complete
Aug 27 02:43:58 user nova-compute[72820]: INFO nova.compute.manager [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 27 02:43:58 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:43:58 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:43:58 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:43:59 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:43:59 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Took 0.94 seconds to deallocate network for instance.
Aug 27 02:43:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-c415e9da-306b-4ece-8726-7411c8c29837 req-42be7bee-5311-4e8e-89c8-8c55b0bdbc08 service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received event network-vif-deleted-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:59 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:43:59 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:43:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:59 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Deleted allocations for instance 7726f4c9-697d-49ac-a2ee-ed42f81d8c64
Aug 27 02:43:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-c8f61933-4c7d-4363-b0e5-c51d1375d616 tempest-AttachVolumeShelveTestJSON-1913674887 tempest-AttachVolumeShelveTestJSON-1913674887-project-member] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.136s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-de326a16-6b79-4b5a-be18-b6780e7edd57 req-3698e24c-f9dc-433b-9997-d7eaec1589fe service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received event network-vif-plugged-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:43:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-de326a16-6b79-4b5a-be18-b6780e7edd57 req-3698e24c-f9dc-433b-9997-d7eaec1589fe service nova] Acquiring lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:43:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-de326a16-6b79-4b5a-be18-b6780e7edd57 req-3698e24c-f9dc-433b-9997-d7eaec1589fe service nova] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:43:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-de326a16-6b79-4b5a-be18-b6780e7edd57 req-3698e24c-f9dc-433b-9997-d7eaec1589fe service nova] Lock "7726f4c9-697d-49ac-a2ee-ed42f81d8c64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:43:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-de326a16-6b79-4b5a-be18-b6780e7edd57 req-3698e24c-f9dc-433b-9997-d7eaec1589fe service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] No waiting events found dispatching network-vif-plugged-44b914a9-6a23-44dc-9711-dd33dfdd276b {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:43:59 user nova-compute[72820]: WARNING nova.compute.manager [req-de326a16-6b79-4b5a-be18-b6780e7edd57 req-3698e24c-f9dc-433b-9997-d7eaec1589fe service nova] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Received unexpected event network-vif-plugged-44b914a9-6a23-44dc-9711-dd33dfdd276b for instance with vm_state deleted and task_state None.
Aug 27 02:44:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:13 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104238.0246215, 7726f4c9-697d-49ac-a2ee-ed42f81d8c64 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:44:13 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] VM Stopped (Lifecycle Event)
Aug 27 02:44:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-a57c0eaa-1730-4811-ba03-cc5c7e8dcd5b None None] [instance: 7726f4c9-697d-49ac-a2ee-ed42f81d8c64] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:44:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:17 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:44:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:20 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:44:21 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:44:21 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:44:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:44:22 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:44:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:44:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:44:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:44:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:44:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:44:22 user nova-compute[72820]: INFO nova.compute.manager [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Terminating instance
Aug 27 02:44:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:44:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG nova.compute.manager [req-144058ba-e86f-46d2-8cb1-4a47e7f7af16 req-e6c1f224-8b2e-4a6f-b34f-1314ae057fa4 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Received event network-vif-unplugged-9c663cbb-4c46-4618-b58e-318aa323a440 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-144058ba-e86f-46d2-8cb1-4a47e7f7af16 req-e6c1f224-8b2e-4a6f-b34f-1314ae057fa4 service nova] Acquiring lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-144058ba-e86f-46d2-8cb1-4a47e7f7af16 req-e6c1f224-8b2e-4a6f-b34f-1314ae057fa4 service nova] Lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-144058ba-e86f-46d2-8cb1-4a47e7f7af16 req-e6c1f224-8b2e-4a6f-b34f-1314ae057fa4 service nova] Lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG nova.compute.manager [req-144058ba-e86f-46d2-8cb1-4a47e7f7af16 req-e6c1f224-8b2e-4a6f-b34f-1314ae057fa4 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] No waiting events found dispatching network-vif-unplugged-9c663cbb-4c46-4618-b58e-318aa323a440 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG nova.compute.manager [req-144058ba-e86f-46d2-8cb1-4a47e7f7af16 req-e6c1f224-8b2e-4a6f-b34f-1314ae057fa4 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Received event network-vif-unplugged-9c663cbb-4c46-4618-b58e-318aa323a440 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:44:23 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Instance destroyed successfully.
Aug 27 02:44:23 user nova-compute[72820]: DEBUG nova.objects.instance [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lazy-loading 'resources' on Instance uuid 96b0b198-aadc-44cb-a54e-9cc1a08226dc {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-38069467',display_name='tempest-TestVolumeBootPattern-volume-backed-server-38069467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-38069467',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOKPBoOH6a8HuZnXEMPsPKAOXgNqMpvHxPQO7+4INzfu9DL259bmU3+zvkNeEhdHxwTrb/YIiOkr59XMdG1dIMgbZAVuxTJ0/9KtuIp4mf+ft3vBWN3Z+CCUzUbNeS1Ag==',key_name='tempest-keypair-2139575159',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:39:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84f02ddcfa2b4571a4d7cacf1287aebd',ramdisk_id='',reservation_id='r-hyd8ffz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-631676638',owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:39:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='878038feacda4094b5d2c9e3814c8bf0',uuid=96b0b198-aadc-44cb-a54e-9cc1a08226dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c663cbb-4c46-4618-b58e-318aa323a440", "address": "fa:16:3e:fb:46:b1", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c663cbb-4c", "ovs_interfaceid": "9c663cbb-4c46-4618-b58e-318aa323a440", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converting VIF {"id": "9c663cbb-4c46-4618-b58e-318aa323a440", "address": "fa:16:3e:fb:46:b1", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c663cbb-4c", "ovs_interfaceid": "9c663cbb-4c46-4618-b58e-318aa323a440", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:46:b1,bridge_name='br-int',has_traffic_filtering=True,id=9c663cbb-4c46-4618-b58e-318aa323a440,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c663cbb-4c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG os_vif [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:46:b1,bridge_name='br-int',has_traffic_filtering=True,id=9c663cbb-4c46-4618-b58e-318aa323a440,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c663cbb-4c') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c663cbb-4c, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:44:23 user nova-compute[72820]: INFO os_vif [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:46:b1,bridge_name='br-int',has_traffic_filtering=True,id=9c663cbb-4c46-4618-b58e-318aa323a440,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c663cbb-4c')
Aug 27 02:44:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yiWBmZkw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:44:23 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:44:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf15520-4118-4d2e-8c54-fb8ec594611b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:44:23 user nova-compute[72820]: No targets found.
Aug 27 02:44:23 user nova-compute[72820]: iSNS:
Aug 27 02:44:23 user nova-compute[72820]: No targets found.
Aug 27 02:44:23 user nova-compute[72820]: STATIC:
Aug 27 02:44:23 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab
Aug 27 02:44:23 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:44:23 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:44:23 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b
Aug 27 02:44:23 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:44:23 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:44:23 user nova-compute[72820]: FIRMWARE:
Aug 27 02:44:23 user nova-compute[72820]: No targets found.
Aug 27 02:44:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:44:23 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:44:23 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a753ff79-addd-4fc4-b516-da7c99aeb54a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cc6142-3944-4a99-9a88-7ff5a1e081e2]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:44:23 user nova-compute[72820]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:44:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b (non-flash)
Aug 27 02:44:23 user nova-compute[72820]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:44:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a02636d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b'): ({'sdb'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Removing single pathed devices sdb {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0654fdf-9b71-4376-94b4-5fa3a4bd977a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7488ce-f26b-4a42-afb6-9fe30c185de9]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Flushing IO for device /dev/sdb {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8004b19a-4f69-44f3-87aa-dff1e6b8f294]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:44:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.117s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f43afc-75c1-4b87-8b8f-bf34bafa266b]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23534663433303936', '/dev/disk/by-id/scsi-1SCST_BIO35406a71-54f4309642ad0182', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_35406a71') {{(pid=84057) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dc5446-3c05-4480-bf7a-42d460d997e0]: (4, None) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ddee0a-b838-4964-b1b8-182e8fa323cb]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ed6229-0a5f-4069-b6c8-3b22fca9cbcf]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b, portal: 172.16.0.220,3260]
Aug 27 02:44:24 user nova-compute[72820]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b, portal: 172.16.0.220,3260] successful.
Aug 27 02:44:24 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7af1bf-d395-4e76-85de-944041885c0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d1de16-7864-4508-a6c3-4efd92110946]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] <== disconnect_volume: return (450ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:44:24 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Deleting instance files /opt/stack/data/nova/instances/96b0b198-aadc-44cb-a54e-9cc1a08226dc_del
Aug 27 02:44:24 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Deletion of /opt/stack/data/nova/instances/96b0b198-aadc-44cb-a54e-9cc1a08226dc_del complete
Aug 27 02:44:24 user nova-compute[72820]: INFO nova.compute.manager [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 27 02:44:24 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:44:24 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:44:25 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:44:25 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Took 0.95 seconds to deallocate network for instance.
Aug 27 02:44:25 user nova-compute[72820]: DEBUG nova.compute.manager [req-addb80a1-d3da-46a1-8d8c-64ef45750735 req-1601f63c-2b7b-4c1e-bf8f-a9390d818942 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Received event network-vif-plugged-9c663cbb-4c46-4618-b58e-318aa323a440 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:44:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-addb80a1-d3da-46a1-8d8c-64ef45750735 req-1601f63c-2b7b-4c1e-bf8f-a9390d818942 service nova] Acquiring lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:44:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-addb80a1-d3da-46a1-8d8c-64ef45750735 req-1601f63c-2b7b-4c1e-bf8f-a9390d818942 service nova] Lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:44:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-addb80a1-d3da-46a1-8d8c-64ef45750735 req-1601f63c-2b7b-4c1e-bf8f-a9390d818942 service nova] Lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:44:25 user nova-compute[72820]: DEBUG nova.compute.manager [req-addb80a1-d3da-46a1-8d8c-64ef45750735 req-1601f63c-2b7b-4c1e-bf8f-a9390d818942 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] No waiting events found dispatching network-vif-plugged-9c663cbb-4c46-4618-b58e-318aa323a440 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:44:25 user nova-compute[72820]: WARNING nova.compute.manager [req-addb80a1-d3da-46a1-8d8c-64ef45750735 req-1601f63c-2b7b-4c1e-bf8f-a9390d818942 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Received unexpected event network-vif-plugged-9c663cbb-4c46-4618-b58e-318aa323a440 for instance with vm_state active and task_state deleting.
Aug 27 02:44:25 user nova-compute[72820]: DEBUG nova.compute.manager [req-addb80a1-d3da-46a1-8d8c-64ef45750735 req-1601f63c-2b7b-4c1e-bf8f-a9390d818942 service nova] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Received event network-vif-deleted-9c663cbb-4c46-4618-b58e-318aa323a440 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:44:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:26 user nova-compute[72820]: INFO nova.compute.manager [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Took 0.87 seconds to detach 1 volumes for instance.
Aug 27 02:44:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Deleting volume: 9a7af1bf-d395-4e76-85de-944041885c0b {{(pid=72820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 02:44:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:44:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:44:26 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:44:26 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:44:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:44:26 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Deleted allocations for instance 96b0b198-aadc-44cb-a54e-9cc1a08226dc
Aug 27 02:44:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7f977d5-4ba2-44ee-bc89-58fb6917d76e tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "96b0b198-aadc-44cb-a54e-9cc1a08226dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.691s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:44:28 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:44:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:29 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:44:29 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:44:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:44:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:44:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:44:29 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:44:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:44:30 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:44:30 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:44:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8341MB free_disk=25.198806762695312GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:44:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:44:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:44:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance b1a0ba95-2678-493d-87ba-061abf80887a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:44:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 937e1fae-4b49-494b-b37b-2ff4cdc8a82b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:44:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance c5729613-2d22-4d9a-9751-e09dca84e0d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:44:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:44:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:44:30 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:44:30 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:44:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:44:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:44:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:33 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:44:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:44:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-937e1fae-4b49-494b-b37b-2ff4cdc8a82b" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:44:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-937e1fae-4b49-494b-b37b-2ff4cdc8a82b" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:44:33 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:44:34 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Updating instance_info_cache with network_info: [{"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:44:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-937e1fae-4b49-494b-b37b-2ff4cdc8a82b" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:44:34 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:44:38 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104263.6780648, 96b0b198-aadc-44cb-a54e-9cc1a08226dc => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:44:38 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] VM Stopped (Lifecycle Event)
Aug 27 02:44:38 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f45a74d5-9478-4d52-afd0-e8afc829d0de None None] [instance: 96b0b198-aadc-44cb-a54e-9cc1a08226dc] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:44:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:44:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Acquiring lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:44:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:44:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Acquiring lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:44:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:44:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:44:51 user nova-compute[72820]: INFO nova.compute.manager [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Terminating instance
Aug 27 02:44:51 user nova-compute[72820]: DEBUG nova.compute.manager [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:44:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-c028051c-ed37-4260-8a8e-d245253c89f3 req-02d88a86-fd73-408b-b7c0-2379b12f49c4 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received event network-vif-unplugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c028051c-ed37-4260-8a8e-d245253c89f3 req-02d88a86-fd73-408b-b7c0-2379b12f49c4 service nova] Acquiring lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c028051c-ed37-4260-8a8e-d245253c89f3 req-02d88a86-fd73-408b-b7c0-2379b12f49c4 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c028051c-ed37-4260-8a8e-d245253c89f3 req-02d88a86-fd73-408b-b7c0-2379b12f49c4 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-c028051c-ed37-4260-8a8e-d245253c89f3 req-02d88a86-fd73-408b-b7c0-2379b12f49c4 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] No waiting events found dispatching network-vif-unplugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-c028051c-ed37-4260-8a8e-d245253c89f3 req-02d88a86-fd73-408b-b7c0-2379b12f49c4 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received event network-vif-unplugged-04e6a150-9c11-4112-9d82-23e360ad145e for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:52 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Instance destroyed successfully.
Aug 27 02:44:52 user nova-compute[72820]: DEBUG nova.objects.instance [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lazy-loading 'resources' on Instance uuid 937e1fae-4b49-494b-b37b-2ff4cdc8a82b {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T02:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-461244386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1719587291',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL4xAW1yqP6Coj+hhVCS5IQNbL8oxWGaJMLhXbiMUMXUf8cKxypJ/lvgX61mLhj54rUE2+oPLqoH07Bp4DB/o2rEWFebI2x+kpnvVVRoO/4DZPpY3FT3cyl8sodoL2efw==',key_name='tempest-keypair-158688571',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:43:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ad16025d31445e4bc439e5e9b1bc1f0',ramdisk_id='',reservation_id='r-q8lxoffq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1903594173',owner_user_name='tempest-ServerActionsV293TestJSON-1903594173-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:43:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='983d52ab60604e21a675cca739977e8c',uuid=937e1fae-4b49-494b-b37b-2ff4cdc8a82b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Converting VIF {"id": "04e6a150-9c11-4112-9d82-23e360ad145e", "address": "fa:16:3e:60:66:0b", "network": {"id": "73446049-4923-430b-a2d6-af3ed8feb088", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-341209354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad16025d31445e4bc439e5e9b1bc1f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e6a150-9c", "ovs_interfaceid": "04e6a150-9c11-4112-9d82-23e360ad145e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:66:0b,bridge_name='br-int',has_traffic_filtering=True,id=04e6a150-9c11-4112-9d82-23e360ad145e,network=Network(73446049-4923-430b-a2d6-af3ed8feb088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e6a150-9c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_vif [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:66:0b,bridge_name='br-int',has_traffic_filtering=True,id=04e6a150-9c11-4112-9d82-23e360ad145e,network=Network(73446049-4923-430b-a2d6-af3ed8feb088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e6a150-9c') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04e6a150-9c, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:52 user nova-compute[72820]: INFO os_vif [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:66:0b,bridge_name='br-int',has_traffic_filtering=True,id=04e6a150-9c11-4112-9d82-23e360ad145e,network=Network(73446049-4923-430b-a2d6-af3ed8feb088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e6a150-9c')
Aug 27 02:44:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxwLdQIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:44:52 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda52a06-8d32-44c1-b5b4-8f249b2f2608]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:44:52 user nova-compute[72820]: No targets found.
Aug 27 02:44:52 user nova-compute[72820]: iSNS:
Aug 27 02:44:52 user nova-compute[72820]: No targets found.
Aug 27 02:44:52 user nova-compute[72820]: STATIC:
Aug 27 02:44:52 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab
Aug 27 02:44:52 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:44:52 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:44:52 user nova-compute[72820]: FIRMWARE:
Aug 27 02:44:52 user nova-compute[72820]: No targets found.
Aug 27 02:44:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:44:52 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:44:52 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[be873b8e-2e79-4cd7-9987-67017e77b0b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[98693368-fbe6-462d-8349-447eb2aa62a8]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:44:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab (non-flash)
Aug 27 02:44:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a05e4670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab'): ({'sdc'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Removing single pathed devices sdc {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8575f8aa-b675-4293-bf85-0516ee1bb398]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.077s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ded0923-cae9-4741-84ed-243bc76d01a4]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Flushing IO for device /dev/sdc {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.036s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ade7fa8-3a8e-4cac-b957-8f8390f7d6ba]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[32efe673-1b93-4a59-ae56-96517b21c112]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c8f259b5', '/dev/disk/by-id/scsi-1SCST_BIOc8f259b5-9360e744d001911f', '/dev/disk/by-id/scsi-23933363065373434') {{(pid=84057) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 02:44:52 user nova-compute[72820]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_c8f259b5
Aug 27 02:44:52 user nova-compute[72820]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOc8f259b5-9360e744d001911f
Aug 27 02:44:52 user nova-compute[72820]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23933363065373434
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90e0996-4ec1-4b37-8981-8f8475bd23ff]: (4, None) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[589e6ee1-b9e5-492b-9c52-dd877347eb60]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dcd15b-dae8-43c1-9edb-ebbf4e41b60a]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab, portal: 172.16.0.220,3260]
Aug 27 02:44:52 user nova-compute[72820]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab, portal: 172.16.0.220,3260] successful.
Aug 27 02:44:52 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:44:52 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:44:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69166b6a-56d7-4e8d-9c76-c633f5035aab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:44:53 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[299b99b0-6d2e-412c-bfa3-199167b9b012]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:44:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:44:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.481s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:44:53 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] <== disconnect_volume: return (482ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:44:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:44:53 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Deleting instance files /opt/stack/data/nova/instances/937e1fae-4b49-494b-b37b-2ff4cdc8a82b_del
Aug 27 02:44:53 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Deletion of /opt/stack/data/nova/instances/937e1fae-4b49-494b-b37b-2ff4cdc8a82b_del complete
Aug 27 02:44:53 user nova-compute[72820]: INFO nova.compute.manager [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Took 1.41 seconds to destroy the instance on the hypervisor.
Aug 27 02:44:53 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:44:53 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:44:53 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:44:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received event network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] Acquiring lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] No waiting events found dispatching network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:44:54 user nova-compute[72820]: WARNING nova.compute.manager [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received unexpected event network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e for instance with vm_state active and task_state deleting.
Aug 27 02:44:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received event network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] Acquiring lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] No waiting events found dispatching network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:44:54 user nova-compute[72820]: WARNING nova.compute.manager [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received unexpected event network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e for instance with vm_state active and task_state deleting.
Aug 27 02:44:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received event network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] Acquiring lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] No waiting events found dispatching network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:44:54 user nova-compute[72820]: WARNING nova.compute.manager [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received unexpected event network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e for instance with vm_state active and task_state deleting.
Aug 27 02:44:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received event network-vif-unplugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] Acquiring lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] No waiting events found dispatching network-vif-unplugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG nova.compute.manager [req-dadd6878-8019-4a9a-979a-8bfc60ee537e req-d6157e27-7c73-46cd-95e9-7aadad848619 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received event network-vif-unplugged-04e6a150-9c11-4112-9d82-23e360ad145e for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:44:54 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:44:54 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Took 1.66 seconds to deallocate network for instance.
Aug 27 02:44:56 user nova-compute[72820]: DEBUG nova.compute.manager [req-38c351d7-184c-49fd-b56a-2e81cc96bcfa req-d95e94f5-0c03-4879-ad37-cdc4415289c8 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received event network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:44:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-38c351d7-184c-49fd-b56a-2e81cc96bcfa req-d95e94f5-0c03-4879-ad37-cdc4415289c8 service nova] Acquiring lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:44:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-38c351d7-184c-49fd-b56a-2e81cc96bcfa req-d95e94f5-0c03-4879-ad37-cdc4415289c8 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:44:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-38c351d7-184c-49fd-b56a-2e81cc96bcfa req-d95e94f5-0c03-4879-ad37-cdc4415289c8 service nova] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:44:56 user nova-compute[72820]: DEBUG nova.compute.manager [req-38c351d7-184c-49fd-b56a-2e81cc96bcfa req-d95e94f5-0c03-4879-ad37-cdc4415289c8 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] No waiting events found dispatching network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:44:56 user nova-compute[72820]: WARNING nova.compute.manager [req-38c351d7-184c-49fd-b56a-2e81cc96bcfa req-d95e94f5-0c03-4879-ad37-cdc4415289c8 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received unexpected event network-vif-plugged-04e6a150-9c11-4112-9d82-23e360ad145e for instance with vm_state active and task_state deleting.
Aug 27 02:44:56 user nova-compute[72820]: DEBUG nova.compute.manager [req-38c351d7-184c-49fd-b56a-2e81cc96bcfa req-d95e94f5-0c03-4879-ad37-cdc4415289c8 service nova] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Received event network-vif-deleted-04e6a150-9c11-4112-9d82-23e360ad145e {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:44:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:44:59 user nova-compute[72820]: INFO nova.compute.manager [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Took 4.74 seconds to detach 1 volumes for instance.
Aug 27 02:44:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Deleting volume: 69166b6a-56d7-4e8d-9c76-c633f5035aab {{(pid=72820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 02:44:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:44:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:44:59 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:44:59 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:44:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:44:59 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Deleted allocations for instance 937e1fae-4b49-494b-b37b-2ff4cdc8a82b
Aug 27 02:44:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20e8090e-caf1-4133-a093-4f40de2ba05c tempest-ServerActionsV293TestJSON-1903594173 tempest-ServerActionsV293TestJSON-1903594173-project-member] Lock "937e1fae-4b49-494b-b37b-2ff4cdc8a82b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.251s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:45:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:45:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:45:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:45:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:45:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:07 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104292.4529493, 937e1fae-4b49-494b-b37b-2ff4cdc8a82b => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:45:07 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] VM Stopped (Lifecycle Event)
Aug 27 02:45:07 user nova-compute[72820]: DEBUG nova.compute.manager [None req-d62a41dd-79e1-4b75-92f3-3736127a894d None None] [instance: 937e1fae-4b49-494b-b37b-2ff4cdc8a82b] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:45:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:45:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:45:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:45:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:45:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:45:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:18 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:45:20 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:45:22 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:45:22 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:45:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:45:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:45:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:45:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:45:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:45:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:26 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:45:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:28 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:45:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:45:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:45:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:45:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:45:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:45:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:45:28 user nova-compute[72820]: INFO nova.compute.claims [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Claim successful on node user
Aug 27 02:45:28 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:45:28 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:45:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:45:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG nova.compute.manager [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG nova.network.neutron [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:45:29 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:45:29 user nova-compute[72820]: DEBUG nova.compute.manager [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:45:29 user nova-compute[72820]: INFO nova.virt.block_device [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Booting with volume abf4d7e0-e457-4f47-830c-0820098fe4ac at /dev/vda
Aug 27 02:45:29 user nova-compute[72820]: DEBUG nova.policy [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '878038feacda4094b5d2c9e3814c8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f02ddcfa2b4571a4d7cacf1287aebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG os_brick.utils [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa27ab6-91b1-47dd-9c61-71b11fd9d047]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[59166975-c8fe-495e-872e-f5675cf8563a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec89889f-2a95-4ed1-9b75-94b7b389ff26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9dfbff-1a41-492b-8d62-8afece074c33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:45:29 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c5b0e1-0c1f-4ae2-a70b-40ce28b88c37]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG os_brick.utils [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Updating existing volume attachment record: a6fd994b-8df7-4446-a3d2-8bfe23d9c4fd {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG nova.network.neutron [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Successfully created port: b0d54248-5b36-4f64-9e05-2ab1acc60dc3 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:45:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:45:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:30 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:45:30 user nova-compute[72820]: DEBUG nova.network.neutron [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Successfully updated port: b0d54248-5b36-4f64-9e05-2ab1acc60dc3 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:45:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-5de80011-4526-4d29-a3a5-f223ee332448 req-3f117477-0b7b-496b-87f7-267460e72a64 service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Received event network-changed-b0d54248-5b36-4f64-9e05-2ab1acc60dc3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:45:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-5de80011-4526-4d29-a3a5-f223ee332448 req-3f117477-0b7b-496b-87f7-267460e72a64 service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Refreshing instance network info cache due to event network-changed-b0d54248-5b36-4f64-9e05-2ab1acc60dc3. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:45:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5de80011-4526-4d29-a3a5-f223ee332448 req-3f117477-0b7b-496b-87f7-267460e72a64 service nova] Acquiring lock "refresh_cache-c4ba4570-ea6f-4e39-9dc6-d9237807fa14" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:45:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5de80011-4526-4d29-a3a5-f223ee332448 req-3f117477-0b7b-496b-87f7-267460e72a64 service nova] Acquired lock "refresh_cache-c4ba4570-ea6f-4e39-9dc6-d9237807fa14" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:45:30 user nova-compute[72820]: DEBUG nova.network.neutron [req-5de80011-4526-4d29-a3a5-f223ee332448 req-3f117477-0b7b-496b-87f7-267460e72a64 service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Refreshing network info cache for port b0d54248-5b36-4f64-9e05-2ab1acc60dc3 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:45:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "refresh_cache-c4ba4570-ea6f-4e39-9dc6-d9237807fa14" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:45:30 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:45:30 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:45:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8480MB free_disk=25.18716812133789GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:45:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:45:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:45:30 user nova-compute[72820]: DEBUG nova.network.neutron [req-5de80011-4526-4d29-a3a5-f223ee332448 req-3f117477-0b7b-496b-87f7-267460e72a64 service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:45:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance b1a0ba95-2678-493d-87ba-061abf80887a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:45:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance c5729613-2d22-4d9a-9751-e09dca84e0d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:45:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance c4ba4570-ea6f-4e39-9dc6-d9237807fa14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:45:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:45:30 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:45:31 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:45:31 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:45:31 user nova-compute[72820]: DEBUG nova.network.neutron [req-5de80011-4526-4d29-a3a5-f223ee332448 req-3f117477-0b7b-496b-87f7-267460e72a64 service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:45:31 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:45:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:45:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5de80011-4526-4d29-a3a5-f223ee332448 req-3f117477-0b7b-496b-87f7-267460e72a64 service nova] Releasing lock "refresh_cache-c4ba4570-ea6f-4e39-9dc6-d9237807fa14" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:45:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquired lock "refresh_cache-c4ba4570-ea6f-4e39-9dc6-d9237807fa14" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:45:31 user nova-compute[72820]: DEBUG nova.network.neutron [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:45:31 user nova-compute[72820]: DEBUG nova.network.neutron [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:45:31 user nova-compute[72820]: DEBUG nova.network.neutron [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Updating instance_info_cache with network_info: [{"id": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "address": "fa:16:3e:24:81:76", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d54248-5b", "ovs_interfaceid": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:45:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Releasing lock "refresh_cache-c4ba4570-ea6f-4e39-9dc6-d9237807fa14" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:45:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Instance network_info: |[{"id": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "address": "fa:16:3e:24:81:76", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d54248-5b", "ovs_interfaceid": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:45:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:45:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:45:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:45:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:45:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:35 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:45:35 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:45:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-c5729613-2d22-4d9a-9751-e09dca84e0d6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:45:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-c5729613-2d22-4d9a-9751-e09dca84e0d6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:45:35 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:45:35 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Updating instance_info_cache with network_info: [{"id": "29272dca-3ab8-4b49-8d58-a85d831942ef", "address": "fa:16:3e:f1:32:45", "network": {"id": "a99debd2-2312-4c82-b0d1-d36eab74a9fb", "bridge": "br-int", "label": "tempest-TestStampPattern-1906437798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aac51df4fd73435c81b9f3037a5916c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29272dca-3a", "ovs_interfaceid": "29272dca-3ab8-4b49-8d58-a85d831942ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:45:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-c5729613-2d22-4d9a-9751-e09dca84e0d6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:45:35 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:45:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:45:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:45:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:45:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:45:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.compute.manager [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:45:40 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Creating image(s)
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Did not create local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Ensure instance console log exists: /opt/stack/data/nova/instances/c4ba4570-ea6f-4e39-9dc6-d9237807fa14/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Start _get_guest_xml network_info=[{"id": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "address": "fa:16:3e:24:81:76", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d54248-5b", "ovs_interfaceid": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a6fd994b-8df7-4446-a3d2-8bfe23d9c4fd', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvBMRPFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4ba4570-ea6f-4e39-9dc6-d9237807fa14', 'attached_at': '', 'detached_at': '', 'volume_id': 'abf4d7e0-e457-4f47-830c-0820098fe4ac', 'serial': 'abf4d7e0-e457-4f47-830c-0820098fe4ac'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:45:40 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:45:40 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvBMRPFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:45:40 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:45:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:45:40 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:45:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:45:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:45:40 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:45:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7c1b5f-e87d-4012-8544-eff7672cd426]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:45:41 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e47d569-70fd-42bd-bc80-9259aed7d1a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac] added
Aug 27 02:45:41 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3223c20e-d734-4fb1-b88c-d5be501e9cfc]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e761f1-cff9-4fba-8ddd-6149dd7f3c36]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dvBMRPFG {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dvBMRPFG" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[82224a58-2936-459b-abd6-353a6c986148]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dvBMRPFG'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6350fd-5082-43b9-b8e4-3e12e074b2c9]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf74e42-9138-4010-a9aa-1034b13b7e58]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 02:45:41 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 02:45:41 user nova-compute[72820]:  {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:45:41 user nova-compute[72820]: WARNING os_brick.initiator.connectors.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 02:45:41 user nova-compute[72820]: 
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a66feb5-2dc3-4d04-adef-ca65b76c9fba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac, portal: 172.16.0.220,3260]
Aug 27 02:45:41 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac, portal: 172.16.0.220,3260] successful.
Aug 27 02:45:41 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8ed7d2-8366-49d2-bca5-db379c9c7822]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b70512-2083-4554-8d2c-e7f6de54724b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)
Aug 27 02:45:41 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)
Aug 27 02:45:41 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[580e2933-be17-4a85-beb5-ec2cbcb2e690]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:45:41 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvBMRPFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23562653666653837', 'path': '/dev/sdb'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562653666653837', 'path': '/dev/sdb'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-427908226',display_name='tempest-TestVolumeBootPattern-server-427908226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-427908226',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRxkQgla9cymo6EFmZDbQk1Vd9PsMUw375tHpE3C+G7XWKJ2wNxA3Wp7pGzZ5jGLrv690Dj/yrsqixKPzVZE/Db7oYR6ptdQgKfU5EdVib0jmGNDhSHb8FtGbnW3QaTgA==',key_name='tempest-TestVolumeBootPattern-410715465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84f02ddcfa2b4571a4d7cacf1287aebd',ramdisk_id='',reservation_id='r-mpwqzh5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-631676638',owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:45:29Z,user_data=None,user_id='878038feacda4094b5d2c9e3814c8bf0',uuid=c4ba4570-ea6f-4e39-9dc6-d9237807fa14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "address": "fa:16:3e:24:81:76", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d54248-5b", "ovs_interfaceid": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converting VIF {"id": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "address": "fa:16:3e:24:81:76", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d54248-5b", "ovs_interfaceid": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:81:76,bridge_name='br-int',has_traffic_filtering=True,id=b0d54248-5b36-4f64-9e05-2ab1acc60dc3,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d54248-5b') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG nova.objects.instance [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lazy-loading 'pci_devices' on Instance uuid c4ba4570-ea6f-4e39-9dc6-d9237807fa14 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:45:42 user nova-compute[72820]:   <uuid>c4ba4570-ea6f-4e39-9dc6-d9237807fa14</uuid>
Aug 27 02:45:42 user nova-compute[72820]:   <name>instance-00000029</name>
Aug 27 02:45:42 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:45:42 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:45:42 user nova-compute[72820]:   <metadata>
Aug 27 02:45:42 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:45:42 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:45:42 user nova-compute[72820]:       <nova:name>tempest-TestVolumeBootPattern-server-427908226</nova:name>
Aug 27 02:45:42 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:45:40</nova:creationTime>
Aug 27 02:45:42 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:45:42 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:45:42 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:45:42 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:45:42 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:45:42 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:45:42 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:45:42 user nova-compute[72820]:       <nova:owner>
Aug 27 02:45:42 user nova-compute[72820]:         <nova:user uuid="878038feacda4094b5d2c9e3814c8bf0">tempest-TestVolumeBootPattern-631676638-project-member</nova:user>
Aug 27 02:45:42 user nova-compute[72820]:         <nova:project uuid="84f02ddcfa2b4571a4d7cacf1287aebd">tempest-TestVolumeBootPattern-631676638</nova:project>
Aug 27 02:45:42 user nova-compute[72820]:       </nova:owner>
Aug 27 02:45:42 user nova-compute[72820]:       <nova:ports>
Aug 27 02:45:42 user nova-compute[72820]:         <nova:port uuid="b0d54248-5b36-4f64-9e05-2ab1acc60dc3">
Aug 27 02:45:42 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 02:45:42 user nova-compute[72820]:         </nova:port>
Aug 27 02:45:42 user nova-compute[72820]:       </nova:ports>
Aug 27 02:45:42 user nova-compute[72820]:     </nova:instance>
Aug 27 02:45:42 user nova-compute[72820]:   </metadata>
Aug 27 02:45:42 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:45:42 user nova-compute[72820]:     <system>
Aug 27 02:45:42 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:45:42 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:45:42 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:45:42 user nova-compute[72820]:       <entry name="serial">c4ba4570-ea6f-4e39-9dc6-d9237807fa14</entry>
Aug 27 02:45:42 user nova-compute[72820]:       <entry name="uuid">c4ba4570-ea6f-4e39-9dc6-d9237807fa14</entry>
Aug 27 02:45:42 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:45:42 user nova-compute[72820]:     </system>
Aug 27 02:45:42 user nova-compute[72820]:   </sysinfo>
Aug 27 02:45:42 user nova-compute[72820]:   <os>
Aug 27 02:45:42 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:45:42 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:45:42 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:45:42 user nova-compute[72820]:   </os>
Aug 27 02:45:42 user nova-compute[72820]:   <features>
Aug 27 02:45:42 user nova-compute[72820]:     <acpi/>
Aug 27 02:45:42 user nova-compute[72820]:     <apic/>
Aug 27 02:45:42 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:45:42 user nova-compute[72820]:   </features>
Aug 27 02:45:42 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:45:42 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:45:42 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:45:42 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:45:42 user nova-compute[72820]:   </clock>
Aug 27 02:45:42 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:45:42 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:45:42 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:45:42 user nova-compute[72820]:   </cpu>
Aug 27 02:45:42 user nova-compute[72820]:   <devices>
Aug 27 02:45:42 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:45:42 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:45:42 user nova-compute[72820]:       <source dev="/dev/sdb"/>
Aug 27 02:45:42 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:45:42 user nova-compute[72820]:       <serial>abf4d7e0-e457-4f47-830c-0820098fe4ac</serial>
Aug 27 02:45:42 user nova-compute[72820]:     </disk>
Aug 27 02:45:42 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:45:42 user nova-compute[72820]:       <mac address="fa:16:3e:24:81:76"/>
Aug 27 02:45:42 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:45:42 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:45:42 user nova-compute[72820]:       <target dev="tapb0d54248-5b"/>
Aug 27 02:45:42 user nova-compute[72820]:     </interface>
Aug 27 02:45:42 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:45:42 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/c4ba4570-ea6f-4e39-9dc6-d9237807fa14/console.log" append="off"/>
Aug 27 02:45:42 user nova-compute[72820]:     </serial>
Aug 27 02:45:42 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:45:42 user nova-compute[72820]:     <video>
Aug 27 02:45:42 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:45:42 user nova-compute[72820]:     </video>
Aug 27 02:45:42 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:45:42 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:45:42 user nova-compute[72820]:     </rng>
Aug 27 02:45:42 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:45:42 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:45:42 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:45:42 user nova-compute[72820]:     </memballoon>
Aug 27 02:45:42 user nova-compute[72820]:   </devices>
Aug 27 02:45:42 user nova-compute[72820]: </domain>
Aug 27 02:45:42 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-427908226',display_name='tempest-TestVolumeBootPattern-server-427908226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-427908226',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRxkQgla9cymo6EFmZDbQk1Vd9PsMUw375tHpE3C+G7XWKJ2wNxA3Wp7pGzZ5jGLrv690Dj/yrsqixKPzVZE/Db7oYR6ptdQgKfU5EdVib0jmGNDhSHb8FtGbnW3QaTgA==',key_name='tempest-TestVolumeBootPattern-410715465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84f02ddcfa2b4571a4d7cacf1287aebd',ramdisk_id='',reservation_id='r-mpwqzh5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-631676638',owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:45:29Z,user_data=None,user_id='878038feacda4094b5d2c9e3814c8bf0',uuid=c4ba4570-ea6f-4e39-9dc6-d9237807fa14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "address": "fa:16:3e:24:81:76", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d54248-5b", "ovs_interfaceid": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converting VIF {"id": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "address": "fa:16:3e:24:81:76", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d54248-5b", "ovs_interfaceid": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:81:76,bridge_name='br-int',has_traffic_filtering=True,id=b0d54248-5b36-4f64-9e05-2ab1acc60dc3,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d54248-5b') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG os_vif [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:81:76,bridge_name='br-int',has_traffic_filtering=True,id=b0d54248-5b36-4f64-9e05-2ab1acc60dc3,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d54248-5b') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0d54248-5b, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb0d54248-5b, col_values=(('external_ids', {'iface-id': 'b0d54248-5b36-4f64-9e05-2ab1acc60dc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:81:76', 'vm-uuid': 'c4ba4570-ea6f-4e39-9dc6-d9237807fa14'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:42 user nova-compute[72820]: INFO os_vif [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:81:76,bridge_name='br-int',has_traffic_filtering=True,id=b0d54248-5b36-4f64-9e05-2ab1acc60dc3,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d54248-5b')
Aug 27 02:45:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:45:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] No VIF found with MAC fa:16:3e:24:81:76, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:45:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:43 user nova-compute[72820]: DEBUG nova.compute.manager [req-24e4dae2-177f-47e0-b12d-d48780c38096 req-4aabc9d3-4223-4096-8cda-a0953ff51199 service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Received event network-vif-plugged-b0d54248-5b36-4f64-9e05-2ab1acc60dc3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:45:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-24e4dae2-177f-47e0-b12d-d48780c38096 req-4aabc9d3-4223-4096-8cda-a0953ff51199 service nova] Acquiring lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:45:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-24e4dae2-177f-47e0-b12d-d48780c38096 req-4aabc9d3-4223-4096-8cda-a0953ff51199 service nova] Lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:45:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-24e4dae2-177f-47e0-b12d-d48780c38096 req-4aabc9d3-4223-4096-8cda-a0953ff51199 service nova] Lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:45:43 user nova-compute[72820]: DEBUG nova.compute.manager [req-24e4dae2-177f-47e0-b12d-d48780c38096 req-4aabc9d3-4223-4096-8cda-a0953ff51199 service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] No waiting events found dispatching network-vif-plugged-b0d54248-5b36-4f64-9e05-2ab1acc60dc3 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:45:43 user nova-compute[72820]: WARNING nova.compute.manager [req-24e4dae2-177f-47e0-b12d-d48780c38096 req-4aabc9d3-4223-4096-8cda-a0953ff51199 service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Received unexpected event network-vif-plugged-b0d54248-5b36-4f64-9e05-2ab1acc60dc3 for instance with vm_state building and task_state spawning.
Aug 27 02:45:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:45 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104345.962623, c4ba4570-ea6f-4e39-9dc6-d9237807fa14 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:45:45 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] VM Resumed (Lifecycle Event)
Aug 27 02:45:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:45:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:45:45 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Instance spawned successfully.
Aug 27 02:45:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:45:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:45:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:45:46 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:45:46 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:45:46 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:45:46 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:45:46 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:45:46 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:45:46 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:45:46 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104345.9628174, c4ba4570-ea6f-4e39-9dc6-d9237807fa14 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:45:46 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] VM Started (Lifecycle Event)
Aug 27 02:45:46 user nova-compute[72820]: DEBUG nova.compute.manager [req-e5318f07-e3dc-4183-ba97-ffe10a04c3b7 req-039ab99b-cb6b-4e80-8852-6917cb7d9b1d service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Received event network-vif-plugged-b0d54248-5b36-4f64-9e05-2ab1acc60dc3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:45:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e5318f07-e3dc-4183-ba97-ffe10a04c3b7 req-039ab99b-cb6b-4e80-8852-6917cb7d9b1d service nova] Acquiring lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:45:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e5318f07-e3dc-4183-ba97-ffe10a04c3b7 req-039ab99b-cb6b-4e80-8852-6917cb7d9b1d service nova] Lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:45:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e5318f07-e3dc-4183-ba97-ffe10a04c3b7 req-039ab99b-cb6b-4e80-8852-6917cb7d9b1d service nova] Lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:45:46 user nova-compute[72820]: DEBUG nova.compute.manager [req-e5318f07-e3dc-4183-ba97-ffe10a04c3b7 req-039ab99b-cb6b-4e80-8852-6917cb7d9b1d service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] No waiting events found dispatching network-vif-plugged-b0d54248-5b36-4f64-9e05-2ab1acc60dc3 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:45:46 user nova-compute[72820]: WARNING nova.compute.manager [req-e5318f07-e3dc-4183-ba97-ffe10a04c3b7 req-039ab99b-cb6b-4e80-8852-6917cb7d9b1d service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Received unexpected event network-vif-plugged-b0d54248-5b36-4f64-9e05-2ab1acc60dc3 for instance with vm_state building and task_state spawning.
Aug 27 02:45:46 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:45:46 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:45:46 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:45:46 user nova-compute[72820]: INFO nova.compute.manager [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Took 5.17 seconds to spawn the instance on the hypervisor.
Aug 27 02:45:46 user nova-compute[72820]: DEBUG nova.compute.manager [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:45:46 user nova-compute[72820]: INFO nova.compute.manager [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Took 17.44 seconds to build instance.
Aug 27 02:45:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d288fe4f-a1aa-49c0-9cf3-639ee4be90cd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.537s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:45:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:45:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:46:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:46:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:18 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:46:20 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:46:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:23 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:46:23 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:46:24 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:46:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:46:27 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:46:27 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 02:46:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:46:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:46:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:46:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:46:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:46:28 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:46:30 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:46:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-6ce20bf7-d2e0-42f4-a349-e1d8caf2f79f req-7320dc8e-3f04-4dcb-a555-3add46dec95c service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Received event network-changed-29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:46:30 user nova-compute[72820]: DEBUG nova.compute.manager [req-6ce20bf7-d2e0-42f4-a349-e1d8caf2f79f req-7320dc8e-3f04-4dcb-a555-3add46dec95c service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Refreshing instance network info cache due to event network-changed-29272dca-3ab8-4b49-8d58-a85d831942ef. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:46:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6ce20bf7-d2e0-42f4-a349-e1d8caf2f79f req-7320dc8e-3f04-4dcb-a555-3add46dec95c service nova] Acquiring lock "refresh_cache-c5729613-2d22-4d9a-9751-e09dca84e0d6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:46:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6ce20bf7-d2e0-42f4-a349-e1d8caf2f79f req-7320dc8e-3f04-4dcb-a555-3add46dec95c service nova] Acquired lock "refresh_cache-c5729613-2d22-4d9a-9751-e09dca84e0d6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:46:30 user nova-compute[72820]: DEBUG nova.network.neutron [req-6ce20bf7-d2e0-42f4-a349-e1d8caf2f79f req-7320dc8e-3f04-4dcb-a555-3add46dec95c service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Refreshing network info cache for port 29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:46:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Acquiring lock "c5729613-2d22-4d9a-9751-e09dca84e0d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:46:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:46:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Acquiring lock "c5729613-2d22-4d9a-9751-e09dca84e0d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:46:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:46:30 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:46:30 user nova-compute[72820]: INFO nova.compute.manager [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Terminating instance
Aug 27 02:46:30 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:46:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:31 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Instance destroyed successfully.
Aug 27 02:46:31 user nova-compute[72820]: DEBUG nova.objects.instance [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lazy-loading 'resources' on Instance uuid c5729613-2d22-4d9a-9751-e09dca84e0d6 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:41:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-563403657',display_name='tempest-TestStampPattern-server-563403657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-563403657',id=39,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0zAooyDHQson0E1c4ecvBYhqHsyNSYXv+t0kCdFnzDUG79nvffpMOO2DrZiwLXLyTH3dY7sHVB3U/W4MnPjR/+jLh1QwwlMVYzj0HLb4YOqzk9KyCId+Pu8REZHe3AJQ==',key_name='tempest-TestStampPattern-792127925',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:41:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aac51df4fd73435c81b9f3037a5916c6',ramdisk_id='',reservation_id='r-62bagmtu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-31454635',owner_user_name='tempest-TestStampPattern-31454635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:41:26Z,user_data=None,user_id='8fe498907edd433e94c14ba72df75355',uuid=c5729613-2d22-4d9a-9751-e09dca84e0d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29272dca-3ab8-4b49-8d58-a85d831942ef", "address": "fa:16:3e:f1:32:45", "network": {"id": "a99debd2-2312-4c82-b0d1-d36eab74a9fb", "bridge": "br-int", "label": "tempest-TestStampPattern-1906437798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aac51df4fd73435c81b9f3037a5916c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29272dca-3a", "ovs_interfaceid": "29272dca-3ab8-4b49-8d58-a85d831942ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Converting VIF {"id": "29272dca-3ab8-4b49-8d58-a85d831942ef", "address": "fa:16:3e:f1:32:45", "network": {"id": "a99debd2-2312-4c82-b0d1-d36eab74a9fb", "bridge": "br-int", "label": "tempest-TestStampPattern-1906437798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aac51df4fd73435c81b9f3037a5916c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29272dca-3a", "ovs_interfaceid": "29272dca-3ab8-4b49-8d58-a85d831942ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:32:45,bridge_name='br-int',has_traffic_filtering=True,id=29272dca-3ab8-4b49-8d58-a85d831942ef,network=Network(a99debd2-2312-4c82-b0d1-d36eab74a9fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29272dca-3a') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG os_vif [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:32:45,bridge_name='br-int',has_traffic_filtering=True,id=29272dca-3ab8-4b49-8d58-a85d831942ef,network=Network(a99debd2-2312-4c82-b0d1-d36eab74a9fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29272dca-3a') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29272dca-3a, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:46:31 user nova-compute[72820]: INFO os_vif [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:32:45,bridge_name='br-int',has_traffic_filtering=True,id=29272dca-3ab8-4b49-8d58-a85d831942ef,network=Network(a99debd2-2312-4c82-b0d1-d36eab74a9fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29272dca-3a')
Aug 27 02:46:31 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Deleting instance files /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6_del
Aug 27 02:46:31 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Deletion of /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6_del complete
Aug 27 02:46:31 user nova-compute[72820]: INFO nova.compute.manager [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 27 02:46:31 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:46:31 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000027, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/c5729613-2d22-4d9a-9751-e09dca84e0d6/disk
Aug 27 02:46:31 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-beb8581a-8616-4962-8c57-e8cb15782844 req-29a6fef6-721b-4423-8c27-99c0b0626f71 service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Received event network-vif-unplugged-29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-beb8581a-8616-4962-8c57-e8cb15782844 req-29a6fef6-721b-4423-8c27-99c0b0626f71 service nova] Acquiring lock "c5729613-2d22-4d9a-9751-e09dca84e0d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-beb8581a-8616-4962-8c57-e8cb15782844 req-29a6fef6-721b-4423-8c27-99c0b0626f71 service nova] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-beb8581a-8616-4962-8c57-e8cb15782844 req-29a6fef6-721b-4423-8c27-99c0b0626f71 service nova] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-beb8581a-8616-4962-8c57-e8cb15782844 req-29a6fef6-721b-4423-8c27-99c0b0626f71 service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] No waiting events found dispatching network-vif-unplugged-29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-beb8581a-8616-4962-8c57-e8cb15782844 req-29a6fef6-721b-4423-8c27-99c0b0626f71 service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Received event network-vif-unplugged-29272dca-3ab8-4b49-8d58-a85d831942ef for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG nova.network.neutron [req-6ce20bf7-d2e0-42f4-a349-e1d8caf2f79f req-7320dc8e-3f04-4dcb-a555-3add46dec95c service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Updated VIF entry in instance network info cache for port 29272dca-3ab8-4b49-8d58-a85d831942ef. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG nova.network.neutron [req-6ce20bf7-d2e0-42f4-a349-e1d8caf2f79f req-7320dc8e-3f04-4dcb-a555-3add46dec95c service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Updating instance_info_cache with network_info: [{"id": "29272dca-3ab8-4b49-8d58-a85d831942ef", "address": "fa:16:3e:f1:32:45", "network": {"id": "a99debd2-2312-4c82-b0d1-d36eab74a9fb", "bridge": "br-int", "label": "tempest-TestStampPattern-1906437798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aac51df4fd73435c81b9f3037a5916c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29272dca-3a", "ovs_interfaceid": "29272dca-3ab8-4b49-8d58-a85d831942ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6ce20bf7-d2e0-42f4-a349-e1d8caf2f79f req-7320dc8e-3f04-4dcb-a555-3add46dec95c service nova] Releasing lock "refresh_cache-c5729613-2d22-4d9a-9751-e09dca84e0d6" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:46:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:46:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:46:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:46:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-98803300-0903-437d-bd6b-e78c391a2ac7 req-4df7e73f-119a-4f6a-8d9f-7ca199caa3f8 service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Received event network-vif-deleted-29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:46:32 user nova-compute[72820]: INFO nova.compute.manager [req-98803300-0903-437d-bd6b-e78c391a2ac7 req-4df7e73f-119a-4f6a-8d9f-7ca199caa3f8 service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Neutron deleted interface 29272dca-3ab8-4b49-8d58-a85d831942ef; detaching it from the instance and deleting it from the info cache
Aug 27 02:46:32 user nova-compute[72820]: DEBUG nova.network.neutron [req-98803300-0903-437d-bd6b-e78c391a2ac7 req-4df7e73f-119a-4f6a-8d9f-7ca199caa3f8 service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:46:32 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:46:32 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:46:32 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:46:32 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8402MB free_disk=25.174518585205078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:46:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:46:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:46:32 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Took 1.12 seconds to deallocate network for instance.
Aug 27 02:46:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-98803300-0903-437d-bd6b-e78c391a2ac7 req-4df7e73f-119a-4f6a-8d9f-7ca199caa3f8 service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Detach interface failed, port_id=29272dca-3ab8-4b49-8d58-a85d831942ef, reason: Instance c5729613-2d22-4d9a-9751-e09dca84e0d6 could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 02:46:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:46:32 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance b1a0ba95-2678-493d-87ba-061abf80887a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:46:32 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance c5729613-2d22-4d9a-9751-e09dca84e0d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:46:32 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance c4ba4570-ea6f-4e39-9dc6-d9237807fa14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:46:32 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:46:32 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:46:32 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing inventories for resource provider a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 02:46:32 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Updating ProviderTree inventory for provider a962b30a-2750-431c-be10-075d0f991065 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 02:46:32 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Updating inventory in ProviderTree for provider a962b30a-2750-431c-be10-075d0f991065 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing aggregate associations for resource provider a962b30a-2750-431c-be10-075d0f991065, aggregates: None {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing trait associations for resource provider a962b30a-2750-431c-be10-075d0f991065, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.485s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] There are 0 instances to clean {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:46:33 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Deleted allocations for instance c5729613-2d22-4d9a-9751-e09dca84e0d6
Aug 27 02:46:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f9689a19-2815-4724-ad4c-5202c4f00425 tempest-TestStampPattern-31454635 tempest-TestStampPattern-31454635-project-member] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.743s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG nova.compute.manager [req-b9a8cf60-d30e-42f8-b1a4-2a63e8ccd008 req-47d9a0af-90d3-4f8e-818b-37100dbccb4a service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Received event network-vif-plugged-29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b9a8cf60-d30e-42f8-b1a4-2a63e8ccd008 req-47d9a0af-90d3-4f8e-818b-37100dbccb4a service nova] Acquiring lock "c5729613-2d22-4d9a-9751-e09dca84e0d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b9a8cf60-d30e-42f8-b1a4-2a63e8ccd008 req-47d9a0af-90d3-4f8e-818b-37100dbccb4a service nova] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b9a8cf60-d30e-42f8-b1a4-2a63e8ccd008 req-47d9a0af-90d3-4f8e-818b-37100dbccb4a service nova] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG nova.compute.manager [req-b9a8cf60-d30e-42f8-b1a4-2a63e8ccd008 req-47d9a0af-90d3-4f8e-818b-37100dbccb4a service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] No waiting events found dispatching network-vif-plugged-29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:46:33 user nova-compute[72820]: WARNING nova.compute.manager [req-b9a8cf60-d30e-42f8-b1a4-2a63e8ccd008 req-47d9a0af-90d3-4f8e-818b-37100dbccb4a service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Received unexpected event network-vif-plugged-29272dca-3ab8-4b49-8d58-a85d831942ef for instance with vm_state deleted and task_state None.
Aug 27 02:46:33 user nova-compute[72820]: DEBUG nova.compute.manager [req-b9a8cf60-d30e-42f8-b1a4-2a63e8ccd008 req-47d9a0af-90d3-4f8e-818b-37100dbccb4a service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Received event network-vif-plugged-29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b9a8cf60-d30e-42f8-b1a4-2a63e8ccd008 req-47d9a0af-90d3-4f8e-818b-37100dbccb4a service nova] Acquiring lock "c5729613-2d22-4d9a-9751-e09dca84e0d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b9a8cf60-d30e-42f8-b1a4-2a63e8ccd008 req-47d9a0af-90d3-4f8e-818b-37100dbccb4a service nova] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b9a8cf60-d30e-42f8-b1a4-2a63e8ccd008 req-47d9a0af-90d3-4f8e-818b-37100dbccb4a service nova] Lock "c5729613-2d22-4d9a-9751-e09dca84e0d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:46:33 user nova-compute[72820]: DEBUG nova.compute.manager [req-b9a8cf60-d30e-42f8-b1a4-2a63e8ccd008 req-47d9a0af-90d3-4f8e-818b-37100dbccb4a service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] No waiting events found dispatching network-vif-plugged-29272dca-3ab8-4b49-8d58-a85d831942ef {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:46:33 user nova-compute[72820]: WARNING nova.compute.manager [req-b9a8cf60-d30e-42f8-b1a4-2a63e8ccd008 req-47d9a0af-90d3-4f8e-818b-37100dbccb4a service nova] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Received unexpected event network-vif-plugged-29272dca-3ab8-4b49-8d58-a85d831942ef for instance with vm_state deleted and task_state None.
Aug 27 02:46:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:37 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:46:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:46:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Didn't find any instances for network info cache update. {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 02:46:37 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:46:40 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:46:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:46:46 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104391.3885412, c5729613-2d22-4d9a-9751-e09dca84e0d6 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:46:46 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] VM Stopped (Lifecycle Event)
Aug 27 02:46:46 user nova-compute[72820]: DEBUG nova.compute.manager [None req-5c669f86-6604-44a7-b518-ae647098cd54 None None] [instance: c5729613-2d22-4d9a-9751-e09dca84e0d6] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:46:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:46:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:46:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:46:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:46:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:46:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:01 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:04 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:47:04 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid b1a0ba95-2678-493d-87ba-061abf80887a {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:47:04 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid c4ba4570-ea6f-4e39-9dc6-d9237807fa14 {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:47:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "b1a0ba95-2678-493d-87ba-061abf80887a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:47:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "b1a0ba95-2678-493d-87ba-061abf80887a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:47:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:47:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:47:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:47:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "b1a0ba95-2678-493d-87ba-061abf80887a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:47:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:47:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:47:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:47:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:47:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:47:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:18 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:47:21 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:47:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:47:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-613e50f5-9a12-4f62-8b72-974ee1beefa8 req-5129cd66-eeca-41d9-bd93-99542de22907 service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Received event network-changed-b0d54248-5b36-4f64-9e05-2ab1acc60dc3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:47:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-613e50f5-9a12-4f62-8b72-974ee1beefa8 req-5129cd66-eeca-41d9-bd93-99542de22907 service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Refreshing instance network info cache due to event network-changed-b0d54248-5b36-4f64-9e05-2ab1acc60dc3. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:47:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-613e50f5-9a12-4f62-8b72-974ee1beefa8 req-5129cd66-eeca-41d9-bd93-99542de22907 service nova] Acquiring lock "refresh_cache-c4ba4570-ea6f-4e39-9dc6-d9237807fa14" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:47:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-613e50f5-9a12-4f62-8b72-974ee1beefa8 req-5129cd66-eeca-41d9-bd93-99542de22907 service nova] Acquired lock "refresh_cache-c4ba4570-ea6f-4e39-9dc6-d9237807fa14" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:47:21 user nova-compute[72820]: DEBUG nova.network.neutron [req-613e50f5-9a12-4f62-8b72-974ee1beefa8 req-5129cd66-eeca-41d9-bd93-99542de22907 service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Refreshing network info cache for port b0d54248-5b36-4f64-9e05-2ab1acc60dc3 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG nova.network.neutron [req-613e50f5-9a12-4f62-8b72-974ee1beefa8 req-5129cd66-eeca-41d9-bd93-99542de22907 service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Updated VIF entry in instance network info cache for port b0d54248-5b36-4f64-9e05-2ab1acc60dc3. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG nova.network.neutron [req-613e50f5-9a12-4f62-8b72-974ee1beefa8 req-5129cd66-eeca-41d9-bd93-99542de22907 service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Updating instance_info_cache with network_info: [{"id": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "address": "fa:16:3e:24:81:76", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d54248-5b", "ovs_interfaceid": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-613e50f5-9a12-4f62-8b72-974ee1beefa8 req-5129cd66-eeca-41d9-bd93-99542de22907 service nova] Releasing lock "refresh_cache-c4ba4570-ea6f-4e39-9dc6-d9237807fa14" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:47:22 user nova-compute[72820]: INFO nova.compute.manager [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Terminating instance
Aug 27 02:47:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-d3239f5e-6879-448a-bd33-bcfd4b98415d req-50d8bd9b-1983-4812-9897-26863061043d service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Received event network-vif-unplugged-b0d54248-5b36-4f64-9e05-2ab1acc60dc3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d3239f5e-6879-448a-bd33-bcfd4b98415d req-50d8bd9b-1983-4812-9897-26863061043d service nova] Acquiring lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d3239f5e-6879-448a-bd33-bcfd4b98415d req-50d8bd9b-1983-4812-9897-26863061043d service nova] Lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d3239f5e-6879-448a-bd33-bcfd4b98415d req-50d8bd9b-1983-4812-9897-26863061043d service nova] Lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-d3239f5e-6879-448a-bd33-bcfd4b98415d req-50d8bd9b-1983-4812-9897-26863061043d service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] No waiting events found dispatching network-vif-unplugged-b0d54248-5b36-4f64-9e05-2ab1acc60dc3 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-d3239f5e-6879-448a-bd33-bcfd4b98415d req-50d8bd9b-1983-4812-9897-26863061043d service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Received event network-vif-unplugged-b0d54248-5b36-4f64-9e05-2ab1acc60dc3 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:22 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Instance destroyed successfully.
Aug 27 02:47:22 user nova-compute[72820]: DEBUG nova.objects.instance [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lazy-loading 'resources' on Instance uuid c4ba4570-ea6f-4e39-9dc6-d9237807fa14 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-427908226',display_name='tempest-TestVolumeBootPattern-server-427908226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-427908226',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRxkQgla9cymo6EFmZDbQk1Vd9PsMUw375tHpE3C+G7XWKJ2wNxA3Wp7pGzZ5jGLrv690Dj/yrsqixKPzVZE/Db7oYR6ptdQgKfU5EdVib0jmGNDhSHb8FtGbnW3QaTgA==',key_name='tempest-TestVolumeBootPattern-410715465',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84f02ddcfa2b4571a4d7cacf1287aebd',ramdisk_id='',reservation_id='r-mpwqzh5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-631676638',owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:45:46Z,user_data=None,user_id='878038feacda4094b5d2c9e3814c8bf0',uuid=c4ba4570-ea6f-4e39-9dc6-d9237807fa14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "address": "fa:16:3e:24:81:76", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d54248-5b", "ovs_interfaceid": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converting VIF {"id": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "address": "fa:16:3e:24:81:76", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d54248-5b", "ovs_interfaceid": "b0d54248-5b36-4f64-9e05-2ab1acc60dc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:81:76,bridge_name='br-int',has_traffic_filtering=True,id=b0d54248-5b36-4f64-9e05-2ab1acc60dc3,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d54248-5b') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG os_vif [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:81:76,bridge_name='br-int',has_traffic_filtering=True,id=b0d54248-5b36-4f64-9e05-2ab1acc60dc3,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d54248-5b') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0d54248-5b, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:23 user nova-compute[72820]: INFO os_vif [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:81:76,bridge_name='br-int',has_traffic_filtering=True,id=b0d54248-5b36-4f64-9e05-2ab1acc60dc3,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d54248-5b')
Aug 27 02:47:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvBMRPFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:47:23 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5db9b19-7d3a-44f8-85ce-5bc02b861319]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:47:23 user nova-compute[72820]: No targets found.
Aug 27 02:47:23 user nova-compute[72820]: iSNS:
Aug 27 02:47:23 user nova-compute[72820]: No targets found.
Aug 27 02:47:23 user nova-compute[72820]: STATIC:
Aug 27 02:47:23 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac
Aug 27 02:47:23 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:47:23 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:47:23 user nova-compute[72820]: FIRMWARE:
Aug 27 02:47:23 user nova-compute[72820]: No targets found.
Aug 27 02:47:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:47:23 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:47:23 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da0f82a-81a8-4a70-a508-97bccae0de36]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d8677f-8d86-4040-819b-bed0b7f95c4b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)
Aug 27 02:47:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)
Aug 27 02:47:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c0207910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac'): ({'sdb'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Removing single pathed devices sdb {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90e881c-b0a5-4d61-8f0e-ea8f0195bab7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[98be4d39-e726-4666-a970-119475ad8bbc]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Flushing IO for device /dev/sdb {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8984030b-9324-4095-882c-2ee6a051683e]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f97d83-2cde-4d47-86b1-115d29aa7a37]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9196a4ef-5be6fe878e1aaa7c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9196a4ef', '/dev/disk/by-id/scsi-23562653666653837') {{(pid=84057) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[566152ce-d360-4cfe-8ba5-e4032bc9940a]: (4, None) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8dc60c-cdd6-412f-8026-a239f991e5d5]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dd62d2-e64c-4cd4-a954-7f048f56b939]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac, portal: 172.16.0.220,3260]
Aug 27 02:47:23 user nova-compute[72820]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac, portal: 172.16.0.220,3260] successful.
Aug 27 02:47:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f796b877-1af0-47b4-8f44-f6ef47ad7c05]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] <== disconnect_volume: return (316ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:47:23 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Deleting instance files /opt/stack/data/nova/instances/c4ba4570-ea6f-4e39-9dc6-d9237807fa14_del
Aug 27 02:47:23 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Deletion of /opt/stack/data/nova/instances/c4ba4570-ea6f-4e39-9dc6-d9237807fa14_del complete
Aug 27 02:47:23 user nova-compute[72820]: INFO nova.compute.manager [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 27 02:47:23 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:47:23 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:47:24 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:47:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:47:24 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:47:24 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Took 1.17 seconds to deallocate network for instance.
Aug 27 02:47:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-986f13bc-c3a6-4c04-908f-be44b186a56e req-3723eb8c-7226-41af-a24e-4cf873006ddc service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Received event network-vif-plugged-b0d54248-5b36-4f64-9e05-2ab1acc60dc3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:47:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-986f13bc-c3a6-4c04-908f-be44b186a56e req-3723eb8c-7226-41af-a24e-4cf873006ddc service nova] Acquiring lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:47:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-986f13bc-c3a6-4c04-908f-be44b186a56e req-3723eb8c-7226-41af-a24e-4cf873006ddc service nova] Lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:47:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-986f13bc-c3a6-4c04-908f-be44b186a56e req-3723eb8c-7226-41af-a24e-4cf873006ddc service nova] Lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:47:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-986f13bc-c3a6-4c04-908f-be44b186a56e req-3723eb8c-7226-41af-a24e-4cf873006ddc service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] No waiting events found dispatching network-vif-plugged-b0d54248-5b36-4f64-9e05-2ab1acc60dc3 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:47:24 user nova-compute[72820]: WARNING nova.compute.manager [req-986f13bc-c3a6-4c04-908f-be44b186a56e req-3723eb8c-7226-41af-a24e-4cf873006ddc service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Received unexpected event network-vif-plugged-b0d54248-5b36-4f64-9e05-2ab1acc60dc3 for instance with vm_state active and task_state deleting.
Aug 27 02:47:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-986f13bc-c3a6-4c04-908f-be44b186a56e req-3723eb8c-7226-41af-a24e-4cf873006ddc service nova] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Received event network-vif-deleted-b0d54248-5b36-4f64-9e05-2ab1acc60dc3 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:47:25 user nova-compute[72820]: INFO nova.compute.manager [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Took 0.80 seconds to detach 1 volumes for instance.
Aug 27 02:47:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:47:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:47:25 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:47:25 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:47:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:47:25 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Deleted allocations for instance c4ba4570-ea6f-4e39-9dc6-d9237807fa14
Aug 27 02:47:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1389f935-587e-4c1e-9f4b-44c48adf4fcd tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "c4ba4570-ea6f-4e39-9dc6-d9237807fa14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.500s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:47:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:28 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:47:30 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:47:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:47:32 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:47:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:47:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:47:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:47:32 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:47:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:47:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:47:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:47:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:47:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:33 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:47:33 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:47:33 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8528MB free_disk=25.198810577392578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:47:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:47:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:47:33 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance b1a0ba95-2678-493d-87ba-061abf80887a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:47:33 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:47:33 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:47:33 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:47:33 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:47:33 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:47:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:47:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:37 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104442.9635727, c4ba4570-ea6f-4e39-9dc6-d9237807fa14 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:47:37 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] VM Stopped (Lifecycle Event)
Aug 27 02:47:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7c34924f-8b04-4163-95e3-8a43d5c3e253 None None] [instance: c4ba4570-ea6f-4e39-9dc6-d9237807fa14] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:47:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:38 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:47:38 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:47:38 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 02:47:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-b1a0ba95-2678-493d-87ba-061abf80887a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:47:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-b1a0ba95-2678-493d-87ba-061abf80887a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:47:39 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:47:39 user nova-compute[72820]: DEBUG nova.objects.instance [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lazy-loading 'info_cache' on Instance uuid b1a0ba95-2678-493d-87ba-061abf80887a {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:47:39 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Updating instance_info_cache with network_info: [{"id": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "address": "fa:16:3e:36:09:99", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a90a590-7f", "ovs_interfaceid": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:47:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-b1a0ba95-2678-493d-87ba-061abf80887a" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:47:39 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:47:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:47:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:47:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquiring lock "b1a0ba95-2678-493d-87ba-061abf80887a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:47:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "b1a0ba95-2678-493d-87ba-061abf80887a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:47:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquiring lock "b1a0ba95-2678-493d-87ba-061abf80887a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:47:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "b1a0ba95-2678-493d-87ba-061abf80887a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:47:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "b1a0ba95-2678-493d-87ba-061abf80887a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:47:57 user nova-compute[72820]: INFO nova.compute.manager [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Terminating instance
Aug 27 02:47:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:47:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:58 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Instance destroyed successfully.
Aug 27 02:47:58 user nova-compute[72820]: DEBUG nova.objects.instance [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lazy-loading 'resources' on Instance uuid b1a0ba95-2678-493d-87ba-061abf80887a {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:47:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-523175913',display_name='tempest-ServersNegativeTestJSON-server-523175913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-523175913',id=33,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:38:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0977a141ee1145b3a94c5cd60571d3d2',ramdisk_id='',reservation_id='r-kdcehtll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1999174782',owner_user_name='tempest-ServersNegativeTestJSON-1999174782-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:38:49Z,user_data=None,user_id='314d3a67dbd24abb848225eaeaa33da6',uuid=b1a0ba95-2678-493d-87ba-061abf80887a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "address": "fa:16:3e:36:09:99", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a90a590-7f", "ovs_interfaceid": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:47:58 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Converting VIF {"id": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "address": "fa:16:3e:36:09:99", "network": {"id": "5f1eaafc-a7ec-4d9d-b853-a4930adeb587", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623393009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0977a141ee1145b3a94c5cd60571d3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a90a590-7f", "ovs_interfaceid": "4a90a590-7f63-4988-87bf-d7dd0ac275cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:47:58 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:09:99,bridge_name='br-int',has_traffic_filtering=True,id=4a90a590-7f63-4988-87bf-d7dd0ac275cd,network=Network(5f1eaafc-a7ec-4d9d-b853-a4930adeb587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a90a590-7f') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:47:58 user nova-compute[72820]: DEBUG os_vif [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:09:99,bridge_name='br-int',has_traffic_filtering=True,id=4a90a590-7f63-4988-87bf-d7dd0ac275cd,network=Network(5f1eaafc-a7ec-4d9d-b853-a4930adeb587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a90a590-7f') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:47:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a90a590-7f, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:47:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:47:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:47:58 user nova-compute[72820]: INFO os_vif [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:09:99,bridge_name='br-int',has_traffic_filtering=True,id=4a90a590-7f63-4988-87bf-d7dd0ac275cd,network=Network(5f1eaafc-a7ec-4d9d-b853-a4930adeb587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a90a590-7f')
Aug 27 02:47:58 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Deleting instance files /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a_del
Aug 27 02:47:58 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Deletion of /opt/stack/data/nova/instances/b1a0ba95-2678-493d-87ba-061abf80887a_del complete
Aug 27 02:47:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-ad593ddd-4cde-4d8e-8e6a-640a561b697a req-e14f2c62-a977-4a21-ad20-d51846238d3a service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Received event network-vif-unplugged-4a90a590-7f63-4988-87bf-d7dd0ac275cd {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:47:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ad593ddd-4cde-4d8e-8e6a-640a561b697a req-e14f2c62-a977-4a21-ad20-d51846238d3a service nova] Acquiring lock "b1a0ba95-2678-493d-87ba-061abf80887a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:47:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ad593ddd-4cde-4d8e-8e6a-640a561b697a req-e14f2c62-a977-4a21-ad20-d51846238d3a service nova] Lock "b1a0ba95-2678-493d-87ba-061abf80887a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:47:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ad593ddd-4cde-4d8e-8e6a-640a561b697a req-e14f2c62-a977-4a21-ad20-d51846238d3a service nova] Lock "b1a0ba95-2678-493d-87ba-061abf80887a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:47:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-ad593ddd-4cde-4d8e-8e6a-640a561b697a req-e14f2c62-a977-4a21-ad20-d51846238d3a service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] No waiting events found dispatching network-vif-unplugged-4a90a590-7f63-4988-87bf-d7dd0ac275cd {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:47:58 user nova-compute[72820]: DEBUG nova.compute.manager [req-ad593ddd-4cde-4d8e-8e6a-640a561b697a req-e14f2c62-a977-4a21-ad20-d51846238d3a service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Received event network-vif-unplugged-4a90a590-7f63-4988-87bf-d7dd0ac275cd for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:47:58 user nova-compute[72820]: INFO nova.compute.manager [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 27 02:47:58 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:47:58 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:47:58 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:47:59 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:47:59 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Took 0.59 seconds to deallocate network for instance.
Aug 27 02:47:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-222d1c17-84bc-41e2-8976-feaccd1b8183 req-351c47e0-e431-4196-8ac2-7d32fc862b12 service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Received event network-vif-deleted-4a90a590-7f63-4988-87bf-d7dd0ac275cd {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:47:59 user nova-compute[72820]: INFO nova.compute.manager [req-222d1c17-84bc-41e2-8976-feaccd1b8183 req-351c47e0-e431-4196-8ac2-7d32fc862b12 service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Neutron deleted interface 4a90a590-7f63-4988-87bf-d7dd0ac275cd; detaching it from the instance and deleting it from the info cache
Aug 27 02:47:59 user nova-compute[72820]: DEBUG nova.network.neutron [req-222d1c17-84bc-41e2-8976-feaccd1b8183 req-351c47e0-e431-4196-8ac2-7d32fc862b12 service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:47:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-222d1c17-84bc-41e2-8976-feaccd1b8183 req-351c47e0-e431-4196-8ac2-7d32fc862b12 service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Detach interface failed, port_id=4a90a590-7f63-4988-87bf-d7dd0ac275cd, reason: Instance b1a0ba95-2678-493d-87ba-061abf80887a could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 02:47:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:47:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:47:59 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:47:59 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:47:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:47:59 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Deleted allocations for instance b1a0ba95-2678-493d-87ba-061abf80887a
Aug 27 02:47:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f31c19b7-4607-440c-9797-7290dcb89729 tempest-ServersNegativeTestJSON-1999174782 tempest-ServersNegativeTestJSON-1999174782-project-member] Lock "b1a0ba95-2678-493d-87ba-061abf80887a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.739s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:48:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-450d11fd-79f5-4772-bbd7-c3e0dfb445cb req-7bd0edf4-98de-4320-bf01-83c83cd8b507 service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Received event network-vif-plugged-4a90a590-7f63-4988-87bf-d7dd0ac275cd {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:48:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-450d11fd-79f5-4772-bbd7-c3e0dfb445cb req-7bd0edf4-98de-4320-bf01-83c83cd8b507 service nova] Acquiring lock "b1a0ba95-2678-493d-87ba-061abf80887a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:48:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-450d11fd-79f5-4772-bbd7-c3e0dfb445cb req-7bd0edf4-98de-4320-bf01-83c83cd8b507 service nova] Lock "b1a0ba95-2678-493d-87ba-061abf80887a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:48:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-450d11fd-79f5-4772-bbd7-c3e0dfb445cb req-7bd0edf4-98de-4320-bf01-83c83cd8b507 service nova] Lock "b1a0ba95-2678-493d-87ba-061abf80887a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:48:00 user nova-compute[72820]: DEBUG nova.compute.manager [req-450d11fd-79f5-4772-bbd7-c3e0dfb445cb req-7bd0edf4-98de-4320-bf01-83c83cd8b507 service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] No waiting events found dispatching network-vif-plugged-4a90a590-7f63-4988-87bf-d7dd0ac275cd {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:48:00 user nova-compute[72820]: WARNING nova.compute.manager [req-450d11fd-79f5-4772-bbd7-c3e0dfb445cb req-7bd0edf4-98de-4320-bf01-83c83cd8b507 service nova] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Received unexpected event network-vif-plugged-4a90a590-7f63-4988-87bf-d7dd0ac275cd for instance with vm_state deleted and task_state None.
Aug 27 02:48:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:13 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104478.4106061, b1a0ba95-2678-493d-87ba-061abf80887a => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:48:13 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] VM Stopped (Lifecycle Event)
Aug 27 02:48:13 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ce355da3-d6e1-4c12-be31-e64c89deafdc None None] [instance: b1a0ba95-2678-493d-87ba-061abf80887a] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:48:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "4480b84a-32b2-4276-ab6d-8c47f4057e55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "4480b84a-32b2-4276-ab6d-8c47f4057e55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:48:14 user nova-compute[72820]: INFO nova.compute.claims [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Claim successful on node user
Aug 27 02:48:14 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:48:14 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:48:14 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:48:14 user nova-compute[72820]: INFO nova.virt.block_device [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Booting with volume abf4d7e0-e457-4f47-830c-0820098fe4ac at /dev/vda
Aug 27 02:48:14 user nova-compute[72820]: DEBUG nova.policy [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '878038feacda4094b5d2c9e3814c8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f02ddcfa2b4571a4d7cacf1287aebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG os_brick.utils [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab7b1e1-9016-4759-b968-d972eb9c6cbb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c141bca0-f439-46e7-b1f4-14956c30432c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[230b2a3e-d819-4273-bad5-8f49bac75644]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd2e2f5-210e-46b4-9498-54c6edd40974]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:48:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:48:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:48:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:48:15 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:48:15 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[12647e32-58f4-47b4-9730-4747ae2bc6b5]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:48:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:48:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:48:15 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:48:15 user nova-compute[72820]: DEBUG os_brick.utils [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:48:15 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Updating existing volume attachment record: 411a26b1-02dc-4053-8633-3c585c49203b {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:48:15 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Successfully created port: 90b1244f-a157-42c2-976d-126d71109e67 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:48:16 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Successfully updated port: 90b1244f-a157-42c2-976d-126d71109e67 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:48:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:48:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquired lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:48:16 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:48:16 user nova-compute[72820]: DEBUG nova.compute.manager [req-de6d34ec-259c-4aeb-9a47-b6ee62eb2127 req-d1f4564c-5b2d-43e2-9d51-77da48a98b1a service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Received event network-changed-90b1244f-a157-42c2-976d-126d71109e67 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:48:16 user nova-compute[72820]: DEBUG nova.compute.manager [req-de6d34ec-259c-4aeb-9a47-b6ee62eb2127 req-d1f4564c-5b2d-43e2-9d51-77da48a98b1a service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Refreshing instance network info cache due to event network-changed-90b1244f-a157-42c2-976d-126d71109e67. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:48:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-de6d34ec-259c-4aeb-9a47-b6ee62eb2127 req-d1f4564c-5b2d-43e2-9d51-77da48a98b1a service nova] Acquiring lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:48:16 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:48:16 user nova-compute[72820]: DEBUG nova.network.neutron [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Updating instance_info_cache with network_info: [{"id": "90b1244f-a157-42c2-976d-126d71109e67", "address": "fa:16:3e:4c:2c:25", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b1244f-a1", "ovs_interfaceid": "90b1244f-a157-42c2-976d-126d71109e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:48:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Releasing lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:48:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Instance network_info: |[{"id": "90b1244f-a157-42c2-976d-126d71109e67", "address": "fa:16:3e:4c:2c:25", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b1244f-a1", "ovs_interfaceid": "90b1244f-a157-42c2-976d-126d71109e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:48:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-de6d34ec-259c-4aeb-9a47-b6ee62eb2127 req-d1f4564c-5b2d-43e2-9d51-77da48a98b1a service nova] Acquired lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:48:16 user nova-compute[72820]: DEBUG nova.network.neutron [req-de6d34ec-259c-4aeb-9a47-b6ee62eb2127 req-d1f4564c-5b2d-43e2-9d51-77da48a98b1a service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Refreshing network info cache for port 90b1244f-a157-42c2-976d-126d71109e67 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:48:17 user nova-compute[72820]: DEBUG nova.network.neutron [req-de6d34ec-259c-4aeb-9a47-b6ee62eb2127 req-d1f4564c-5b2d-43e2-9d51-77da48a98b1a service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Updated VIF entry in instance network info cache for port 90b1244f-a157-42c2-976d-126d71109e67. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:48:17 user nova-compute[72820]: DEBUG nova.network.neutron [req-de6d34ec-259c-4aeb-9a47-b6ee62eb2127 req-d1f4564c-5b2d-43e2-9d51-77da48a98b1a service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Updating instance_info_cache with network_info: [{"id": "90b1244f-a157-42c2-976d-126d71109e67", "address": "fa:16:3e:4c:2c:25", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b1244f-a1", "ovs_interfaceid": "90b1244f-a157-42c2-976d-126d71109e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:48:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-de6d34ec-259c-4aeb-9a47-b6ee62eb2127 req-d1f4564c-5b2d-43e2-9d51-77da48a98b1a service nova] Releasing lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:48:18 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:48:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Acquiring lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG nova.compute.manager [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:48:19 user nova-compute[72820]: INFO nova.compute.claims [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Claim successful on node user
Aug 27 02:48:19 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.240s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG nova.compute.manager [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG nova.compute.manager [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG nova.network.neutron [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:48:19 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:48:19 user nova-compute[72820]: DEBUG nova.compute.manager [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG nova.compute.manager [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:48:19 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Creating image(s)
Aug 27 02:48:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Lock "/opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Lock "/opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.187s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:48:19 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.181s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:20 user nova-compute[72820]: DEBUG nova.policy [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '086aa08d8551468882824e486f863640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4007a2f671140fea2d98e36c00e2e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:48:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/disk 1073741824" returned: 0 in 0.052s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:48:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.175s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:20 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:48:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:20 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:20 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Cannot resize image /opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:48:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:48:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Ensure instance console log exists: /opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:48:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:48:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:48:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:48:20 user nova-compute[72820]: DEBUG nova.network.neutron [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Successfully created port: e14b9c96-1c03-44f5-b9dd-0da2092d7442 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:48:21 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:48:21 user nova-compute[72820]: DEBUG nova.network.neutron [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Successfully updated port: e14b9c96-1c03-44f5-b9dd-0da2092d7442 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:48:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Acquiring lock "refresh_cache-cf2d330e-386a-4300-b1c3-99d5b44b78bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:48:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Acquired lock "refresh_cache-cf2d330e-386a-4300-b1c3-99d5b44b78bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:48:21 user nova-compute[72820]: DEBUG nova.network.neutron [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:48:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-c14b9457-e63c-448e-acb3-b1c263f65e60 req-50c46275-97d2-4056-8e4c-fbc645882ac0 service nova] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Received event network-changed-e14b9c96-1c03-44f5-b9dd-0da2092d7442 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:48:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-c14b9457-e63c-448e-acb3-b1c263f65e60 req-50c46275-97d2-4056-8e4c-fbc645882ac0 service nova] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Refreshing instance network info cache due to event network-changed-e14b9c96-1c03-44f5-b9dd-0da2092d7442. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:48:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c14b9457-e63c-448e-acb3-b1c263f65e60 req-50c46275-97d2-4056-8e4c-fbc645882ac0 service nova] Acquiring lock "refresh_cache-cf2d330e-386a-4300-b1c3-99d5b44b78bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:48:21 user nova-compute[72820]: DEBUG nova.network.neutron [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.network.neutron [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Updating instance_info_cache with network_info: [{"id": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "address": "fa:16:3e:68:09:84", "network": {"id": "11bbf161-b267-4b4c-a07e-95e2e1d152c3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "74aabc5a6b3140eeac78f2075029cb88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape14b9c96-1c", "ovs_interfaceid": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Releasing lock "refresh_cache-cf2d330e-386a-4300-b1c3-99d5b44b78bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Instance network_info: |[{"id": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "address": "fa:16:3e:68:09:84", "network": {"id": "11bbf161-b267-4b4c-a07e-95e2e1d152c3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "74aabc5a6b3140eeac78f2075029cb88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape14b9c96-1c", "ovs_interfaceid": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c14b9457-e63c-448e-acb3-b1c263f65e60 req-50c46275-97d2-4056-8e4c-fbc645882ac0 service nova] Acquired lock "refresh_cache-cf2d330e-386a-4300-b1c3-99d5b44b78bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.network.neutron [req-c14b9457-e63c-448e-acb3-b1c263f65e60 req-50c46275-97d2-4056-8e4c-fbc645882ac0 service nova] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Refreshing network info cache for port e14b9c96-1c03-44f5-b9dd-0da2092d7442 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Start _get_guest_xml network_info=[{"id": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "address": "fa:16:3e:68:09:84", "network": {"id": "11bbf161-b267-4b4c-a07e-95e2e1d152c3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "74aabc5a6b3140eeac78f2075029cb88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape14b9c96-1c", "ovs_interfaceid": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:48:22 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:48:22 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:48:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-978396871',display_name='tempest-VolumesNegativeTest-instance-978396871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-978396871',id=43,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4007a2f671140fea2d98e36c00e2e21',ramdisk_id='',reservation_id='r-dyeo32wh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1909179835',owner_user_name='tempest-VolumesNegativeTest-1909179835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:48:20Z,user_data=None,user_id='086aa08d8551468882824e486f863640',uuid=cf2d330e-386a-4300-b1c3-99d5b44b78bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "address": "fa:16:3e:68:09:84", "network": {"id": "11bbf161-b267-4b4c-a07e-95e2e1d152c3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "74aabc5a6b3140eeac78f2075029cb88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape14b9c96-1c", "ovs_interfaceid": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Converting VIF {"id": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "address": "fa:16:3e:68:09:84", "network": {"id": "11bbf161-b267-4b4c-a07e-95e2e1d152c3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "74aabc5a6b3140eeac78f2075029cb88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape14b9c96-1c", "ovs_interfaceid": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:09:84,bridge_name='br-int',has_traffic_filtering=True,id=e14b9c96-1c03-44f5-b9dd-0da2092d7442,network=Network(11bbf161-b267-4b4c-a07e-95e2e1d152c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape14b9c96-1c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.objects.instance [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Lazy-loading 'pci_devices' on Instance uuid cf2d330e-386a-4300-b1c3-99d5b44b78bf {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:48:22 user nova-compute[72820]:   <uuid>cf2d330e-386a-4300-b1c3-99d5b44b78bf</uuid>
Aug 27 02:48:22 user nova-compute[72820]:   <name>instance-0000002b</name>
Aug 27 02:48:22 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:48:22 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:48:22 user nova-compute[72820]:   <metadata>
Aug 27 02:48:22 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:48:22 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:48:22 user nova-compute[72820]:       <nova:name>tempest-VolumesNegativeTest-instance-978396871</nova:name>
Aug 27 02:48:22 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:48:22</nova:creationTime>
Aug 27 02:48:22 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:48:22 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:48:22 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:48:22 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:48:22 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:48:22 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:48:22 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:48:22 user nova-compute[72820]:       <nova:owner>
Aug 27 02:48:22 user nova-compute[72820]:         <nova:user uuid="086aa08d8551468882824e486f863640">tempest-VolumesNegativeTest-1909179835-project-member</nova:user>
Aug 27 02:48:22 user nova-compute[72820]:         <nova:project uuid="b4007a2f671140fea2d98e36c00e2e21">tempest-VolumesNegativeTest-1909179835</nova:project>
Aug 27 02:48:22 user nova-compute[72820]:       </nova:owner>
Aug 27 02:48:22 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:48:22 user nova-compute[72820]:       <nova:ports>
Aug 27 02:48:22 user nova-compute[72820]:         <nova:port uuid="e14b9c96-1c03-44f5-b9dd-0da2092d7442">
Aug 27 02:48:22 user nova-compute[72820]:           <nova:ip type="fixed" address="192.168.233.167" ipVersion="4"/>
Aug 27 02:48:22 user nova-compute[72820]:         </nova:port>
Aug 27 02:48:22 user nova-compute[72820]:       </nova:ports>
Aug 27 02:48:22 user nova-compute[72820]:     </nova:instance>
Aug 27 02:48:22 user nova-compute[72820]:   </metadata>
Aug 27 02:48:22 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:48:22 user nova-compute[72820]:     <system>
Aug 27 02:48:22 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:48:22 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:48:22 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:48:22 user nova-compute[72820]:       <entry name="serial">cf2d330e-386a-4300-b1c3-99d5b44b78bf</entry>
Aug 27 02:48:22 user nova-compute[72820]:       <entry name="uuid">cf2d330e-386a-4300-b1c3-99d5b44b78bf</entry>
Aug 27 02:48:22 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:48:22 user nova-compute[72820]:     </system>
Aug 27 02:48:22 user nova-compute[72820]:   </sysinfo>
Aug 27 02:48:22 user nova-compute[72820]:   <os>
Aug 27 02:48:22 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:48:22 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:48:22 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:48:22 user nova-compute[72820]:   </os>
Aug 27 02:48:22 user nova-compute[72820]:   <features>
Aug 27 02:48:22 user nova-compute[72820]:     <acpi/>
Aug 27 02:48:22 user nova-compute[72820]:     <apic/>
Aug 27 02:48:22 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:48:22 user nova-compute[72820]:   </features>
Aug 27 02:48:22 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:48:22 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:48:22 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:48:22 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:48:22 user nova-compute[72820]:   </clock>
Aug 27 02:48:22 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:48:22 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:48:22 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:48:22 user nova-compute[72820]:   </cpu>
Aug 27 02:48:22 user nova-compute[72820]:   <devices>
Aug 27 02:48:22 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:48:22 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:48:22 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/disk"/>
Aug 27 02:48:22 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:48:22 user nova-compute[72820]:     </disk>
Aug 27 02:48:22 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:48:22 user nova-compute[72820]:       <mac address="fa:16:3e:68:09:84"/>
Aug 27 02:48:22 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:48:22 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:48:22 user nova-compute[72820]:       <target dev="tape14b9c96-1c"/>
Aug 27 02:48:22 user nova-compute[72820]:     </interface>
Aug 27 02:48:22 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:48:22 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/console.log" append="off"/>
Aug 27 02:48:22 user nova-compute[72820]:     </serial>
Aug 27 02:48:22 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:48:22 user nova-compute[72820]:     <video>
Aug 27 02:48:22 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:48:22 user nova-compute[72820]:     </video>
Aug 27 02:48:22 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:48:22 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:48:22 user nova-compute[72820]:     </rng>
Aug 27 02:48:22 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:48:22 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:48:22 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:48:22 user nova-compute[72820]:     </memballoon>
Aug 27 02:48:22 user nova-compute[72820]:   </devices>
Aug 27 02:48:22 user nova-compute[72820]: </domain>
Aug 27 02:48:22 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:48:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-978396871',display_name='tempest-VolumesNegativeTest-instance-978396871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-978396871',id=43,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4007a2f671140fea2d98e36c00e2e21',ramdisk_id='',reservation_id='r-dyeo32wh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1909179835',owner_user_name='tempest-VolumesNegativeTest-1909179835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:48:20Z,user_data=None,user_id='086aa08d8551468882824e486f863640',uuid=cf2d330e-386a-4300-b1c3-99d5b44b78bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "address": "fa:16:3e:68:09:84", "network": {"id": "11bbf161-b267-4b4c-a07e-95e2e1d152c3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "74aabc5a6b3140eeac78f2075029cb88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape14b9c96-1c", "ovs_interfaceid": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Converting VIF {"id": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "address": "fa:16:3e:68:09:84", "network": {"id": "11bbf161-b267-4b4c-a07e-95e2e1d152c3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "74aabc5a6b3140eeac78f2075029cb88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape14b9c96-1c", "ovs_interfaceid": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:09:84,bridge_name='br-int',has_traffic_filtering=True,id=e14b9c96-1c03-44f5-b9dd-0da2092d7442,network=Network(11bbf161-b267-4b4c-a07e-95e2e1d152c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape14b9c96-1c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG os_vif [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:09:84,bridge_name='br-int',has_traffic_filtering=True,id=e14b9c96-1c03-44f5-b9dd-0da2092d7442,network=Network(11bbf161-b267-4b4c-a07e-95e2e1d152c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape14b9c96-1c') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape14b9c96-1c, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape14b9c96-1c, col_values=(('external_ids', {'iface-id': 'e14b9c96-1c03-44f5-b9dd-0da2092d7442', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:09:84', 'vm-uuid': 'cf2d330e-386a-4300-b1c3-99d5b44b78bf'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:22 user nova-compute[72820]: INFO os_vif [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:09:84,bridge_name='br-int',has_traffic_filtering=True,id=e14b9c96-1c03-44f5-b9dd-0da2092d7442,network=Network(11bbf161-b267-4b4c-a07e-95e2e1d152c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape14b9c96-1c')
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] No VIF found with MAC fa:16:3e:68:09:84, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.network.neutron [req-c14b9457-e63c-448e-acb3-b1c263f65e60 req-50c46275-97d2-4056-8e4c-fbc645882ac0 service nova] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Updated VIF entry in instance network info cache for port e14b9c96-1c03-44f5-b9dd-0da2092d7442. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG nova.network.neutron [req-c14b9457-e63c-448e-acb3-b1c263f65e60 req-50c46275-97d2-4056-8e4c-fbc645882ac0 service nova] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Updating instance_info_cache with network_info: [{"id": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "address": "fa:16:3e:68:09:84", "network": {"id": "11bbf161-b267-4b4c-a07e-95e2e1d152c3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "74aabc5a6b3140eeac78f2075029cb88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape14b9c96-1c", "ovs_interfaceid": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:48:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c14b9457-e63c-448e-acb3-b1c263f65e60 req-50c46275-97d2-4056-8e4c-fbc645882ac0 service nova] Releasing lock "refresh_cache-cf2d330e-386a-4300-b1c3-99d5b44b78bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:48:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-2ade4a86-0d69-4af9-8488-e10eb427479e req-8a493627-ad17-4fab-a787-46145ad26329 service nova] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Received event network-vif-plugged-e14b9c96-1c03-44f5-b9dd-0da2092d7442 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:48:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2ade4a86-0d69-4af9-8488-e10eb427479e req-8a493627-ad17-4fab-a787-46145ad26329 service nova] Acquiring lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:48:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2ade4a86-0d69-4af9-8488-e10eb427479e req-8a493627-ad17-4fab-a787-46145ad26329 service nova] Lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:48:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2ade4a86-0d69-4af9-8488-e10eb427479e req-8a493627-ad17-4fab-a787-46145ad26329 service nova] Lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:48:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-2ade4a86-0d69-4af9-8488-e10eb427479e req-8a493627-ad17-4fab-a787-46145ad26329 service nova] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] No waiting events found dispatching network-vif-plugged-e14b9c96-1c03-44f5-b9dd-0da2092d7442 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:48:24 user nova-compute[72820]: WARNING nova.compute.manager [req-2ade4a86-0d69-4af9-8488-e10eb427479e req-8a493627-ad17-4fab-a787-46145ad26329 service nova] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Received unexpected event network-vif-plugged-e14b9c96-1c03-44f5-b9dd-0da2092d7442 for instance with vm_state building and task_state spawning.
Aug 27 02:48:24 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:48:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:25 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:48:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:48:25 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104505.9225802, cf2d330e-386a-4300-b1c3-99d5b44b78bf => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:48:25 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] VM Resumed (Lifecycle Event)
Aug 27 02:48:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:48:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:48:25 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Instance spawned successfully.
Aug 27 02:48:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:48:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:48:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:48:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:48:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:48:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:48:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:48:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:48:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:48:25 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:48:25 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104505.9238098, cf2d330e-386a-4300-b1c3-99d5b44b78bf => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:48:25 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] VM Started (Lifecycle Event)
Aug 27 02:48:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:48:26 user nova-compute[72820]: INFO nova.compute.manager [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Took 6.24 seconds to spawn the instance on the hypervisor.
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:48:26 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:48:26 user nova-compute[72820]: INFO nova.compute.manager [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Took 6.81 seconds to build instance.
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.compute.manager [req-746e598e-fbd9-440f-ac6d-dc425bfac02a req-888cb4ea-a7ef-4527-80c8-52b9ff45ee34 service nova] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Received event network-vif-plugged-e14b9c96-1c03-44f5-b9dd-0da2092d7442 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-746e598e-fbd9-440f-ac6d-dc425bfac02a req-888cb4ea-a7ef-4527-80c8-52b9ff45ee34 service nova] Acquiring lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-746e598e-fbd9-440f-ac6d-dc425bfac02a req-888cb4ea-a7ef-4527-80c8-52b9ff45ee34 service nova] Lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-746e598e-fbd9-440f-ac6d-dc425bfac02a req-888cb4ea-a7ef-4527-80c8-52b9ff45ee34 service nova] Lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.compute.manager [req-746e598e-fbd9-440f-ac6d-dc425bfac02a req-888cb4ea-a7ef-4527-80c8-52b9ff45ee34 service nova] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] No waiting events found dispatching network-vif-plugged-e14b9c96-1c03-44f5-b9dd-0da2092d7442 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:48:26 user nova-compute[72820]: WARNING nova.compute.manager [req-746e598e-fbd9-440f-ac6d-dc425bfac02a req-888cb4ea-a7ef-4527-80c8-52b9ff45ee34 service nova] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Received unexpected event network-vif-plugged-e14b9c96-1c03-44f5-b9dd-0da2092d7442 for instance with vm_state active and task_state None.
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-695d2967-e188-44f7-81ad-2220f70dd535 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.908s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:48:26 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Creating image(s)
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Did not create local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Ensure instance console log exists: /opt/stack/data/nova/instances/4480b84a-32b2-4276-ab6d-8c47f4057e55/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Start _get_guest_xml network_info=[{"id": "90b1244f-a157-42c2-976d-126d71109e67", "address": "fa:16:3e:4c:2c:25", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b1244f-a1", "ovs_interfaceid": "90b1244f-a157-42c2-976d-126d71109e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '411a26b1-02dc-4053-8633-3c585c49203b', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvBMRPFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4480b84a-32b2-4276-ab6d-8c47f4057e55', 'attached_at': '', 'detached_at': '', 'volume_id': 'abf4d7e0-e457-4f47-830c-0820098fe4ac', 'serial': 'abf4d7e0-e457-4f47-830c-0820098fe4ac'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:48:26 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:48:26 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvBMRPFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:48:26 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:48:26 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:48:26 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58e2599-c53d-451a-af65-c878ff990a6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:48:26 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabcb098-6115-4a2e-8422-7d75a39343ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac] added
Aug 27 02:48:26 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1ea07e-d72e-46e4-83a0-b15d566c53e3]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b262edc-985e-47dc-baaa-657766d032f1]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dvBMRPFG {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dvBMRPFG" returned: 0 in 0.062s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[61971a26-02b4-45e7-b652-0d49cd3e1933]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dvBMRPFG'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5700f958-6cc8-4e80-af9b-2cd5c2493a39]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25d32c7-3d7a-451e-89a1-b5c9e623dff5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 02:48:26 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 02:48:26 user nova-compute[72820]:  {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:48:26 user nova-compute[72820]: WARNING os_brick.initiator.connectors.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 02:48:26 user nova-compute[72820]: 
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce519b7e-0ab0-499f-a7ce-08273e4b4464]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac, portal: 172.16.0.220,3260]
Aug 27 02:48:26 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac, portal: 172.16.0.220,3260] successful.
Aug 27 02:48:26 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e880f3b-51ab-49e1-8403-d9988352c71c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8616c7-95e1-4f23-9999-738d27528b61]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)
Aug 27 02:48:26 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)
Aug 27 02:48:26 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[41accf03-2498-42c0-902c-3f0bee7a8dc6]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:48:26 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvBMRPFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23562653666653837', 'path': '/dev/sdb'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562653666653837', 'path': '/dev/sdb'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-753987207',display_name='tempest-TestVolumeBootPattern-server-753987207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-753987207',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRxkQgla9cymo6EFmZDbQk1Vd9PsMUw375tHpE3C+G7XWKJ2wNxA3Wp7pGzZ5jGLrv690Dj/yrsqixKPzVZE/Db7oYR6ptdQgKfU5EdVib0jmGNDhSHb8FtGbnW3QaTgA==',key_name='tempest-TestVolumeBootPattern-410715465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84f02ddcfa2b4571a4d7cacf1287aebd',ramdisk_id='',reservation_id='r-veeocn8e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-631676638',owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:48:15Z,user_data=None,user_id='878038feacda4094b5d2c9e3814c8bf0',uuid=4480b84a-32b2-4276-ab6d-8c47f4057e55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90b1244f-a157-42c2-976d-126d71109e67", "address": "fa:16:3e:4c:2c:25", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b1244f-a1", "ovs_interfaceid": "90b1244f-a157-42c2-976d-126d71109e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converting VIF {"id": "90b1244f-a157-42c2-976d-126d71109e67", "address": "fa:16:3e:4c:2c:25", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b1244f-a1", "ovs_interfaceid": "90b1244f-a157-42c2-976d-126d71109e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:2c:25,bridge_name='br-int',has_traffic_filtering=True,id=90b1244f-a157-42c2-976d-126d71109e67,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b1244f-a1') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG nova.objects.instance [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lazy-loading 'pci_devices' on Instance uuid 4480b84a-32b2-4276-ab6d-8c47f4057e55 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:48:27 user nova-compute[72820]:   <uuid>4480b84a-32b2-4276-ab6d-8c47f4057e55</uuid>
Aug 27 02:48:27 user nova-compute[72820]:   <name>instance-0000002a</name>
Aug 27 02:48:27 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:48:27 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:48:27 user nova-compute[72820]:   <metadata>
Aug 27 02:48:27 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:48:27 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:48:27 user nova-compute[72820]:       <nova:name>tempest-TestVolumeBootPattern-server-753987207</nova:name>
Aug 27 02:48:27 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:48:26</nova:creationTime>
Aug 27 02:48:27 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:48:27 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:48:27 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:48:27 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:48:27 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:48:27 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:48:27 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:48:27 user nova-compute[72820]:       <nova:owner>
Aug 27 02:48:27 user nova-compute[72820]:         <nova:user uuid="878038feacda4094b5d2c9e3814c8bf0">tempest-TestVolumeBootPattern-631676638-project-member</nova:user>
Aug 27 02:48:27 user nova-compute[72820]:         <nova:project uuid="84f02ddcfa2b4571a4d7cacf1287aebd">tempest-TestVolumeBootPattern-631676638</nova:project>
Aug 27 02:48:27 user nova-compute[72820]:       </nova:owner>
Aug 27 02:48:27 user nova-compute[72820]:       <nova:ports>
Aug 27 02:48:27 user nova-compute[72820]:         <nova:port uuid="90b1244f-a157-42c2-976d-126d71109e67">
Aug 27 02:48:27 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 02:48:27 user nova-compute[72820]:         </nova:port>
Aug 27 02:48:27 user nova-compute[72820]:       </nova:ports>
Aug 27 02:48:27 user nova-compute[72820]:     </nova:instance>
Aug 27 02:48:27 user nova-compute[72820]:   </metadata>
Aug 27 02:48:27 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:48:27 user nova-compute[72820]:     <system>
Aug 27 02:48:27 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:48:27 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:48:27 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:48:27 user nova-compute[72820]:       <entry name="serial">4480b84a-32b2-4276-ab6d-8c47f4057e55</entry>
Aug 27 02:48:27 user nova-compute[72820]:       <entry name="uuid">4480b84a-32b2-4276-ab6d-8c47f4057e55</entry>
Aug 27 02:48:27 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:48:27 user nova-compute[72820]:     </system>
Aug 27 02:48:27 user nova-compute[72820]:   </sysinfo>
Aug 27 02:48:27 user nova-compute[72820]:   <os>
Aug 27 02:48:27 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:48:27 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:48:27 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:48:27 user nova-compute[72820]:   </os>
Aug 27 02:48:27 user nova-compute[72820]:   <features>
Aug 27 02:48:27 user nova-compute[72820]:     <acpi/>
Aug 27 02:48:27 user nova-compute[72820]:     <apic/>
Aug 27 02:48:27 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:48:27 user nova-compute[72820]:   </features>
Aug 27 02:48:27 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:48:27 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:48:27 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:48:27 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:48:27 user nova-compute[72820]:   </clock>
Aug 27 02:48:27 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:48:27 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:48:27 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:48:27 user nova-compute[72820]:   </cpu>
Aug 27 02:48:27 user nova-compute[72820]:   <devices>
Aug 27 02:48:27 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:48:27 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:48:27 user nova-compute[72820]:       <source dev="/dev/sdb"/>
Aug 27 02:48:27 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:48:27 user nova-compute[72820]:       <serial>abf4d7e0-e457-4f47-830c-0820098fe4ac</serial>
Aug 27 02:48:27 user nova-compute[72820]:     </disk>
Aug 27 02:48:27 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:48:27 user nova-compute[72820]:       <mac address="fa:16:3e:4c:2c:25"/>
Aug 27 02:48:27 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:48:27 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:48:27 user nova-compute[72820]:       <target dev="tap90b1244f-a1"/>
Aug 27 02:48:27 user nova-compute[72820]:     </interface>
Aug 27 02:48:27 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:48:27 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/4480b84a-32b2-4276-ab6d-8c47f4057e55/console.log" append="off"/>
Aug 27 02:48:27 user nova-compute[72820]:     </serial>
Aug 27 02:48:27 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:48:27 user nova-compute[72820]:     <video>
Aug 27 02:48:27 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:48:27 user nova-compute[72820]:     </video>
Aug 27 02:48:27 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:48:27 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:48:27 user nova-compute[72820]:     </rng>
Aug 27 02:48:27 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:48:27 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:48:27 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:48:27 user nova-compute[72820]:     </memballoon>
Aug 27 02:48:27 user nova-compute[72820]:   </devices>
Aug 27 02:48:27 user nova-compute[72820]: </domain>
Aug 27 02:48:27 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-753987207',display_name='tempest-TestVolumeBootPattern-server-753987207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-753987207',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRxkQgla9cymo6EFmZDbQk1Vd9PsMUw375tHpE3C+G7XWKJ2wNxA3Wp7pGzZ5jGLrv690Dj/yrsqixKPzVZE/Db7oYR6ptdQgKfU5EdVib0jmGNDhSHb8FtGbnW3QaTgA==',key_name='tempest-TestVolumeBootPattern-410715465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84f02ddcfa2b4571a4d7cacf1287aebd',ramdisk_id='',reservation_id='r-veeocn8e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-631676638',owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:48:15Z,user_data=None,user_id='878038feacda4094b5d2c9e3814c8bf0',uuid=4480b84a-32b2-4276-ab6d-8c47f4057e55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90b1244f-a157-42c2-976d-126d71109e67", "address": "fa:16:3e:4c:2c:25", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b1244f-a1", "ovs_interfaceid": "90b1244f-a157-42c2-976d-126d71109e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converting VIF {"id": "90b1244f-a157-42c2-976d-126d71109e67", "address": "fa:16:3e:4c:2c:25", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b1244f-a1", "ovs_interfaceid": "90b1244f-a157-42c2-976d-126d71109e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:2c:25,bridge_name='br-int',has_traffic_filtering=True,id=90b1244f-a157-42c2-976d-126d71109e67,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b1244f-a1') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG os_vif [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:2c:25,bridge_name='br-int',has_traffic_filtering=True,id=90b1244f-a157-42c2-976d-126d71109e67,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b1244f-a1') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90b1244f-a1, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90b1244f-a1, col_values=(('external_ids', {'iface-id': '90b1244f-a157-42c2-976d-126d71109e67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:2c:25', 'vm-uuid': '4480b84a-32b2-4276-ab6d-8c47f4057e55'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:27 user nova-compute[72820]: INFO os_vif [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:2c:25,bridge_name='br-int',has_traffic_filtering=True,id=90b1244f-a157-42c2-976d-126d71109e67,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b1244f-a1')
Aug 27 02:48:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] No VIF found with MAC fa:16:3e:4c:2c:25, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:48:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:28 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:48:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:29 user nova-compute[72820]: DEBUG nova.compute.manager [req-390139fa-23db-4370-bc0d-362249040b03 req-90f85573-b170-48ae-bf91-0d561cf2cfd2 service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Received event network-vif-plugged-90b1244f-a157-42c2-976d-126d71109e67 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:48:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-390139fa-23db-4370-bc0d-362249040b03 req-90f85573-b170-48ae-bf91-0d561cf2cfd2 service nova] Acquiring lock "4480b84a-32b2-4276-ab6d-8c47f4057e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:48:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-390139fa-23db-4370-bc0d-362249040b03 req-90f85573-b170-48ae-bf91-0d561cf2cfd2 service nova] Lock "4480b84a-32b2-4276-ab6d-8c47f4057e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:48:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-390139fa-23db-4370-bc0d-362249040b03 req-90f85573-b170-48ae-bf91-0d561cf2cfd2 service nova] Lock "4480b84a-32b2-4276-ab6d-8c47f4057e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:48:29 user nova-compute[72820]: DEBUG nova.compute.manager [req-390139fa-23db-4370-bc0d-362249040b03 req-90f85573-b170-48ae-bf91-0d561cf2cfd2 service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] No waiting events found dispatching network-vif-plugged-90b1244f-a157-42c2-976d-126d71109e67 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:48:29 user nova-compute[72820]: WARNING nova.compute.manager [req-390139fa-23db-4370-bc0d-362249040b03 req-90f85573-b170-48ae-bf91-0d561cf2cfd2 service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Received unexpected event network-vif-plugged-90b1244f-a157-42c2-976d-126d71109e67 for instance with vm_state building and task_state spawning.
Aug 27 02:48:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:48:31 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104511.3452048, 4480b84a-32b2-4276-ab6d-8c47f4057e55 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:48:31 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] VM Resumed (Lifecycle Event)
Aug 27 02:48:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:48:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:48:31 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Instance spawned successfully.
Aug 27 02:48:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:48:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:48:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:48:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:48:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:48:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:48:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:48:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:48:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:48:31 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:48:31 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104511.3484657, 4480b84a-32b2-4276-ab6d-8c47f4057e55 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:48:31 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] VM Started (Lifecycle Event)
Aug 27 02:48:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:48:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-4ae2b11a-cf66-49d4-8fd7-1428c3811dcc req-d2e7d556-0ca4-4b21-9ee9-6e6cca4ce184 service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Received event network-vif-plugged-90b1244f-a157-42c2-976d-126d71109e67 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:48:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ae2b11a-cf66-49d4-8fd7-1428c3811dcc req-d2e7d556-0ca4-4b21-9ee9-6e6cca4ce184 service nova] Acquiring lock "4480b84a-32b2-4276-ab6d-8c47f4057e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:48:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ae2b11a-cf66-49d4-8fd7-1428c3811dcc req-d2e7d556-0ca4-4b21-9ee9-6e6cca4ce184 service nova] Lock "4480b84a-32b2-4276-ab6d-8c47f4057e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:48:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4ae2b11a-cf66-49d4-8fd7-1428c3811dcc req-d2e7d556-0ca4-4b21-9ee9-6e6cca4ce184 service nova] Lock "4480b84a-32b2-4276-ab6d-8c47f4057e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:48:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-4ae2b11a-cf66-49d4-8fd7-1428c3811dcc req-d2e7d556-0ca4-4b21-9ee9-6e6cca4ce184 service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] No waiting events found dispatching network-vif-plugged-90b1244f-a157-42c2-976d-126d71109e67 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:48:31 user nova-compute[72820]: WARNING nova.compute.manager [req-4ae2b11a-cf66-49d4-8fd7-1428c3811dcc req-d2e7d556-0ca4-4b21-9ee9-6e6cca4ce184 service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Received unexpected event network-vif-plugged-90b1244f-a157-42c2-976d-126d71109e67 for instance with vm_state building and task_state spawning.
Aug 27 02:48:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:48:31 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:48:31 user nova-compute[72820]: INFO nova.compute.manager [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Took 5.38 seconds to spawn the instance on the hypervisor.
Aug 27 02:48:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:48:31 user nova-compute[72820]: INFO nova.compute.manager [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Took 17.40 seconds to build instance.
Aug 27 02:48:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f5b6bf69-d32e-47bd-952f-474fd4a2ef57 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "4480b84a-32b2-4276-ab6d-8c47f4057e55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.505s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:48:32 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:48:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:33 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:48:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:48:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:48:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:48:33 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:48:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:48:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:48:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:48:34 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:48:34 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:48:34 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8570MB free_disk=25.211872100830078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:48:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:48:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:48:34 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 4480b84a-32b2-4276-ab6d-8c47f4057e55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:48:34 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance cf2d330e-386a-4300-b1c3-99d5b44b78bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:48:34 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:48:34 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:48:34 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:48:34 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:48:34 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:48:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:48:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:39 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:48:39 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:48:39 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 02:48:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:48:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:48:39 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:48:39 user nova-compute[72820]: DEBUG nova.objects.instance [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lazy-loading 'info_cache' on Instance uuid 4480b84a-32b2-4276-ab6d-8c47f4057e55 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:48:40 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Updating instance_info_cache with network_info: [{"id": "90b1244f-a157-42c2-976d-126d71109e67", "address": "fa:16:3e:4c:2c:25", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b1244f-a1", "ovs_interfaceid": "90b1244f-a157-42c2-976d-126d71109e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:48:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:48:40 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:48:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:48:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "5bff5ccf-6365-4086-9307-adb1c488617f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:49:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "5bff5ccf-6365-4086-9307-adb1c488617f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:49:02 user nova-compute[72820]: DEBUG nova.compute.manager [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:49:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:49:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:49:02 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:49:02 user nova-compute[72820]: INFO nova.compute.claims [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Claim successful on node user
Aug 27 02:49:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG nova.compute.manager [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG nova.compute.manager [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG nova.network.neutron [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:49:03 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:49:03 user nova-compute[72820]: DEBUG nova.compute.manager [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG nova.policy [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '391718f05f07460f9388d168d1ebdc98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '117a0b3ffbe84eba93968f924fa7d2e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG nova.compute.manager [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:49:03 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Creating image(s)
Aug 27 02:49:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "/opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "/opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "/opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.219s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.198s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk 1073741824" returned: 0 in 0.060s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:49:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:49:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.239s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:49:04 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:49:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:49:04 user nova-compute[72820]: DEBUG nova.network.neutron [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Successfully created port: fafe642e-4c06-4eec-90ae-751c8cb746ca {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:49:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:49:04 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Cannot resize image /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:49:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:49:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Ensure instance console log exists: /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:49:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:49:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:49:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:49:05 user nova-compute[72820]: DEBUG nova.network.neutron [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Successfully updated port: fafe642e-4c06-4eec-90ae-751c8cb746ca {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:49:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "refresh_cache-5bff5ccf-6365-4086-9307-adb1c488617f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:49:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquired lock "refresh_cache-5bff5ccf-6365-4086-9307-adb1c488617f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:49:05 user nova-compute[72820]: DEBUG nova.network.neutron [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:49:05 user nova-compute[72820]: DEBUG nova.compute.manager [req-f15f7673-8a89-4b78-9385-40b3aaab3631 req-aa4d2d1d-a646-4ebd-9b4c-f7f6bb2de95e service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Received event network-changed-fafe642e-4c06-4eec-90ae-751c8cb746ca {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:49:05 user nova-compute[72820]: DEBUG nova.compute.manager [req-f15f7673-8a89-4b78-9385-40b3aaab3631 req-aa4d2d1d-a646-4ebd-9b4c-f7f6bb2de95e service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Refreshing instance network info cache due to event network-changed-fafe642e-4c06-4eec-90ae-751c8cb746ca. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:49:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f15f7673-8a89-4b78-9385-40b3aaab3631 req-aa4d2d1d-a646-4ebd-9b4c-f7f6bb2de95e service nova] Acquiring lock "refresh_cache-5bff5ccf-6365-4086-9307-adb1c488617f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:49:05 user nova-compute[72820]: DEBUG nova.network.neutron [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.network.neutron [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Updating instance_info_cache with network_info: [{"id": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "address": "fa:16:3e:4d:50:a9", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe642e-4c", "ovs_interfaceid": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Releasing lock "refresh_cache-5bff5ccf-6365-4086-9307-adb1c488617f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.compute.manager [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Instance network_info: |[{"id": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "address": "fa:16:3e:4d:50:a9", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe642e-4c", "ovs_interfaceid": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f15f7673-8a89-4b78-9385-40b3aaab3631 req-aa4d2d1d-a646-4ebd-9b4c-f7f6bb2de95e service nova] Acquired lock "refresh_cache-5bff5ccf-6365-4086-9307-adb1c488617f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.network.neutron [req-f15f7673-8a89-4b78-9385-40b3aaab3631 req-aa4d2d1d-a646-4ebd-9b4c-f7f6bb2de95e service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Refreshing network info cache for port fafe642e-4c06-4eec-90ae-751c8cb746ca {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Start _get_guest_xml network_info=[{"id": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "address": "fa:16:3e:4d:50:a9", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe642e-4c", "ovs_interfaceid": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:49:06 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:49:06 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1711660628',display_name='tempest-AttachVolumeNegativeTest-server-1711660628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1711660628',id=44,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEh7Q50iNoJJni6mf5cZ5twTHkoWbM9AzSB/bXk3TQ2WpHjF53JNLADYCT14ICQLdueDCi743Z5ZFSZ0yBSrza0Yf3EiSeOT0NQngzyRXmoSDM6goZm9/UYFppFQJzkTQw==',key_name='tempest-keypair-2099163185',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='117a0b3ffbe84eba93968f924fa7d2e9',ramdisk_id='',reservation_id='r-9pdh7f9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2145874992',owner_user_name='tempest-AttachVolumeNegativeTest-2145874992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='391718f05f07460f9388d168d1ebdc98',uuid=5bff5ccf-6365-4086-9307-adb1c488617f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "address": "fa:16:3e:4d:50:a9", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe642e-4c", "ovs_interfaceid": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converting VIF {"id": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "address": "fa:16:3e:4d:50:a9", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe642e-4c", "ovs_interfaceid": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:50:a9,bridge_name='br-int',has_traffic_filtering=True,id=fafe642e-4c06-4eec-90ae-751c8cb746ca,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfafe642e-4c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.objects.instance [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bff5ccf-6365-4086-9307-adb1c488617f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:49:06 user nova-compute[72820]:   <uuid>5bff5ccf-6365-4086-9307-adb1c488617f</uuid>
Aug 27 02:49:06 user nova-compute[72820]:   <name>instance-0000002c</name>
Aug 27 02:49:06 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:49:06 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:49:06 user nova-compute[72820]:   <metadata>
Aug 27 02:49:06 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:49:06 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:49:06 user nova-compute[72820]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1711660628</nova:name>
Aug 27 02:49:06 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:49:06</nova:creationTime>
Aug 27 02:49:06 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:49:06 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:49:06 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:49:06 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:49:06 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:49:06 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:49:06 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:49:06 user nova-compute[72820]:       <nova:owner>
Aug 27 02:49:06 user nova-compute[72820]:         <nova:user uuid="391718f05f07460f9388d168d1ebdc98">tempest-AttachVolumeNegativeTest-2145874992-project-member</nova:user>
Aug 27 02:49:06 user nova-compute[72820]:         <nova:project uuid="117a0b3ffbe84eba93968f924fa7d2e9">tempest-AttachVolumeNegativeTest-2145874992</nova:project>
Aug 27 02:49:06 user nova-compute[72820]:       </nova:owner>
Aug 27 02:49:06 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:49:06 user nova-compute[72820]:       <nova:ports>
Aug 27 02:49:06 user nova-compute[72820]:         <nova:port uuid="fafe642e-4c06-4eec-90ae-751c8cb746ca">
Aug 27 02:49:06 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 02:49:06 user nova-compute[72820]:         </nova:port>
Aug 27 02:49:06 user nova-compute[72820]:       </nova:ports>
Aug 27 02:49:06 user nova-compute[72820]:     </nova:instance>
Aug 27 02:49:06 user nova-compute[72820]:   </metadata>
Aug 27 02:49:06 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:49:06 user nova-compute[72820]:     <system>
Aug 27 02:49:06 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:49:06 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:49:06 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:49:06 user nova-compute[72820]:       <entry name="serial">5bff5ccf-6365-4086-9307-adb1c488617f</entry>
Aug 27 02:49:06 user nova-compute[72820]:       <entry name="uuid">5bff5ccf-6365-4086-9307-adb1c488617f</entry>
Aug 27 02:49:06 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:49:06 user nova-compute[72820]:     </system>
Aug 27 02:49:06 user nova-compute[72820]:   </sysinfo>
Aug 27 02:49:06 user nova-compute[72820]:   <os>
Aug 27 02:49:06 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:49:06 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:49:06 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:49:06 user nova-compute[72820]:   </os>
Aug 27 02:49:06 user nova-compute[72820]:   <features>
Aug 27 02:49:06 user nova-compute[72820]:     <acpi/>
Aug 27 02:49:06 user nova-compute[72820]:     <apic/>
Aug 27 02:49:06 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:49:06 user nova-compute[72820]:   </features>
Aug 27 02:49:06 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:49:06 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:49:06 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:49:06 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:49:06 user nova-compute[72820]:   </clock>
Aug 27 02:49:06 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:49:06 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:49:06 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:49:06 user nova-compute[72820]:   </cpu>
Aug 27 02:49:06 user nova-compute[72820]:   <devices>
Aug 27 02:49:06 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:49:06 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:49:06 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk"/>
Aug 27 02:49:06 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:49:06 user nova-compute[72820]:     </disk>
Aug 27 02:49:06 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:49:06 user nova-compute[72820]:       <mac address="fa:16:3e:4d:50:a9"/>
Aug 27 02:49:06 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:49:06 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:49:06 user nova-compute[72820]:       <target dev="tapfafe642e-4c"/>
Aug 27 02:49:06 user nova-compute[72820]:     </interface>
Aug 27 02:49:06 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:49:06 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/console.log" append="off"/>
Aug 27 02:49:06 user nova-compute[72820]:     </serial>
Aug 27 02:49:06 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:49:06 user nova-compute[72820]:     <video>
Aug 27 02:49:06 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:49:06 user nova-compute[72820]:     </video>
Aug 27 02:49:06 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:49:06 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:49:06 user nova-compute[72820]:     </rng>
Aug 27 02:49:06 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:49:06 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:49:06 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:49:06 user nova-compute[72820]:     </memballoon>
Aug 27 02:49:06 user nova-compute[72820]:   </devices>
Aug 27 02:49:06 user nova-compute[72820]: </domain>
Aug 27 02:49:06 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1711660628',display_name='tempest-AttachVolumeNegativeTest-server-1711660628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1711660628',id=44,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEh7Q50iNoJJni6mf5cZ5twTHkoWbM9AzSB/bXk3TQ2WpHjF53JNLADYCT14ICQLdueDCi743Z5ZFSZ0yBSrza0Yf3EiSeOT0NQngzyRXmoSDM6goZm9/UYFppFQJzkTQw==',key_name='tempest-keypair-2099163185',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='117a0b3ffbe84eba93968f924fa7d2e9',ramdisk_id='',reservation_id='r-9pdh7f9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2145874992',owner_user_name='tempest-AttachVolumeNegativeTest-2145874992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='391718f05f07460f9388d168d1ebdc98',uuid=5bff5ccf-6365-4086-9307-adb1c488617f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "address": "fa:16:3e:4d:50:a9", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe642e-4c", "ovs_interfaceid": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converting VIF {"id": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "address": "fa:16:3e:4d:50:a9", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe642e-4c", "ovs_interfaceid": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:50:a9,bridge_name='br-int',has_traffic_filtering=True,id=fafe642e-4c06-4eec-90ae-751c8cb746ca,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfafe642e-4c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG os_vif [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:50:a9,bridge_name='br-int',has_traffic_filtering=True,id=fafe642e-4c06-4eec-90ae-751c8cb746ca,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfafe642e-4c') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfafe642e-4c, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfafe642e-4c, col_values=(('external_ids', {'iface-id': 'fafe642e-4c06-4eec-90ae-751c8cb746ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:50:a9', 'vm-uuid': '5bff5ccf-6365-4086-9307-adb1c488617f'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:06 user nova-compute[72820]: INFO os_vif [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:50:a9,bridge_name='br-int',has_traffic_filtering=True,id=fafe642e-4c06-4eec-90ae-751c8cb746ca,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfafe642e-4c')
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:49:06 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] No VIF found with MAC fa:16:3e:4d:50:a9, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:49:07 user nova-compute[72820]: DEBUG nova.network.neutron [req-f15f7673-8a89-4b78-9385-40b3aaab3631 req-aa4d2d1d-a646-4ebd-9b4c-f7f6bb2de95e service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Updated VIF entry in instance network info cache for port fafe642e-4c06-4eec-90ae-751c8cb746ca. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:49:07 user nova-compute[72820]: DEBUG nova.network.neutron [req-f15f7673-8a89-4b78-9385-40b3aaab3631 req-aa4d2d1d-a646-4ebd-9b4c-f7f6bb2de95e service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Updating instance_info_cache with network_info: [{"id": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "address": "fa:16:3e:4d:50:a9", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe642e-4c", "ovs_interfaceid": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:49:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f15f7673-8a89-4b78-9385-40b3aaab3631 req-aa4d2d1d-a646-4ebd-9b4c-f7f6bb2de95e service nova] Releasing lock "refresh_cache-5bff5ccf-6365-4086-9307-adb1c488617f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:49:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-ddccfbee-d363-487c-88cc-3aeb245fed65 req-145b7be5-2b97-4a44-8060-004b65f4b255 service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Received event network-vif-plugged-fafe642e-4c06-4eec-90ae-751c8cb746ca {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:49:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ddccfbee-d363-487c-88cc-3aeb245fed65 req-145b7be5-2b97-4a44-8060-004b65f4b255 service nova] Acquiring lock "5bff5ccf-6365-4086-9307-adb1c488617f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:49:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ddccfbee-d363-487c-88cc-3aeb245fed65 req-145b7be5-2b97-4a44-8060-004b65f4b255 service nova] Lock "5bff5ccf-6365-4086-9307-adb1c488617f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:49:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ddccfbee-d363-487c-88cc-3aeb245fed65 req-145b7be5-2b97-4a44-8060-004b65f4b255 service nova] Lock "5bff5ccf-6365-4086-9307-adb1c488617f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:49:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-ddccfbee-d363-487c-88cc-3aeb245fed65 req-145b7be5-2b97-4a44-8060-004b65f4b255 service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] No waiting events found dispatching network-vif-plugged-fafe642e-4c06-4eec-90ae-751c8cb746ca {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:49:08 user nova-compute[72820]: WARNING nova.compute.manager [req-ddccfbee-d363-487c-88cc-3aeb245fed65 req-145b7be5-2b97-4a44-8060-004b65f4b255 service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Received unexpected event network-vif-plugged-fafe642e-4c06-4eec-90ae-751c8cb746ca for instance with vm_state building and task_state spawning.
Aug 27 02:49:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:10 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104550.46651, 5bff5ccf-6365-4086-9307-adb1c488617f => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:49:10 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] VM Resumed (Lifecycle Event)
Aug 27 02:49:10 user nova-compute[72820]: DEBUG nova.compute.manager [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:49:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:49:10 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Instance spawned successfully.
Aug 27 02:49:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:49:10 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:49:10 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:49:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:49:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:49:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:49:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:49:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:49:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:49:10 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:49:10 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104550.4696455, 5bff5ccf-6365-4086-9307-adb1c488617f => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:49:10 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] VM Started (Lifecycle Event)
Aug 27 02:49:10 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:49:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-3720c91a-1bba-4677-b1bb-0441d1da66f0 req-4329f9a9-b4ef-4e8f-b0b4-18057a693aaf service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Received event network-vif-plugged-fafe642e-4c06-4eec-90ae-751c8cb746ca {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:49:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3720c91a-1bba-4677-b1bb-0441d1da66f0 req-4329f9a9-b4ef-4e8f-b0b4-18057a693aaf service nova] Acquiring lock "5bff5ccf-6365-4086-9307-adb1c488617f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:49:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3720c91a-1bba-4677-b1bb-0441d1da66f0 req-4329f9a9-b4ef-4e8f-b0b4-18057a693aaf service nova] Lock "5bff5ccf-6365-4086-9307-adb1c488617f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:49:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3720c91a-1bba-4677-b1bb-0441d1da66f0 req-4329f9a9-b4ef-4e8f-b0b4-18057a693aaf service nova] Lock "5bff5ccf-6365-4086-9307-adb1c488617f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:49:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-3720c91a-1bba-4677-b1bb-0441d1da66f0 req-4329f9a9-b4ef-4e8f-b0b4-18057a693aaf service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] No waiting events found dispatching network-vif-plugged-fafe642e-4c06-4eec-90ae-751c8cb746ca {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:49:10 user nova-compute[72820]: WARNING nova.compute.manager [req-3720c91a-1bba-4677-b1bb-0441d1da66f0 req-4329f9a9-b4ef-4e8f-b0b4-18057a693aaf service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Received unexpected event network-vif-plugged-fafe642e-4c06-4eec-90ae-751c8cb746ca for instance with vm_state building and task_state spawning.
Aug 27 02:49:10 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:49:10 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:49:10 user nova-compute[72820]: INFO nova.compute.manager [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Took 7.21 seconds to spawn the instance on the hypervisor.
Aug 27 02:49:10 user nova-compute[72820]: DEBUG nova.compute.manager [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:49:10 user nova-compute[72820]: INFO nova.compute.manager [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Took 7.84 seconds to build instance.
Aug 27 02:49:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-0d00addb-8169-48e5-9de8-c45ecbc35af6 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "5bff5ccf-6365-4086-9307-adb1c488617f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.942s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:49:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:19 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:49:21 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:49:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:49:24 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:49:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:27 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:49:27 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:49:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:30 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:49:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:49:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:34 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:49:34 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:49:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:49:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:49:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:49:34 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:49:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:49:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/disk --force-share --output=json" returned: 0 in 0.370s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:49:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:49:34 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:49:35 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:49:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:49:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:49:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:49:35 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:49:35 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:49:35 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:49:35 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8447MB free_disk=25.153461456298828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:49:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:49:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:49:35 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 4480b84a-32b2-4276-ab6d-8c47f4057e55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:49:35 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance cf2d330e-386a-4300-b1c3-99d5b44b78bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:49:35 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 5bff5ccf-6365-4086-9307-adb1c488617f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:49:35 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:49:35 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:49:35 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:49:35 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:49:36 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:49:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:49:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:41 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:49:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:49:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-cf2d330e-386a-4300-b1c3-99d5b44b78bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:49:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-cf2d330e-386a-4300-b1c3-99d5b44b78bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:49:41 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:49:41 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Updating instance_info_cache with network_info: [{"id": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "address": "fa:16:3e:68:09:84", "network": {"id": "11bbf161-b267-4b4c-a07e-95e2e1d152c3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "74aabc5a6b3140eeac78f2075029cb88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape14b9c96-1c", "ovs_interfaceid": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:49:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-cf2d330e-386a-4300-b1c3-99d5b44b78bf" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:49:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:49:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:49:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:49:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:01 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:50:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-57c14e94-de05-4128-8683-b0d415c4d3af req-187cec06-d0a8-47aa-8068-0a44d8996760 service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Received event network-changed-90b1244f-a157-42c2-976d-126d71109e67 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:50:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-57c14e94-de05-4128-8683-b0d415c4d3af req-187cec06-d0a8-47aa-8068-0a44d8996760 service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Refreshing instance network info cache due to event network-changed-90b1244f-a157-42c2-976d-126d71109e67. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:50:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-57c14e94-de05-4128-8683-b0d415c4d3af req-187cec06-d0a8-47aa-8068-0a44d8996760 service nova] Acquiring lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:50:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-57c14e94-de05-4128-8683-b0d415c4d3af req-187cec06-d0a8-47aa-8068-0a44d8996760 service nova] Acquired lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:50:06 user nova-compute[72820]: DEBUG nova.network.neutron [req-57c14e94-de05-4128-8683-b0d415c4d3af req-187cec06-d0a8-47aa-8068-0a44d8996760 service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Refreshing network info cache for port 90b1244f-a157-42c2-976d-126d71109e67 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:50:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:06 user nova-compute[72820]: DEBUG nova.network.neutron [req-57c14e94-de05-4128-8683-b0d415c4d3af req-187cec06-d0a8-47aa-8068-0a44d8996760 service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Updated VIF entry in instance network info cache for port 90b1244f-a157-42c2-976d-126d71109e67. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:50:06 user nova-compute[72820]: DEBUG nova.network.neutron [req-57c14e94-de05-4128-8683-b0d415c4d3af req-187cec06-d0a8-47aa-8068-0a44d8996760 service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Updating instance_info_cache with network_info: [{"id": "90b1244f-a157-42c2-976d-126d71109e67", "address": "fa:16:3e:4c:2c:25", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b1244f-a1", "ovs_interfaceid": "90b1244f-a157-42c2-976d-126d71109e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:50:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-57c14e94-de05-4128-8683-b0d415c4d3af req-187cec06-d0a8-47aa-8068-0a44d8996760 service nova] Releasing lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:50:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Acquiring lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:50:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:50:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Acquiring lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:50:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:50:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:50:09 user nova-compute[72820]: INFO nova.compute.manager [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Terminating instance
Aug 27 02:50:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:50:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:09 user nova-compute[72820]: DEBUG nova.compute.manager [req-2bd9dabe-6e1a-47ec-a273-86a7aa0466ab req-a3eaac6f-9ca6-49d2-9f68-4a02d0518325 service nova] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Received event network-vif-unplugged-e14b9c96-1c03-44f5-b9dd-0da2092d7442 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:50:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2bd9dabe-6e1a-47ec-a273-86a7aa0466ab req-a3eaac6f-9ca6-49d2-9f68-4a02d0518325 service nova] Acquiring lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:50:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2bd9dabe-6e1a-47ec-a273-86a7aa0466ab req-a3eaac6f-9ca6-49d2-9f68-4a02d0518325 service nova] Lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:50:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2bd9dabe-6e1a-47ec-a273-86a7aa0466ab req-a3eaac6f-9ca6-49d2-9f68-4a02d0518325 service nova] Lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:50:09 user nova-compute[72820]: DEBUG nova.compute.manager [req-2bd9dabe-6e1a-47ec-a273-86a7aa0466ab req-a3eaac6f-9ca6-49d2-9f68-4a02d0518325 service nova] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] No waiting events found dispatching network-vif-unplugged-e14b9c96-1c03-44f5-b9dd-0da2092d7442 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:50:09 user nova-compute[72820]: DEBUG nova.compute.manager [req-2bd9dabe-6e1a-47ec-a273-86a7aa0466ab req-a3eaac6f-9ca6-49d2-9f68-4a02d0518325 service nova] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Received event network-vif-unplugged-e14b9c96-1c03-44f5-b9dd-0da2092d7442 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:50:10 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Instance destroyed successfully.
Aug 27 02:50:10 user nova-compute[72820]: DEBUG nova.objects.instance [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Lazy-loading 'resources' on Instance uuid cf2d330e-386a-4300-b1c3-99d5b44b78bf {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:50:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:48:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-978396871',display_name='tempest-VolumesNegativeTest-instance-978396871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-978396871',id=43,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:48:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4007a2f671140fea2d98e36c00e2e21',ramdisk_id='',reservation_id='r-dyeo32wh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1909179835',owner_user_name='tempest-VolumesNegativeTest-1909179835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:48:26Z,user_data=None,user_id='086aa08d8551468882824e486f863640',uuid=cf2d330e-386a-4300-b1c3-99d5b44b78bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "address": "fa:16:3e:68:09:84", "network": {"id": "11bbf161-b267-4b4c-a07e-95e2e1d152c3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "74aabc5a6b3140eeac78f2075029cb88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape14b9c96-1c", "ovs_interfaceid": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:50:10 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Converting VIF {"id": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "address": "fa:16:3e:68:09:84", "network": {"id": "11bbf161-b267-4b4c-a07e-95e2e1d152c3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "74aabc5a6b3140eeac78f2075029cb88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape14b9c96-1c", "ovs_interfaceid": "e14b9c96-1c03-44f5-b9dd-0da2092d7442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:50:10 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:09:84,bridge_name='br-int',has_traffic_filtering=True,id=e14b9c96-1c03-44f5-b9dd-0da2092d7442,network=Network(11bbf161-b267-4b4c-a07e-95e2e1d152c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape14b9c96-1c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:50:10 user nova-compute[72820]: DEBUG os_vif [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:09:84,bridge_name='br-int',has_traffic_filtering=True,id=e14b9c96-1c03-44f5-b9dd-0da2092d7442,network=Network(11bbf161-b267-4b4c-a07e-95e2e1d152c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape14b9c96-1c') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:50:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape14b9c96-1c, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:50:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:50:10 user nova-compute[72820]: INFO os_vif [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:09:84,bridge_name='br-int',has_traffic_filtering=True,id=e14b9c96-1c03-44f5-b9dd-0da2092d7442,network=Network(11bbf161-b267-4b4c-a07e-95e2e1d152c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape14b9c96-1c')
Aug 27 02:50:10 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Deleting instance files /opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf_del
Aug 27 02:50:10 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Deletion of /opt/stack/data/nova/instances/cf2d330e-386a-4300-b1c3-99d5b44b78bf_del complete
Aug 27 02:50:10 user nova-compute[72820]: INFO nova.compute.manager [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 27 02:50:10 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:50:10 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:50:10 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:50:10 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:50:10 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Took 0.54 seconds to deallocate network for instance.
Aug 27 02:50:10 user nova-compute[72820]: DEBUG nova.compute.manager [req-2c5c4ad0-39c2-42f6-b1d1-8b2a2eb5eeec req-e5b31d1b-ad71-4777-8205-4860e67cd848 service nova] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Received event network-vif-deleted-e14b9c96-1c03-44f5-b9dd-0da2092d7442 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:50:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:50:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:50:11 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:50:11 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:50:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:50:11 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Deleted allocations for instance cf2d330e-386a-4300-b1c3-99d5b44b78bf
Aug 27 02:50:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-67d469f2-4c16-4aa2-9d5a-6dfa3969d863 tempest-VolumesNegativeTest-1909179835 tempest-VolumesNegativeTest-1909179835-project-member] Lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.840s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:50:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-1781d9f9-3163-449a-acf9-931ba62733c2 req-d7e30ace-7de2-4008-918b-ff2b407aa99d service nova] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Received event network-vif-plugged-e14b9c96-1c03-44f5-b9dd-0da2092d7442 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:50:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1781d9f9-3163-449a-acf9-931ba62733c2 req-d7e30ace-7de2-4008-918b-ff2b407aa99d service nova] Acquiring lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:50:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1781d9f9-3163-449a-acf9-931ba62733c2 req-d7e30ace-7de2-4008-918b-ff2b407aa99d service nova] Lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:50:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1781d9f9-3163-449a-acf9-931ba62733c2 req-d7e30ace-7de2-4008-918b-ff2b407aa99d service nova] Lock "cf2d330e-386a-4300-b1c3-99d5b44b78bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:50:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-1781d9f9-3163-449a-acf9-931ba62733c2 req-d7e30ace-7de2-4008-918b-ff2b407aa99d service nova] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] No waiting events found dispatching network-vif-plugged-e14b9c96-1c03-44f5-b9dd-0da2092d7442 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:50:11 user nova-compute[72820]: WARNING nova.compute.manager [req-1781d9f9-3163-449a-acf9-931ba62733c2 req-d7e30ace-7de2-4008-918b-ff2b407aa99d service nova] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Received unexpected event network-vif-plugged-e14b9c96-1c03-44f5-b9dd-0da2092d7442 for instance with vm_state deleted and task_state None.
Aug 27 02:50:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:20 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:50:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:21 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:50:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:25 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104610.2768893, cf2d330e-386a-4300-b1c3-99d5b44b78bf => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:50:25 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] VM Stopped (Lifecycle Event)
Aug 27 02:50:25 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:50:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-0af267c7-501c-46af-a861-18bfebc9019f None None] [instance: cf2d330e-386a-4300-b1c3-99d5b44b78bf] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:50:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:28 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:50:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:50:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:50:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:50:28 user nova-compute[72820]: DEBUG nova.compute.manager [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:50:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:50:28 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:50:28 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:50:28 user nova-compute[72820]: INFO nova.compute.claims [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Claim successful on node user
Aug 27 02:50:29 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG nova.compute.manager [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG nova.compute.manager [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG nova.network.neutron [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:50:29 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:50:29 user nova-compute[72820]: DEBUG nova.compute.manager [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:50:29 user nova-compute[72820]: INFO nova.virt.block_device [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Booting with volume 58f5bac4-3fa7-4f3f-851e-a58be051cf32 at /dev/vda
Aug 27 02:50:29 user nova-compute[72820]: DEBUG nova.policy [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '878038feacda4094b5d2c9e3814c8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f02ddcfa2b4571a4d7cacf1287aebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG os_brick.utils [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[39391418-26a5-46df-a0d5-1c20a8feb283]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[29de1f33-35ab-436f-8b2d-7bfa85708255]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7356f240-9f53-4500-950f-311a4bf382e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b75574-b599-4874-8525-90ca23b3bbb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:50:29 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:50:29 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[073d45cc-666d-404d-a71e-001a8514a871]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG os_brick.utils [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:50:29 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Updating existing volume attachment record: 1c37795c-bc72-4c3a-ab84-00f57b7a04f7 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:50:30 user nova-compute[72820]: DEBUG nova.network.neutron [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Successfully created port: e9176c10-fdb2-40ee-9286-6b514d803b63 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:50:30 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:50:30 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:50:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:50:31 user nova-compute[72820]: DEBUG nova.network.neutron [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Successfully updated port: e9176c10-fdb2-40ee-9286-6b514d803b63 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:50:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "refresh_cache-a470ac6a-b748-4142-84fe-ea073cf9f4a7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:50:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquired lock "refresh_cache-a470ac6a-b748-4142-84fe-ea073cf9f4a7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:50:31 user nova-compute[72820]: DEBUG nova.network.neutron [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:50:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-3be6600e-615b-4c0b-96b0-a2255855e62d req-4ea490a1-8484-4526-8bf7-44cf24454387 service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Received event network-changed-e9176c10-fdb2-40ee-9286-6b514d803b63 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:50:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-3be6600e-615b-4c0b-96b0-a2255855e62d req-4ea490a1-8484-4526-8bf7-44cf24454387 service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Refreshing instance network info cache due to event network-changed-e9176c10-fdb2-40ee-9286-6b514d803b63. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:50:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3be6600e-615b-4c0b-96b0-a2255855e62d req-4ea490a1-8484-4526-8bf7-44cf24454387 service nova] Acquiring lock "refresh_cache-a470ac6a-b748-4142-84fe-ea073cf9f4a7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:50:31 user nova-compute[72820]: DEBUG nova.network.neutron [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:50:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:50:31 user nova-compute[72820]: DEBUG nova.network.neutron [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Updating instance_info_cache with network_info: [{"id": "e9176c10-fdb2-40ee-9286-6b514d803b63", "address": "fa:16:3e:de:4d:22", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9176c10-fd", "ovs_interfaceid": "e9176c10-fdb2-40ee-9286-6b514d803b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:50:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Releasing lock "refresh_cache-a470ac6a-b748-4142-84fe-ea073cf9f4a7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:50:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Instance network_info: |[{"id": "e9176c10-fdb2-40ee-9286-6b514d803b63", "address": "fa:16:3e:de:4d:22", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9176c10-fd", "ovs_interfaceid": "e9176c10-fdb2-40ee-9286-6b514d803b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:50:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3be6600e-615b-4c0b-96b0-a2255855e62d req-4ea490a1-8484-4526-8bf7-44cf24454387 service nova] Acquired lock "refresh_cache-a470ac6a-b748-4142-84fe-ea073cf9f4a7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:50:31 user nova-compute[72820]: DEBUG nova.network.neutron [req-3be6600e-615b-4c0b-96b0-a2255855e62d req-4ea490a1-8484-4526-8bf7-44cf24454387 service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Refreshing network info cache for port e9176c10-fdb2-40ee-9286-6b514d803b63 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:50:31 user nova-compute[72820]: DEBUG nova.network.neutron [req-3be6600e-615b-4c0b-96b0-a2255855e62d req-4ea490a1-8484-4526-8bf7-44cf24454387 service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Updated VIF entry in instance network info cache for port e9176c10-fdb2-40ee-9286-6b514d803b63. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:50:31 user nova-compute[72820]: DEBUG nova.network.neutron [req-3be6600e-615b-4c0b-96b0-a2255855e62d req-4ea490a1-8484-4526-8bf7-44cf24454387 service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Updating instance_info_cache with network_info: [{"id": "e9176c10-fdb2-40ee-9286-6b514d803b63", "address": "fa:16:3e:de:4d:22", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9176c10-fd", "ovs_interfaceid": "e9176c10-fdb2-40ee-9286-6b514d803b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:50:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-3be6600e-615b-4c0b-96b0-a2255855e62d req-4ea490a1-8484-4526-8bf7-44cf24454387 service nova] Releasing lock "refresh_cache-a470ac6a-b748-4142-84fe-ea073cf9f4a7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:50:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:50:36 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:50:36 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:50:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:50:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:50:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:50:36 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:50:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:50:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:50:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:50:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:50:36 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:50:37 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:50:37 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:50:37 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8625MB free_disk=25.1798095703125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:50:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:50:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:50:37 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 4480b84a-32b2-4276-ab6d-8c47f4057e55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:50:37 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 5bff5ccf-6365-4086-9307-adb1c488617f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:50:37 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance a470ac6a-b748-4142-84fe-ea073cf9f4a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:50:37 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:50:37 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:50:37 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:50:37 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:50:37 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:50:37 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:50:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.compute.manager [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:50:40 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Creating image(s)
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Did not create local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Ensure instance console log exists: /opt/stack/data/nova/instances/a470ac6a-b748-4142-84fe-ea073cf9f4a7/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Start _get_guest_xml network_info=[{"id": "e9176c10-fdb2-40ee-9286-6b514d803b63", "address": "fa:16:3e:de:4d:22", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9176c10-fd", "ovs_interfaceid": "e9176c10-fdb2-40ee-9286-6b514d803b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1c37795c-bc72-4c3a-ab84-00f57b7a04f7', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBqbKCzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a470ac6a-b748-4142-84fe-ea073cf9f4a7', 'attached_at': '', 'detached_at': '', 'volume_id': '58f5bac4-3fa7-4f3f-851e-a58be051cf32', 'serial': '58f5bac4-3fa7-4f3f-851e-a58be051cf32'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:50:40 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:50:40 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBqbKCzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:50:40 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:50:40 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:50:40 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[027f9ffb-d5b4-47ac-92d5-317b5956319f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:50:40 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Skipping network cache update for instance because it is Building. {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7fedfc-dd93-4ff1-b4df-959a6ebecb24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32] added
Aug 27 02:50:40 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[75900040-8a68-48c9-96b6-db0a66868d57]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG nova.objects.instance [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lazy-loading 'info_cache' on Instance uuid 4480b84a-32b2-4276-ab6d-8c47f4057e55 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a07bedd-83fd-44d6-8dca-a9c27396b708]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBqbKCzc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBqbKCzc" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a1ec73-7b66-446b-8c13-21e064472823]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZBqbKCzc'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6497adc-7aa2-43cf-8e27-20badf51bef9]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35678d6-d07c-4a7a-9d94-94ee3356d6ad]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)
Aug 27 02:50:40 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)
Aug 27 02:50:40 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[546a62d9-07bf-49a0-a3c2-d046c904a740]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32, portal: 172.16.0.220,3260]
Aug 27 02:50:40 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32, portal: 172.16.0.220,3260] successful.
Aug 27 02:50:40 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[902a78d8-ecef-46c8-aea5-d57c8a60c8b6]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[af955f4a-3a22-4ed4-844b-0f3d8970c6bf]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)
Aug 27 02:50:40 user nova-compute[72820]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 (non-flash)
Aug 27 02:50:40 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)
Aug 27 02:50:40 user nova-compute[72820]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 (non-flash)
Aug 27 02:50:40 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[601e819e-cff7-4725-8964-1030109f2987]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:50:40 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBqbKCzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Updating instance_info_cache with network_info: [{"id": "90b1244f-a157-42c2-976d-126d71109e67", "address": "fa:16:3e:4c:2c:25", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b1244f-a1", "ovs_interfaceid": "90b1244f-a157-42c2-976d-126d71109e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23633303033383666', 'path': '/dev/sdc'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633303033383666', 'path': '/dev/sdc'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1594170511',display_name='tempest-TestVolumeBootPattern-server-1594170511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1594170511',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRxkQgla9cymo6EFmZDbQk1Vd9PsMUw375tHpE3C+G7XWKJ2wNxA3Wp7pGzZ5jGLrv690Dj/yrsqixKPzVZE/Db7oYR6ptdQgKfU5EdVib0jmGNDhSHb8FtGbnW3QaTgA==',key_name='tempest-TestVolumeBootPattern-410715465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84f02ddcfa2b4571a4d7cacf1287aebd',ramdisk_id='',reservation_id='r-gb04t0mq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-631676638',owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:50:29Z,user_data=None,user_id='878038feacda4094b5d2c9e3814c8bf0',uuid=a470ac6a-b748-4142-84fe-ea073cf9f4a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9176c10-fdb2-40ee-9286-6b514d803b63", "address": "fa:16:3e:de:4d:22", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9176c10-fd", "ovs_interfaceid": "e9176c10-fdb2-40ee-9286-6b514d803b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converting VIF {"id": "e9176c10-fdb2-40ee-9286-6b514d803b63", "address": "fa:16:3e:de:4d:22", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9176c10-fd", "ovs_interfaceid": "e9176c10-fdb2-40ee-9286-6b514d803b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:4d:22,bridge_name='br-int',has_traffic_filtering=True,id=e9176c10-fdb2-40ee-9286-6b514d803b63,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9176c10-fd') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG nova.objects.instance [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lazy-loading 'pci_devices' on Instance uuid a470ac6a-b748-4142-84fe-ea073cf9f4a7 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:50:41 user nova-compute[72820]:   <uuid>a470ac6a-b748-4142-84fe-ea073cf9f4a7</uuid>
Aug 27 02:50:41 user nova-compute[72820]:   <name>instance-0000002d</name>
Aug 27 02:50:41 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:50:41 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:50:41 user nova-compute[72820]:   <metadata>
Aug 27 02:50:41 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:50:41 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:50:41 user nova-compute[72820]:       <nova:name>tempest-TestVolumeBootPattern-server-1594170511</nova:name>
Aug 27 02:50:41 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:50:40</nova:creationTime>
Aug 27 02:50:41 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:50:41 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:50:41 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:50:41 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:50:41 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:50:41 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:50:41 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:50:41 user nova-compute[72820]:       <nova:owner>
Aug 27 02:50:41 user nova-compute[72820]:         <nova:user uuid="878038feacda4094b5d2c9e3814c8bf0">tempest-TestVolumeBootPattern-631676638-project-member</nova:user>
Aug 27 02:50:41 user nova-compute[72820]:         <nova:project uuid="84f02ddcfa2b4571a4d7cacf1287aebd">tempest-TestVolumeBootPattern-631676638</nova:project>
Aug 27 02:50:41 user nova-compute[72820]:       </nova:owner>
Aug 27 02:50:41 user nova-compute[72820]:       <nova:ports>
Aug 27 02:50:41 user nova-compute[72820]:         <nova:port uuid="e9176c10-fdb2-40ee-9286-6b514d803b63">
Aug 27 02:50:41 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 02:50:41 user nova-compute[72820]:         </nova:port>
Aug 27 02:50:41 user nova-compute[72820]:       </nova:ports>
Aug 27 02:50:41 user nova-compute[72820]:     </nova:instance>
Aug 27 02:50:41 user nova-compute[72820]:   </metadata>
Aug 27 02:50:41 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:50:41 user nova-compute[72820]:     <system>
Aug 27 02:50:41 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:50:41 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:50:41 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:50:41 user nova-compute[72820]:       <entry name="serial">a470ac6a-b748-4142-84fe-ea073cf9f4a7</entry>
Aug 27 02:50:41 user nova-compute[72820]:       <entry name="uuid">a470ac6a-b748-4142-84fe-ea073cf9f4a7</entry>
Aug 27 02:50:41 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:50:41 user nova-compute[72820]:     </system>
Aug 27 02:50:41 user nova-compute[72820]:   </sysinfo>
Aug 27 02:50:41 user nova-compute[72820]:   <os>
Aug 27 02:50:41 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:50:41 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:50:41 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:50:41 user nova-compute[72820]:   </os>
Aug 27 02:50:41 user nova-compute[72820]:   <features>
Aug 27 02:50:41 user nova-compute[72820]:     <acpi/>
Aug 27 02:50:41 user nova-compute[72820]:     <apic/>
Aug 27 02:50:41 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:50:41 user nova-compute[72820]:   </features>
Aug 27 02:50:41 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:50:41 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:50:41 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:50:41 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:50:41 user nova-compute[72820]:   </clock>
Aug 27 02:50:41 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:50:41 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:50:41 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:50:41 user nova-compute[72820]:   </cpu>
Aug 27 02:50:41 user nova-compute[72820]:   <devices>
Aug 27 02:50:41 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:50:41 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:50:41 user nova-compute[72820]:       <source dev="/dev/sdc"/>
Aug 27 02:50:41 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:50:41 user nova-compute[72820]:       <serial>58f5bac4-3fa7-4f3f-851e-a58be051cf32</serial>
Aug 27 02:50:41 user nova-compute[72820]:     </disk>
Aug 27 02:50:41 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:50:41 user nova-compute[72820]:       <mac address="fa:16:3e:de:4d:22"/>
Aug 27 02:50:41 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:50:41 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:50:41 user nova-compute[72820]:       <target dev="tape9176c10-fd"/>
Aug 27 02:50:41 user nova-compute[72820]:     </interface>
Aug 27 02:50:41 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:50:41 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/a470ac6a-b748-4142-84fe-ea073cf9f4a7/console.log" append="off"/>
Aug 27 02:50:41 user nova-compute[72820]:     </serial>
Aug 27 02:50:41 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:50:41 user nova-compute[72820]:     <video>
Aug 27 02:50:41 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:50:41 user nova-compute[72820]:     </video>
Aug 27 02:50:41 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:50:41 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:50:41 user nova-compute[72820]:     </rng>
Aug 27 02:50:41 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:50:41 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:50:41 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:50:41 user nova-compute[72820]:     </memballoon>
Aug 27 02:50:41 user nova-compute[72820]:   </devices>
Aug 27 02:50:41 user nova-compute[72820]: </domain>
Aug 27 02:50:41 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1594170511',display_name='tempest-TestVolumeBootPattern-server-1594170511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1594170511',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRxkQgla9cymo6EFmZDbQk1Vd9PsMUw375tHpE3C+G7XWKJ2wNxA3Wp7pGzZ5jGLrv690Dj/yrsqixKPzVZE/Db7oYR6ptdQgKfU5EdVib0jmGNDhSHb8FtGbnW3QaTgA==',key_name='tempest-TestVolumeBootPattern-410715465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84f02ddcfa2b4571a4d7cacf1287aebd',ramdisk_id='',reservation_id='r-gb04t0mq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-631676638',owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:50:29Z,user_data=None,user_id='878038feacda4094b5d2c9e3814c8bf0',uuid=a470ac6a-b748-4142-84fe-ea073cf9f4a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9176c10-fdb2-40ee-9286-6b514d803b63", "address": "fa:16:3e:de:4d:22", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9176c10-fd", "ovs_interfaceid": "e9176c10-fdb2-40ee-9286-6b514d803b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converting VIF {"id": "e9176c10-fdb2-40ee-9286-6b514d803b63", "address": "fa:16:3e:de:4d:22", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9176c10-fd", "ovs_interfaceid": "e9176c10-fdb2-40ee-9286-6b514d803b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:4d:22,bridge_name='br-int',has_traffic_filtering=True,id=e9176c10-fdb2-40ee-9286-6b514d803b63,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9176c10-fd') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG os_vif [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:4d:22,bridge_name='br-int',has_traffic_filtering=True,id=e9176c10-fdb2-40ee-9286-6b514d803b63,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9176c10-fd') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9176c10-fd, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9176c10-fd, col_values=(('external_ids', {'iface-id': 'e9176c10-fdb2-40ee-9286-6b514d803b63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:4d:22', 'vm-uuid': 'a470ac6a-b748-4142-84fe-ea073cf9f4a7'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:41 user nova-compute[72820]: INFO os_vif [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:4d:22,bridge_name='br-int',has_traffic_filtering=True,id=e9176c10-fdb2-40ee-9286-6b514d803b63,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9176c10-fd')
Aug 27 02:50:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:50:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] No VIF found with MAC fa:16:3e:de:4d:22, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:50:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:43 user nova-compute[72820]: DEBUG nova.compute.manager [req-aa14f92e-64e4-494e-8773-c0de1d02370b req-c0532a0c-408a-49c7-bab0-7c41930bcbee service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Received event network-vif-plugged-e9176c10-fdb2-40ee-9286-6b514d803b63 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:50:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-aa14f92e-64e4-494e-8773-c0de1d02370b req-c0532a0c-408a-49c7-bab0-7c41930bcbee service nova] Acquiring lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:50:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-aa14f92e-64e4-494e-8773-c0de1d02370b req-c0532a0c-408a-49c7-bab0-7c41930bcbee service nova] Lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:50:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-aa14f92e-64e4-494e-8773-c0de1d02370b req-c0532a0c-408a-49c7-bab0-7c41930bcbee service nova] Lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:50:43 user nova-compute[72820]: DEBUG nova.compute.manager [req-aa14f92e-64e4-494e-8773-c0de1d02370b req-c0532a0c-408a-49c7-bab0-7c41930bcbee service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] No waiting events found dispatching network-vif-plugged-e9176c10-fdb2-40ee-9286-6b514d803b63 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:50:43 user nova-compute[72820]: WARNING nova.compute.manager [req-aa14f92e-64e4-494e-8773-c0de1d02370b req-c0532a0c-408a-49c7-bab0-7c41930bcbee service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Received unexpected event network-vif-plugged-e9176c10-fdb2-40ee-9286-6b514d803b63 for instance with vm_state building and task_state spawning.
Aug 27 02:50:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:45 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104645.198367, a470ac6a-b748-4142-84fe-ea073cf9f4a7 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:50:45 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] VM Resumed (Lifecycle Event)
Aug 27 02:50:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:50:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:50:45 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Instance spawned successfully.
Aug 27 02:50:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:50:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:50:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:50:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:50:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:50:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:50:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:50:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:50:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:50:45 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:50:45 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104645.1999645, a470ac6a-b748-4142-84fe-ea073cf9f4a7 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:50:45 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] VM Started (Lifecycle Event)
Aug 27 02:50:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:50:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:50:45 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:50:45 user nova-compute[72820]: INFO nova.compute.manager [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Took 4.96 seconds to spawn the instance on the hypervisor.
Aug 27 02:50:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:50:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-6c65968d-2eb4-4667-adbb-ef315bf3b539 req-24218a97-f222-4631-b2e3-6a3fb7eeaadb service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Received event network-vif-plugged-e9176c10-fdb2-40ee-9286-6b514d803b63 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:50:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6c65968d-2eb4-4667-adbb-ef315bf3b539 req-24218a97-f222-4631-b2e3-6a3fb7eeaadb service nova] Acquiring lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:50:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6c65968d-2eb4-4667-adbb-ef315bf3b539 req-24218a97-f222-4631-b2e3-6a3fb7eeaadb service nova] Lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:50:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6c65968d-2eb4-4667-adbb-ef315bf3b539 req-24218a97-f222-4631-b2e3-6a3fb7eeaadb service nova] Lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:50:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-6c65968d-2eb4-4667-adbb-ef315bf3b539 req-24218a97-f222-4631-b2e3-6a3fb7eeaadb service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] No waiting events found dispatching network-vif-plugged-e9176c10-fdb2-40ee-9286-6b514d803b63 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:50:45 user nova-compute[72820]: WARNING nova.compute.manager [req-6c65968d-2eb4-4667-adbb-ef315bf3b539 req-24218a97-f222-4631-b2e3-6a3fb7eeaadb service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Received unexpected event network-vif-plugged-e9176c10-fdb2-40ee-9286-6b514d803b63 for instance with vm_state building and task_state spawning.
Aug 27 02:50:45 user nova-compute[72820]: INFO nova.compute.manager [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Took 16.51 seconds to build instance.
Aug 27 02:50:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-de9dcf5f-27ab-42f2-80aa-c52ce381ddea tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.600s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:50:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-7914cf3c-c0c2-4a61-9ee2-e0f819571d38 req-34b6dbc2-14f2-4eff-9824-1f900803fee0 service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Received event network-changed-fafe642e-4c06-4eec-90ae-751c8cb746ca {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:50:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-7914cf3c-c0c2-4a61-9ee2-e0f819571d38 req-34b6dbc2-14f2-4eff-9824-1f900803fee0 service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Refreshing instance network info cache due to event network-changed-fafe642e-4c06-4eec-90ae-751c8cb746ca. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:50:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7914cf3c-c0c2-4a61-9ee2-e0f819571d38 req-34b6dbc2-14f2-4eff-9824-1f900803fee0 service nova] Acquiring lock "refresh_cache-5bff5ccf-6365-4086-9307-adb1c488617f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:50:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7914cf3c-c0c2-4a61-9ee2-e0f819571d38 req-34b6dbc2-14f2-4eff-9824-1f900803fee0 service nova] Acquired lock "refresh_cache-5bff5ccf-6365-4086-9307-adb1c488617f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:50:53 user nova-compute[72820]: DEBUG nova.network.neutron [req-7914cf3c-c0c2-4a61-9ee2-e0f819571d38 req-34b6dbc2-14f2-4eff-9824-1f900803fee0 service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Refreshing network info cache for port fafe642e-4c06-4eec-90ae-751c8cb746ca {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:50:54 user nova-compute[72820]: DEBUG nova.network.neutron [req-7914cf3c-c0c2-4a61-9ee2-e0f819571d38 req-34b6dbc2-14f2-4eff-9824-1f900803fee0 service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Updated VIF entry in instance network info cache for port fafe642e-4c06-4eec-90ae-751c8cb746ca. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:50:54 user nova-compute[72820]: DEBUG nova.network.neutron [req-7914cf3c-c0c2-4a61-9ee2-e0f819571d38 req-34b6dbc2-14f2-4eff-9824-1f900803fee0 service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Updating instance_info_cache with network_info: [{"id": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "address": "fa:16:3e:4d:50:a9", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe642e-4c", "ovs_interfaceid": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:50:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7914cf3c-c0c2-4a61-9ee2-e0f819571d38 req-34b6dbc2-14f2-4eff-9824-1f900803fee0 service nova] Releasing lock "refresh_cache-5bff5ccf-6365-4086-9307-adb1c488617f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:50:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:50:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "5bff5ccf-6365-4086-9307-adb1c488617f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:50:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "5bff5ccf-6365-4086-9307-adb1c488617f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:50:59 user nova-compute[72820]: DEBUG nova.objects.instance [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lazy-loading 'flavor' on Instance uuid 5bff5ccf-6365-4086-9307-adb1c488617f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:50:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "5bff5ccf-6365-4086-9307-adb1c488617f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:50:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "5bff5ccf-6365-4086-9307-adb1c488617f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:50:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "5bff5ccf-6365-4086-9307-adb1c488617f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:50:59 user nova-compute[72820]: INFO nova.compute.manager [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Attaching volume 4dbac620-7b96-490d-a1eb-a3cf1727e5f4 to /dev/vdb
Aug 27 02:51:00 user nova-compute[72820]: DEBUG os_brick.utils [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c820ce-9a8b-4bc2-ad59-9b0abb279d52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c276939-ab3f-46e7-8b69-2228e6039413]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b31a33-f92b-41ec-98b2-7f8acc4adcbc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee15d53-bdc2-4159-a336-5e02581c62e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:51:00 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:51:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40e4344-21b2-482f-ba37-21baa99dc937]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG os_brick.utils [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:51:00 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Updating existing volume attachment record: 15c6cc28-c9cd-43f1-8a89-b03472cf4ab7 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:51:01 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWBFAvCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:51:18 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:51:18 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:51:18 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b578cce-a080-45f3-a9eb-00e6f8c6eafb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:51:18 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[64881caa-4a58-4d77-9fc4-59adf87077fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4] added
Aug 27 02:51:18 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3496cb-27bb-4155-9b7e-3da1da8050c2]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0fad71-7127-4962-a6ba-401ea4d0e84c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XWBFAvCT {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XWBFAvCT" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1543e8e2-a27b-442a-9408-b877be5d8e32]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XWBFAvCT'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[44499222-9c93-4bb7-a819-a66151b336f2]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d31bd9-b113-48f9-9801-a77a5b64f9cc]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)
Aug 27 02:51:18 user nova-compute[72820]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 (non-flash)
Aug 27 02:51:18 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)
Aug 27 02:51:18 user nova-compute[72820]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 (non-flash)
Aug 27 02:51:18 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[879149e2-296d-45cb-80d6-c8cff9bb46a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4, portal: 172.16.0.220,3260]
Aug 27 02:51:18 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4, portal: 172.16.0.220,3260] successful.
Aug 27 02:51:18 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc37e79-5f03-4303-941c-fb6f12ee5f5c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[64faa602-2fd8-4191-b5f6-6243c1162d1d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)
Aug 27 02:51:18 user nova-compute[72820]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 (non-flash)
Aug 27 02:51:18 user nova-compute[72820]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 (non-flash)
Aug 27 02:51:18 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)
Aug 27 02:51:18 user nova-compute[72820]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 (non-flash)
Aug 27 02:51:18 user nova-compute[72820]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 (non-flash)
Aug 27 02:51:18 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcc9051-0ece-4a13-ba08-fa9e49115173]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:51:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWBFAvCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:51:19 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:51:19 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23930393335613733', 'path': '/dev/sdd'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:51:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930393335613733', 'path': '/dev/sdd'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:51:19 user nova-compute[72820]: DEBUG nova.objects.instance [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lazy-loading 'flavor' on Instance uuid 5bff5ccf-6365-4086-9307-adb1c488617f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:51:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:51:19 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:51:19 user nova-compute[72820]:   <source dev="/dev/sdd"/>
Aug 27 02:51:19 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:51:19 user nova-compute[72820]:   <serial>4dbac620-7b96-490d-a1eb-a3cf1727e5f4</serial>
Aug 27 02:51:19 user nova-compute[72820]: </disk>
Aug 27 02:51:19 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:51:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:51:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:51:20 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] No VIF found with MAC fa:16:3e:4d:50:a9, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:51:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-f9c42e04-9bbf-4a5b-b39b-be642bb981c1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "5bff5ccf-6365-4086-9307-adb1c488617f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.563s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:51:21 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:51:21 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:51:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:51:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:51:24 user nova-compute[72820]: DEBUG nova.compute.manager [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:51:25 user nova-compute[72820]: INFO nova.compute.claims [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Claim successful on node user
Aug 27 02:51:25 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG nova.network.neutron [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:51:25 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:51:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG nova.policy [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '391718f05f07460f9388d168d1ebdc98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '117a0b3ffbe84eba93968f924fa7d2e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:51:25 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Creating image(s)
Aug 27 02:51:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "/opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "/opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.184s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:51:25 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.169s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/disk 1073741824" returned: 0 in 0.048s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:51:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.180s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:26 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:51:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:26 user nova-compute[72820]: DEBUG nova.network.neutron [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Successfully created port: 9558ff30-3839-4db9-9ced-1410b2dffc76 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:51:26 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:26 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Cannot resize image /opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:51:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:51:26 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Ensure instance console log exists: /opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:51:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:51:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:51:26 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:51:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.network.neutron [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Successfully updated port: 9558ff30-3839-4db9-9ced-1410b2dffc76 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "refresh_cache-ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquired lock "refresh_cache-ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.network.neutron [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.compute.manager [req-2eb5910d-8eaf-4b49-a374-96dd704efbcb req-44e19093-43c6-4b6d-af58-6da4431f41ba service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Received event network-changed-9558ff30-3839-4db9-9ced-1410b2dffc76 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.compute.manager [req-2eb5910d-8eaf-4b49-a374-96dd704efbcb req-44e19093-43c6-4b6d-af58-6da4431f41ba service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Refreshing instance network info cache due to event network-changed-9558ff30-3839-4db9-9ced-1410b2dffc76. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2eb5910d-8eaf-4b49-a374-96dd704efbcb req-44e19093-43c6-4b6d-af58-6da4431f41ba service nova] Acquiring lock "refresh_cache-ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.network.neutron [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.network.neutron [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Updating instance_info_cache with network_info: [{"id": "9558ff30-3839-4db9-9ced-1410b2dffc76", "address": "fa:16:3e:e5:e3:1b", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9558ff30-38", "ovs_interfaceid": "9558ff30-3839-4db9-9ced-1410b2dffc76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Releasing lock "refresh_cache-ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.compute.manager [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Instance network_info: |[{"id": "9558ff30-3839-4db9-9ced-1410b2dffc76", "address": "fa:16:3e:e5:e3:1b", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9558ff30-38", "ovs_interfaceid": "9558ff30-3839-4db9-9ced-1410b2dffc76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2eb5910d-8eaf-4b49-a374-96dd704efbcb req-44e19093-43c6-4b6d-af58-6da4431f41ba service nova] Acquired lock "refresh_cache-ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.network.neutron [req-2eb5910d-8eaf-4b49-a374-96dd704efbcb req-44e19093-43c6-4b6d-af58-6da4431f41ba service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Refreshing network info cache for port 9558ff30-3839-4db9-9ced-1410b2dffc76 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Start _get_guest_xml network_info=[{"id": "9558ff30-3839-4db9-9ced-1410b2dffc76", "address": "fa:16:3e:e5:e3:1b", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9558ff30-38", "ovs_interfaceid": "9558ff30-3839-4db9-9ced-1410b2dffc76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:51:27 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:51:27 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:51:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2144700579',display_name='tempest-AttachVolumeNegativeTest-server-2144700579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2144700579',id=46,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhX7u0BiegyHCZNHwrqw5qGl4vPm4odHv7mztFxyYf3SuWvTYNCzmAB0ROnF4stniGnSQuDXp949SzXv+Om6Ns7dJ6C2GqgcPaex1aBq3F53i9aeIwSP6JiEj4j5IY9rA==',key_name='tempest-keypair-1385607554',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='117a0b3ffbe84eba93968f924fa7d2e9',ramdisk_id='',reservation_id='r-y5dn06x4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2145874992',owner_user_name='tempest-AttachVolumeNegativeTest-2145874992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:51:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='391718f05f07460f9388d168d1ebdc98',uuid=ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9558ff30-3839-4db9-9ced-1410b2dffc76", "address": "fa:16:3e:e5:e3:1b", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9558ff30-38", "ovs_interfaceid": "9558ff30-3839-4db9-9ced-1410b2dffc76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converting VIF {"id": "9558ff30-3839-4db9-9ced-1410b2dffc76", "address": "fa:16:3e:e5:e3:1b", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9558ff30-38", "ovs_interfaceid": "9558ff30-3839-4db9-9ced-1410b2dffc76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e3:1b,bridge_name='br-int',has_traffic_filtering=True,id=9558ff30-3839-4db9-9ced-1410b2dffc76,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9558ff30-38') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.objects.instance [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lazy-loading 'pci_devices' on Instance uuid ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:51:27 user nova-compute[72820]:   <uuid>ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d</uuid>
Aug 27 02:51:27 user nova-compute[72820]:   <name>instance-0000002e</name>
Aug 27 02:51:27 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:51:27 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:51:27 user nova-compute[72820]:   <metadata>
Aug 27 02:51:27 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:51:27 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:51:27 user nova-compute[72820]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2144700579</nova:name>
Aug 27 02:51:27 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:51:27</nova:creationTime>
Aug 27 02:51:27 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:51:27 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:51:27 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:51:27 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:51:27 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:51:27 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:51:27 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:51:27 user nova-compute[72820]:       <nova:owner>
Aug 27 02:51:27 user nova-compute[72820]:         <nova:user uuid="391718f05f07460f9388d168d1ebdc98">tempest-AttachVolumeNegativeTest-2145874992-project-member</nova:user>
Aug 27 02:51:27 user nova-compute[72820]:         <nova:project uuid="117a0b3ffbe84eba93968f924fa7d2e9">tempest-AttachVolumeNegativeTest-2145874992</nova:project>
Aug 27 02:51:27 user nova-compute[72820]:       </nova:owner>
Aug 27 02:51:27 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:51:27 user nova-compute[72820]:       <nova:ports>
Aug 27 02:51:27 user nova-compute[72820]:         <nova:port uuid="9558ff30-3839-4db9-9ced-1410b2dffc76">
Aug 27 02:51:27 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 02:51:27 user nova-compute[72820]:         </nova:port>
Aug 27 02:51:27 user nova-compute[72820]:       </nova:ports>
Aug 27 02:51:27 user nova-compute[72820]:     </nova:instance>
Aug 27 02:51:27 user nova-compute[72820]:   </metadata>
Aug 27 02:51:27 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:51:27 user nova-compute[72820]:     <system>
Aug 27 02:51:27 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:51:27 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:51:27 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:51:27 user nova-compute[72820]:       <entry name="serial">ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d</entry>
Aug 27 02:51:27 user nova-compute[72820]:       <entry name="uuid">ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d</entry>
Aug 27 02:51:27 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:51:27 user nova-compute[72820]:     </system>
Aug 27 02:51:27 user nova-compute[72820]:   </sysinfo>
Aug 27 02:51:27 user nova-compute[72820]:   <os>
Aug 27 02:51:27 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:51:27 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:51:27 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:51:27 user nova-compute[72820]:   </os>
Aug 27 02:51:27 user nova-compute[72820]:   <features>
Aug 27 02:51:27 user nova-compute[72820]:     <acpi/>
Aug 27 02:51:27 user nova-compute[72820]:     <apic/>
Aug 27 02:51:27 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:51:27 user nova-compute[72820]:   </features>
Aug 27 02:51:27 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:51:27 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:51:27 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:51:27 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:51:27 user nova-compute[72820]:   </clock>
Aug 27 02:51:27 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:51:27 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:51:27 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:51:27 user nova-compute[72820]:   </cpu>
Aug 27 02:51:27 user nova-compute[72820]:   <devices>
Aug 27 02:51:27 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:51:27 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:51:27 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/disk"/>
Aug 27 02:51:27 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:51:27 user nova-compute[72820]:     </disk>
Aug 27 02:51:27 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:51:27 user nova-compute[72820]:       <mac address="fa:16:3e:e5:e3:1b"/>
Aug 27 02:51:27 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:51:27 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:51:27 user nova-compute[72820]:       <target dev="tap9558ff30-38"/>
Aug 27 02:51:27 user nova-compute[72820]:     </interface>
Aug 27 02:51:27 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:51:27 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/console.log" append="off"/>
Aug 27 02:51:27 user nova-compute[72820]:     </serial>
Aug 27 02:51:27 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:51:27 user nova-compute[72820]:     <video>
Aug 27 02:51:27 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:51:27 user nova-compute[72820]:     </video>
Aug 27 02:51:27 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:51:27 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:51:27 user nova-compute[72820]:     </rng>
Aug 27 02:51:27 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:51:27 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:51:27 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:51:27 user nova-compute[72820]:     </memballoon>
Aug 27 02:51:27 user nova-compute[72820]:   </devices>
Aug 27 02:51:27 user nova-compute[72820]: </domain>
Aug 27 02:51:27 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:51:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2144700579',display_name='tempest-AttachVolumeNegativeTest-server-2144700579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2144700579',id=46,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhX7u0BiegyHCZNHwrqw5qGl4vPm4odHv7mztFxyYf3SuWvTYNCzmAB0ROnF4stniGnSQuDXp949SzXv+Om6Ns7dJ6C2GqgcPaex1aBq3F53i9aeIwSP6JiEj4j5IY9rA==',key_name='tempest-keypair-1385607554',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='117a0b3ffbe84eba93968f924fa7d2e9',ramdisk_id='',reservation_id='r-y5dn06x4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2145874992',owner_user_name='tempest-AttachVolumeNegativeTest-2145874992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:51:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='391718f05f07460f9388d168d1ebdc98',uuid=ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9558ff30-3839-4db9-9ced-1410b2dffc76", "address": "fa:16:3e:e5:e3:1b", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9558ff30-38", "ovs_interfaceid": "9558ff30-3839-4db9-9ced-1410b2dffc76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converting VIF {"id": "9558ff30-3839-4db9-9ced-1410b2dffc76", "address": "fa:16:3e:e5:e3:1b", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9558ff30-38", "ovs_interfaceid": "9558ff30-3839-4db9-9ced-1410b2dffc76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e3:1b,bridge_name='br-int',has_traffic_filtering=True,id=9558ff30-3839-4db9-9ced-1410b2dffc76,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9558ff30-38') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG os_vif [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e3:1b,bridge_name='br-int',has_traffic_filtering=True,id=9558ff30-3839-4db9-9ced-1410b2dffc76,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9558ff30-38') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9558ff30-38, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9558ff30-38, col_values=(('external_ids', {'iface-id': '9558ff30-3839-4db9-9ced-1410b2dffc76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:e3:1b', 'vm-uuid': 'ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:27 user nova-compute[72820]: INFO os_vif [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e3:1b,bridge_name='br-int',has_traffic_filtering=True,id=9558ff30-3839-4db9-9ced-1410b2dffc76,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9558ff30-38')
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] No VIF found with MAC fa:16:3e:e5:e3:1b, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.network.neutron [req-2eb5910d-8eaf-4b49-a374-96dd704efbcb req-44e19093-43c6-4b6d-af58-6da4431f41ba service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Updated VIF entry in instance network info cache for port 9558ff30-3839-4db9-9ced-1410b2dffc76. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG nova.network.neutron [req-2eb5910d-8eaf-4b49-a374-96dd704efbcb req-44e19093-43c6-4b6d-af58-6da4431f41ba service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Updating instance_info_cache with network_info: [{"id": "9558ff30-3839-4db9-9ced-1410b2dffc76", "address": "fa:16:3e:e5:e3:1b", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9558ff30-38", "ovs_interfaceid": "9558ff30-3839-4db9-9ced-1410b2dffc76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:51:27 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-2eb5910d-8eaf-4b49-a374-96dd704efbcb req-44e19093-43c6-4b6d-af58-6da4431f41ba service nova] Releasing lock "refresh_cache-ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:51:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:29 user nova-compute[72820]: DEBUG nova.compute.manager [req-16622e11-a7f6-4505-a844-b2270b0c8027 req-1a34fdeb-5a1c-4b69-9ebb-7d0e4c6062dc service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Received event network-vif-plugged-9558ff30-3839-4db9-9ced-1410b2dffc76 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:51:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-16622e11-a7f6-4505-a844-b2270b0c8027 req-1a34fdeb-5a1c-4b69-9ebb-7d0e4c6062dc service nova] Acquiring lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:51:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-16622e11-a7f6-4505-a844-b2270b0c8027 req-1a34fdeb-5a1c-4b69-9ebb-7d0e4c6062dc service nova] Lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:51:29 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-16622e11-a7f6-4505-a844-b2270b0c8027 req-1a34fdeb-5a1c-4b69-9ebb-7d0e4c6062dc service nova] Lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:51:29 user nova-compute[72820]: DEBUG nova.compute.manager [req-16622e11-a7f6-4505-a844-b2270b0c8027 req-1a34fdeb-5a1c-4b69-9ebb-7d0e4c6062dc service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] No waiting events found dispatching network-vif-plugged-9558ff30-3839-4db9-9ced-1410b2dffc76 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:51:29 user nova-compute[72820]: WARNING nova.compute.manager [req-16622e11-a7f6-4505-a844-b2270b0c8027 req-1a34fdeb-5a1c-4b69-9ebb-7d0e4c6062dc service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Received unexpected event network-vif-plugged-9558ff30-3839-4db9-9ced-1410b2dffc76 for instance with vm_state building and task_state spawning.
Aug 27 02:51:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:30 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:51:30 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:51:30 user nova-compute[72820]: DEBUG nova.compute.manager [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:51:30 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:51:30 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104690.987389, ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:51:30 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] VM Resumed (Lifecycle Event)
Aug 27 02:51:31 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Instance spawned successfully.
Aug 27 02:51:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:51:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:51:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:51:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:51:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:51:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:51:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:51:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:51:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:51:31 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:51:31 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104690.988329, ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:51:31 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] VM Started (Lifecycle Event)
Aug 27 02:51:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:51:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:51:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-9214680b-4bf5-4b6b-9f0e-06f56dead69b req-e6f723ca-3912-47f3-9f8a-551fae592752 service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Received event network-vif-plugged-9558ff30-3839-4db9-9ced-1410b2dffc76 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:51:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9214680b-4bf5-4b6b-9f0e-06f56dead69b req-e6f723ca-3912-47f3-9f8a-551fae592752 service nova] Acquiring lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:51:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9214680b-4bf5-4b6b-9f0e-06f56dead69b req-e6f723ca-3912-47f3-9f8a-551fae592752 service nova] Lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:51:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-9214680b-4bf5-4b6b-9f0e-06f56dead69b req-e6f723ca-3912-47f3-9f8a-551fae592752 service nova] Lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:51:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-9214680b-4bf5-4b6b-9f0e-06f56dead69b req-e6f723ca-3912-47f3-9f8a-551fae592752 service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] No waiting events found dispatching network-vif-plugged-9558ff30-3839-4db9-9ced-1410b2dffc76 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:51:31 user nova-compute[72820]: WARNING nova.compute.manager [req-9214680b-4bf5-4b6b-9f0e-06f56dead69b req-e6f723ca-3912-47f3-9f8a-551fae592752 service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Received unexpected event network-vif-plugged-9558ff30-3839-4db9-9ced-1410b2dffc76 for instance with vm_state building and task_state spawning.
Aug 27 02:51:31 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:51:31 user nova-compute[72820]: INFO nova.compute.manager [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Took 5.44 seconds to spawn the instance on the hypervisor.
Aug 27 02:51:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:51:31 user nova-compute[72820]: INFO nova.compute.manager [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Took 6.17 seconds to build instance.
Aug 27 02:51:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-db18de47-8a33-4928-8f74-f6e2db88f633 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.279s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:51:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:51:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:51:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:51:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "f6349e97-f14d-4104-9959-1193781a2c4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:51:35 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:51:36 user nova-compute[72820]: INFO nova.compute.claims [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Claim successful on node user
Aug 27 02:51:36 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Refreshing inventories for resource provider a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Updating ProviderTree inventory for provider a962b30a-2750-431c-be10-075d0f991065 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Updating inventory in ProviderTree for provider a962b30a-2750-431c-be10-075d0f991065 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Refreshing aggregate associations for resource provider a962b30a-2750-431c-be10-075d0f991065, aggregates: None {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Refreshing trait associations for resource provider a962b30a-2750-431c-be10-075d0f991065, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG nova.network.neutron [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:51:36 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:51:36 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG nova.policy [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a767e402c070429caad7dd8a4cedf72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54352cfd7c104bd9acb2d479ccefc214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:51:36 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Creating image(s)
Aug 27 02:51:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "/opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "/opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "24c93ab9f46be2dfd2a40dfa937dc9b88e88011a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:51:36 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "24c93ab9f46be2dfd2a40dfa937dc9b88e88011a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:51:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a.part --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a.part --force-share --output=json" returned: 0 in 0.212s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:37 user nova-compute[72820]: DEBUG nova.virt.images [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] f9f62467-2436-4491-9ef0-eb671acdf108 was qcow2, converting to raw {{(pid=72820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 02:51:37 user nova-compute[72820]: DEBUG nova.privsep.utils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 02:51:37 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a.part /opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a.converted {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:37 user nova-compute[72820]: DEBUG nova.network.neutron [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Successfully created port: b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a.part /opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a.converted" returned: 0 in 0.448s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a.converted --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a.converted --force-share --output=json" returned: 0 in 0.223s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "24c93ab9f46be2dfd2a40dfa937dc9b88e88011a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.510s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a --force-share --output=json" returned: 0 in 0.203s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "24c93ab9f46be2dfd2a40dfa937dc9b88e88011a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "24c93ab9f46be2dfd2a40dfa937dc9b88e88011a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG nova.network.neutron [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Successfully updated port: b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquired lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG nova.network.neutron [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a --force-share --output=json" returned: 0 in 0.181s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a,backing_fmt=raw /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG nova.network.neutron [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a,backing_fmt=raw /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk 1073741824" returned: 0 in 0.086s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "24c93ab9f46be2dfd2a40dfa937dc9b88e88011a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-cea7c654-042b-4a75-890e-8352b5208727 req-d330abce-e2a2-4469-8c1e-3673aea4466f service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-changed-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG nova.compute.manager [req-cea7c654-042b-4a75-890e-8352b5208727 req-d330abce-e2a2-4469-8c1e-3673aea4466f service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Refreshing instance network info cache due to event network-changed-b17ed63b-2125-4530-a7e3-e715affe9d50. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-cea7c654-042b-4a75-890e-8352b5208727 req-d330abce-e2a2-4469-8c1e-3673aea4466f service nova] Acquiring lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:51:38 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a --force-share --output=json" returned: 0 in 0.198s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.network.neutron [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updating instance_info_cache with network_info: [{"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Releasing lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Instance network_info: |[{"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-cea7c654-042b-4a75-890e-8352b5208727 req-d330abce-e2a2-4469-8c1e-3673aea4466f service nova] Acquired lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.network.neutron [req-cea7c654-042b-4a75-890e-8352b5208727 req-d330abce-e2a2-4469-8c1e-3673aea4466f service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Refreshing network info cache for port b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Cannot resize image /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Ensure instance console log exists: /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Start _get_guest_xml network_info=[{"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:51:33Z,direct_url=<?>,disk_format='qcow2',id=f9f62467-2436-4491-9ef0-eb671acdf108,min_disk=0,min_ram=0,name='tempest-scenario-img--1154846659',owner='54352cfd7c104bd9acb2d479ccefc214',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:51:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': 'f9f62467-2436-4491-9ef0-eb671acdf108'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:51:39 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:51:39 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:51:33Z,direct_url=<?>,disk_format='qcow2',id=f9f62467-2436-4491-9ef0-eb671acdf108,min_disk=0,min_ram=0,name='tempest-scenario-img--1154846659',owner='54352cfd7c104bd9acb2d479ccefc214',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:51:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:51:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2074165623',display_name='tempest-TestMinimumBasicScenario-server-2074165623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2074165623',id=47,image_ref='f9f62467-2436-4491-9ef0-eb671acdf108',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcX2jA7sDNPWUQhjs1FiyFD7h6MX0eLaDB9NFR3NOAlF+VbO89wFOHA4K1huE1Hf1P/pKJKuIAlKoEIkWrI9gLcvVOOBWxzx/5z1ZwxvOP9NtZa00eV9AfXmisNGspKWg==',key_name='tempest-TestMinimumBasicScenario-815937332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54352cfd7c104bd9acb2d479ccefc214',ramdisk_id='',reservation_id='r-c1uyhvmg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f9f62467-2436-4491-9ef0-eb671acdf108',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-181769521',owner_user_name='tempest-TestMinimumBasicScenario-181769521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:51:37Z,user_data=None,user_id='a767e402c070429caad7dd8a4cedf72d',uuid=f6349e97-f14d-4104-9959-1193781a2c4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Converting VIF {"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=b17ed63b-2125-4530-a7e3-e715affe9d50,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb17ed63b-21') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.objects.instance [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lazy-loading 'pci_devices' on Instance uuid f6349e97-f14d-4104-9959-1193781a2c4c {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:51:39 user nova-compute[72820]:   <uuid>f6349e97-f14d-4104-9959-1193781a2c4c</uuid>
Aug 27 02:51:39 user nova-compute[72820]:   <name>instance-0000002f</name>
Aug 27 02:51:39 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:51:39 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:51:39 user nova-compute[72820]:   <metadata>
Aug 27 02:51:39 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:51:39 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:51:39 user nova-compute[72820]:       <nova:name>tempest-TestMinimumBasicScenario-server-2074165623</nova:name>
Aug 27 02:51:39 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:51:39</nova:creationTime>
Aug 27 02:51:39 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:51:39 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:51:39 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:51:39 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:51:39 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:51:39 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:51:39 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:51:39 user nova-compute[72820]:       <nova:owner>
Aug 27 02:51:39 user nova-compute[72820]:         <nova:user uuid="a767e402c070429caad7dd8a4cedf72d">tempest-TestMinimumBasicScenario-181769521-project-member</nova:user>
Aug 27 02:51:39 user nova-compute[72820]:         <nova:project uuid="54352cfd7c104bd9acb2d479ccefc214">tempest-TestMinimumBasicScenario-181769521</nova:project>
Aug 27 02:51:39 user nova-compute[72820]:       </nova:owner>
Aug 27 02:51:39 user nova-compute[72820]:       <nova:root type="image" uuid="f9f62467-2436-4491-9ef0-eb671acdf108"/>
Aug 27 02:51:39 user nova-compute[72820]:       <nova:ports>
Aug 27 02:51:39 user nova-compute[72820]:         <nova:port uuid="b17ed63b-2125-4530-a7e3-e715affe9d50">
Aug 27 02:51:39 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 02:51:39 user nova-compute[72820]:         </nova:port>
Aug 27 02:51:39 user nova-compute[72820]:       </nova:ports>
Aug 27 02:51:39 user nova-compute[72820]:     </nova:instance>
Aug 27 02:51:39 user nova-compute[72820]:   </metadata>
Aug 27 02:51:39 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:51:39 user nova-compute[72820]:     <system>
Aug 27 02:51:39 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:51:39 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:51:39 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:51:39 user nova-compute[72820]:       <entry name="serial">f6349e97-f14d-4104-9959-1193781a2c4c</entry>
Aug 27 02:51:39 user nova-compute[72820]:       <entry name="uuid">f6349e97-f14d-4104-9959-1193781a2c4c</entry>
Aug 27 02:51:39 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:51:39 user nova-compute[72820]:     </system>
Aug 27 02:51:39 user nova-compute[72820]:   </sysinfo>
Aug 27 02:51:39 user nova-compute[72820]:   <os>
Aug 27 02:51:39 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:51:39 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:51:39 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:51:39 user nova-compute[72820]:   </os>
Aug 27 02:51:39 user nova-compute[72820]:   <features>
Aug 27 02:51:39 user nova-compute[72820]:     <acpi/>
Aug 27 02:51:39 user nova-compute[72820]:     <apic/>
Aug 27 02:51:39 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:51:39 user nova-compute[72820]:   </features>
Aug 27 02:51:39 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:51:39 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:51:39 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:51:39 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:51:39 user nova-compute[72820]:   </clock>
Aug 27 02:51:39 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:51:39 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:51:39 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:51:39 user nova-compute[72820]:   </cpu>
Aug 27 02:51:39 user nova-compute[72820]:   <devices>
Aug 27 02:51:39 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:51:39 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:51:39 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk"/>
Aug 27 02:51:39 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:51:39 user nova-compute[72820]:     </disk>
Aug 27 02:51:39 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:51:39 user nova-compute[72820]:       <mac address="fa:16:3e:d3:84:d7"/>
Aug 27 02:51:39 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:51:39 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:51:39 user nova-compute[72820]:       <target dev="tapb17ed63b-21"/>
Aug 27 02:51:39 user nova-compute[72820]:     </interface>
Aug 27 02:51:39 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:51:39 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/console.log" append="off"/>
Aug 27 02:51:39 user nova-compute[72820]:     </serial>
Aug 27 02:51:39 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:51:39 user nova-compute[72820]:     <video>
Aug 27 02:51:39 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:51:39 user nova-compute[72820]:     </video>
Aug 27 02:51:39 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:51:39 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:51:39 user nova-compute[72820]:     </rng>
Aug 27 02:51:39 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:51:39 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:51:39 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:51:39 user nova-compute[72820]:     </memballoon>
Aug 27 02:51:39 user nova-compute[72820]:   </devices>
Aug 27 02:51:39 user nova-compute[72820]: </domain>
Aug 27 02:51:39 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:51:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2074165623',display_name='tempest-TestMinimumBasicScenario-server-2074165623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2074165623',id=47,image_ref='f9f62467-2436-4491-9ef0-eb671acdf108',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcX2jA7sDNPWUQhjs1FiyFD7h6MX0eLaDB9NFR3NOAlF+VbO89wFOHA4K1huE1Hf1P/pKJKuIAlKoEIkWrI9gLcvVOOBWxzx/5z1ZwxvOP9NtZa00eV9AfXmisNGspKWg==',key_name='tempest-TestMinimumBasicScenario-815937332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54352cfd7c104bd9acb2d479ccefc214',ramdisk_id='',reservation_id='r-c1uyhvmg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f9f62467-2436-4491-9ef0-eb671acdf108',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-181769521',owner_user_name='tempest-TestMinimumBasicScenario-181769521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:51:37Z,user_data=None,user_id='a767e402c070429caad7dd8a4cedf72d',uuid=f6349e97-f14d-4104-9959-1193781a2c4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Converting VIF {"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=b17ed63b-2125-4530-a7e3-e715affe9d50,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb17ed63b-21') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG os_vif [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=b17ed63b-2125-4530-a7e3-e715affe9d50,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb17ed63b-21') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb17ed63b-21, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb17ed63b-21, col_values=(('external_ids', {'iface-id': 'b17ed63b-2125-4530-a7e3-e715affe9d50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:84:d7', 'vm-uuid': 'f6349e97-f14d-4104-9959-1193781a2c4c'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:39 user nova-compute[72820]: INFO os_vif [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=b17ed63b-2125-4530-a7e3-e715affe9d50,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb17ed63b-21')
Aug 27 02:51:39 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:51:39 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8361MB free_disk=25.106517791748047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] No VIF found with MAC fa:16:3e:d3:84:d7, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 4480b84a-32b2-4276-ab6d-8c47f4057e55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 5bff5ccf-6365-4086-9307-adb1c488617f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance a470ac6a-b748-4142-84fe-ea073cf9f4a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f6349e97-f14d-4104-9959-1193781a2c4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:51:39 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:51:40 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:51:40 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:51:40 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:51:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.368s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:51:40 user nova-compute[72820]: DEBUG nova.network.neutron [req-cea7c654-042b-4a75-890e-8352b5208727 req-d330abce-e2a2-4469-8c1e-3673aea4466f service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updated VIF entry in instance network info cache for port b17ed63b-2125-4530-a7e3-e715affe9d50. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:51:40 user nova-compute[72820]: DEBUG nova.network.neutron [req-cea7c654-042b-4a75-890e-8352b5208727 req-d330abce-e2a2-4469-8c1e-3673aea4466f service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updating instance_info_cache with network_info: [{"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:51:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-cea7c654-042b-4a75-890e-8352b5208727 req-d330abce-e2a2-4469-8c1e-3673aea4466f service nova] Releasing lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-5bff5ccf-6365-4086-9307-adb1c488617f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-5bff5ccf-6365-4086-9307-adb1c488617f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG nova.compute.manager [req-f4b8e680-add5-4aa2-ad1a-cf5117edf8c6 req-829b1a38-b04d-4ed7-b5d0-9a919f9b461a service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f4b8e680-add5-4aa2-ad1a-cf5117edf8c6 req-829b1a38-b04d-4ed7-b5d0-9a919f9b461a service nova] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f4b8e680-add5-4aa2-ad1a-cf5117edf8c6 req-829b1a38-b04d-4ed7-b5d0-9a919f9b461a service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f4b8e680-add5-4aa2-ad1a-cf5117edf8c6 req-829b1a38-b04d-4ed7-b5d0-9a919f9b461a service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG nova.compute.manager [req-f4b8e680-add5-4aa2-ad1a-cf5117edf8c6 req-829b1a38-b04d-4ed7-b5d0-9a919f9b461a service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] No waiting events found dispatching network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:51:41 user nova-compute[72820]: WARNING nova.compute.manager [req-f4b8e680-add5-4aa2-ad1a-cf5117edf8c6 req-829b1a38-b04d-4ed7-b5d0-9a919f9b461a service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received unexpected event network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 for instance with vm_state building and task_state spawning.
Aug 27 02:51:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Updating instance_info_cache with network_info: [{"id": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "address": "fa:16:3e:4d:50:a9", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe642e-4c", "ovs_interfaceid": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-5bff5ccf-6365-4086-9307-adb1c488617f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:51:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 02:51:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:43 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104703.2906506, f6349e97-f14d-4104-9959-1193781a2c4c => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:51:43 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] VM Resumed (Lifecycle Event)
Aug 27 02:51:43 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:51:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:51:43 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Instance spawned successfully.
Aug 27 02:51:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:51:43 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:51:43 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:51:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:51:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:51:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:51:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:51:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:51:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:51:43 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:51:43 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104703.292187, f6349e97-f14d-4104-9959-1193781a2c4c => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:51:43 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] VM Started (Lifecycle Event)
Aug 27 02:51:43 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:51:43 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:51:43 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:51:43 user nova-compute[72820]: INFO nova.compute.manager [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Took 6.58 seconds to spawn the instance on the hypervisor.
Aug 27 02:51:43 user nova-compute[72820]: DEBUG nova.compute.manager [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:51:43 user nova-compute[72820]: DEBUG nova.compute.manager [req-506ffe8d-475b-404e-bd11-9c11aa9fe4fb req-20cb8f33-0db3-493b-9f80-38d85bed6ac7 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:51:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-506ffe8d-475b-404e-bd11-9c11aa9fe4fb req-20cb8f33-0db3-493b-9f80-38d85bed6ac7 service nova] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:51:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-506ffe8d-475b-404e-bd11-9c11aa9fe4fb req-20cb8f33-0db3-493b-9f80-38d85bed6ac7 service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:51:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-506ffe8d-475b-404e-bd11-9c11aa9fe4fb req-20cb8f33-0db3-493b-9f80-38d85bed6ac7 service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:51:43 user nova-compute[72820]: DEBUG nova.compute.manager [req-506ffe8d-475b-404e-bd11-9c11aa9fe4fb req-20cb8f33-0db3-493b-9f80-38d85bed6ac7 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] No waiting events found dispatching network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:51:43 user nova-compute[72820]: WARNING nova.compute.manager [req-506ffe8d-475b-404e-bd11-9c11aa9fe4fb req-20cb8f33-0db3-493b-9f80-38d85bed6ac7 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received unexpected event network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 for instance with vm_state building and task_state spawning.
Aug 27 02:51:43 user nova-compute[72820]: INFO nova.compute.manager [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Took 7.47 seconds to build instance.
Aug 27 02:51:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7b5f0e66-ac09-4c9e-8f03-f6704605204f tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "f6349e97-f14d-4104-9959-1193781a2c4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.583s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:51:44 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:51:44 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 02:51:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:44 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] There are 0 instances to clean {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 02:51:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:53 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:51:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:51:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:20 user nova-compute[72820]: DEBUG nova.compute.manager [req-c530108e-268d-440a-852c-0a3ce9dcd8bd req-22b5fb9c-8fb2-47a4-9f20-e33a55a4a453 service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Received event network-changed-e9176c10-fdb2-40ee-9286-6b514d803b63 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:52:20 user nova-compute[72820]: DEBUG nova.compute.manager [req-c530108e-268d-440a-852c-0a3ce9dcd8bd req-22b5fb9c-8fb2-47a4-9f20-e33a55a4a453 service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Refreshing instance network info cache due to event network-changed-e9176c10-fdb2-40ee-9286-6b514d803b63. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:52:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c530108e-268d-440a-852c-0a3ce9dcd8bd req-22b5fb9c-8fb2-47a4-9f20-e33a55a4a453 service nova] Acquiring lock "refresh_cache-a470ac6a-b748-4142-84fe-ea073cf9f4a7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:52:20 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c530108e-268d-440a-852c-0a3ce9dcd8bd req-22b5fb9c-8fb2-47a4-9f20-e33a55a4a453 service nova] Acquired lock "refresh_cache-a470ac6a-b748-4142-84fe-ea073cf9f4a7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:52:20 user nova-compute[72820]: DEBUG nova.network.neutron [req-c530108e-268d-440a-852c-0a3ce9dcd8bd req-22b5fb9c-8fb2-47a4-9f20-e33a55a4a453 service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Refreshing network info cache for port e9176c10-fdb2-40ee-9286-6b514d803b63 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:52:21 user nova-compute[72820]: DEBUG nova.network.neutron [req-c530108e-268d-440a-852c-0a3ce9dcd8bd req-22b5fb9c-8fb2-47a4-9f20-e33a55a4a453 service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Updated VIF entry in instance network info cache for port e9176c10-fdb2-40ee-9286-6b514d803b63. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:52:21 user nova-compute[72820]: DEBUG nova.network.neutron [req-c530108e-268d-440a-852c-0a3ce9dcd8bd req-22b5fb9c-8fb2-47a4-9f20-e33a55a4a453 service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Updating instance_info_cache with network_info: [{"id": "e9176c10-fdb2-40ee-9286-6b514d803b63", "address": "fa:16:3e:de:4d:22", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9176c10-fd", "ovs_interfaceid": "e9176c10-fdb2-40ee-9286-6b514d803b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:52:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c530108e-268d-440a-852c-0a3ce9dcd8bd req-22b5fb9c-8fb2-47a4-9f20-e33a55a4a453 service nova] Releasing lock "refresh_cache-a470ac6a-b748-4142-84fe-ea073cf9f4a7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:52:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:52:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:52:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:52:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:52:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:52:21 user nova-compute[72820]: INFO nova.compute.manager [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Terminating instance
Aug 27 02:52:21 user nova-compute[72820]: DEBUG nova.compute.manager [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:52:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-7a18b1d1-3a47-462d-8519-e6a432b0bd80 req-e9c239de-1bfa-40e1-aeba-ac0f47f2fc1c service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Received event network-vif-unplugged-e9176c10-fdb2-40ee-9286-6b514d803b63 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:52:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7a18b1d1-3a47-462d-8519-e6a432b0bd80 req-e9c239de-1bfa-40e1-aeba-ac0f47f2fc1c service nova] Acquiring lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:52:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7a18b1d1-3a47-462d-8519-e6a432b0bd80 req-e9c239de-1bfa-40e1-aeba-ac0f47f2fc1c service nova] Lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:52:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7a18b1d1-3a47-462d-8519-e6a432b0bd80 req-e9c239de-1bfa-40e1-aeba-ac0f47f2fc1c service nova] Lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:52:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-7a18b1d1-3a47-462d-8519-e6a432b0bd80 req-e9c239de-1bfa-40e1-aeba-ac0f47f2fc1c service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] No waiting events found dispatching network-vif-unplugged-e9176c10-fdb2-40ee-9286-6b514d803b63 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:52:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-7a18b1d1-3a47-462d-8519-e6a432b0bd80 req-e9c239de-1bfa-40e1-aeba-ac0f47f2fc1c service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Received event network-vif-unplugged-e9176c10-fdb2-40ee-9286-6b514d803b63 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:52:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:52:22 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Instance destroyed successfully.
Aug 27 02:52:22 user nova-compute[72820]: DEBUG nova.objects.instance [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lazy-loading 'resources' on Instance uuid a470ac6a-b748-4142-84fe-ea073cf9f4a7 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1594170511',display_name='tempest-TestVolumeBootPattern-server-1594170511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1594170511',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRxkQgla9cymo6EFmZDbQk1Vd9PsMUw375tHpE3C+G7XWKJ2wNxA3Wp7pGzZ5jGLrv690Dj/yrsqixKPzVZE/Db7oYR6ptdQgKfU5EdVib0jmGNDhSHb8FtGbnW3QaTgA==',key_name='tempest-TestVolumeBootPattern-410715465',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:50:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84f02ddcfa2b4571a4d7cacf1287aebd',ramdisk_id='',reservation_id='r-gb04t0mq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-631676638',owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:50:45Z,user_data=None,user_id='878038feacda4094b5d2c9e3814c8bf0',uuid=a470ac6a-b748-4142-84fe-ea073cf9f4a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9176c10-fdb2-40ee-9286-6b514d803b63", "address": "fa:16:3e:de:4d:22", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9176c10-fd", "ovs_interfaceid": "e9176c10-fdb2-40ee-9286-6b514d803b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converting VIF {"id": "e9176c10-fdb2-40ee-9286-6b514d803b63", "address": "fa:16:3e:de:4d:22", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9176c10-fd", "ovs_interfaceid": "e9176c10-fdb2-40ee-9286-6b514d803b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:4d:22,bridge_name='br-int',has_traffic_filtering=True,id=e9176c10-fdb2-40ee-9286-6b514d803b63,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9176c10-fd') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_vif [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:4d:22,bridge_name='br-int',has_traffic_filtering=True,id=e9176c10-fdb2-40ee-9286-6b514d803b63,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9176c10-fd') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9176c10-fd, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:52:22 user nova-compute[72820]: INFO os_vif [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:4d:22,bridge_name='br-int',has_traffic_filtering=True,id=e9176c10-fdb2-40ee-9286-6b514d803b63,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9176c10-fd')
Aug 27 02:52:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBqbKCzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:52:22 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1651d4-8628-423e-8a61-a9d76a7aa412]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:52:22 user nova-compute[72820]: No targets found.
Aug 27 02:52:22 user nova-compute[72820]: iSNS:
Aug 27 02:52:22 user nova-compute[72820]: No targets found.
Aug 27 02:52:22 user nova-compute[72820]: STATIC:
Aug 27 02:52:22 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32
Aug 27 02:52:22 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:52:22 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:52:22 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac
Aug 27 02:52:22 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:52:22 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:52:22 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4
Aug 27 02:52:22 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:52:22 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:52:22 user nova-compute[72820]: FIRMWARE:
Aug 27 02:52:22 user nova-compute[72820]: No targets found.
Aug 27 02:52:22 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:52:22 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:52:22 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[302b1d16-ce4d-4a1c-b965-8111bb453500]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaed64b-c3ec-4a13-a674-07d23bd42546]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)
Aug 27 02:52:22 user nova-compute[72820]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 (non-flash)
Aug 27 02:52:22 user nova-compute[72820]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 (non-flash)
Aug 27 02:52:22 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)
Aug 27 02:52:22 user nova-compute[72820]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 (non-flash)
Aug 27 02:52:22 user nova-compute[72820]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 (non-flash)
Aug 27 02:52:22 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a0536950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32'): ({'sdc'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Removing single pathed devices sdc {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9d58d7-d7bf-4b26-962b-a0a47e4e8c74]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[efadead5-62f7-47c2-8ede-0d65386018a2]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Flushing IO for device /dev/sdc {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3a96d1-69e3-41ad-8d47-e9dd8c5ceaec]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf04de15-0791-4fb6-9f64-bed5737fb4e4]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5fd048a5-6300386ffce74e28', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5fd048a5', '/dev/disk/by-id/scsi-23633303033383666') {{(pid=84057) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[476697e7-b795-44bc-9d17-91ec2a433522]: (4, None) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[401f1bb1-2baf-4ab7-954c-fbcbdbd6241a]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[087259d1-8279-4e35-b7a3-544ce3b3c854]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32, portal: 172.16.0.220,3260]
Aug 27 02:52:22 user nova-compute[72820]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32, portal: 172.16.0.220,3260] successful.
Aug 27 02:52:22 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5bac4-3fa7-4f3f-851e-a58be051cf32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e63df2b-4c79-4554-8b21-96c28425f80c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] <== disconnect_volume: return (313ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:52:22 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Deleting instance files /opt/stack/data/nova/instances/a470ac6a-b748-4142-84fe-ea073cf9f4a7_del
Aug 27 02:52:22 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Deletion of /opt/stack/data/nova/instances/a470ac6a-b748-4142-84fe-ea073cf9f4a7_del complete
Aug 27 02:52:22 user nova-compute[72820]: INFO nova.compute.manager [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-d8105d12-5e5c-4a80-b689-acc9169b0cba req-4e0fe939-0bb3-4bfc-88c1-a13d5754007e service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Received event network-changed-e9176c10-fdb2-40ee-9286-6b514d803b63 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG nova.compute.manager [req-d8105d12-5e5c-4a80-b689-acc9169b0cba req-4e0fe939-0bb3-4bfc-88c1-a13d5754007e service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Refreshing instance network info cache due to event network-changed-e9176c10-fdb2-40ee-9286-6b514d803b63. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d8105d12-5e5c-4a80-b689-acc9169b0cba req-4e0fe939-0bb3-4bfc-88c1-a13d5754007e service nova] Acquiring lock "refresh_cache-a470ac6a-b748-4142-84fe-ea073cf9f4a7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d8105d12-5e5c-4a80-b689-acc9169b0cba req-4e0fe939-0bb3-4bfc-88c1-a13d5754007e service nova] Acquired lock "refresh_cache-a470ac6a-b748-4142-84fe-ea073cf9f4a7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:52:22 user nova-compute[72820]: DEBUG nova.network.neutron [req-d8105d12-5e5c-4a80-b689-acc9169b0cba req-4e0fe939-0bb3-4bfc-88c1-a13d5754007e service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Refreshing network info cache for port e9176c10-fdb2-40ee-9286-6b514d803b63 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:52:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:23 user nova-compute[72820]: DEBUG nova.network.neutron [req-d8105d12-5e5c-4a80-b689-acc9169b0cba req-4e0fe939-0bb3-4bfc-88c1-a13d5754007e service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Updated VIF entry in instance network info cache for port e9176c10-fdb2-40ee-9286-6b514d803b63. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:52:23 user nova-compute[72820]: DEBUG nova.network.neutron [req-d8105d12-5e5c-4a80-b689-acc9169b0cba req-4e0fe939-0bb3-4bfc-88c1-a13d5754007e service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Updating instance_info_cache with network_info: [{"id": "e9176c10-fdb2-40ee-9286-6b514d803b63", "address": "fa:16:3e:de:4d:22", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9176c10-fd", "ovs_interfaceid": "e9176c10-fdb2-40ee-9286-6b514d803b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:52:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d8105d12-5e5c-4a80-b689-acc9169b0cba req-4e0fe939-0bb3-4bfc-88c1-a13d5754007e service nova] Releasing lock "refresh_cache-a470ac6a-b748-4142-84fe-ea073cf9f4a7" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:52:23 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:52:23 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:52:23 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Took 0.55 seconds to deallocate network for instance.
Aug 27 02:52:23 user nova-compute[72820]: DEBUG nova.compute.manager [req-cf7cea53-c208-4e3c-83ec-d3238b6b6409 req-80da5e52-3ce0-488e-9078-981a26649b70 service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Received event network-vif-deleted-e9176c10-fdb2-40ee-9286-6b514d803b63 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:52:23 user nova-compute[72820]: INFO nova.compute.manager [req-cf7cea53-c208-4e3c-83ec-d3238b6b6409 req-80da5e52-3ce0-488e-9078-981a26649b70 service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Neutron deleted interface e9176c10-fdb2-40ee-9286-6b514d803b63; detaching it from the instance and deleting it from the info cache
Aug 27 02:52:23 user nova-compute[72820]: DEBUG nova.network.neutron [req-cf7cea53-c208-4e3c-83ec-d3238b6b6409 req-80da5e52-3ce0-488e-9078-981a26649b70 service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:52:23 user nova-compute[72820]: DEBUG nova.compute.manager [req-cf7cea53-c208-4e3c-83ec-d3238b6b6409 req-80da5e52-3ce0-488e-9078-981a26649b70 service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Detach interface failed, port_id=e9176c10-fdb2-40ee-9286-6b514d803b63, reason: Instance a470ac6a-b748-4142-84fe-ea073cf9f4a7 could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 02:52:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-7eed6293-461b-4282-9c7c-de1a18b27046 req-be86d449-fc67-4fc2-b5eb-e7a7da39cc98 service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Received event network-vif-plugged-e9176c10-fdb2-40ee-9286-6b514d803b63 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:52:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7eed6293-461b-4282-9c7c-de1a18b27046 req-be86d449-fc67-4fc2-b5eb-e7a7da39cc98 service nova] Acquiring lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:52:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7eed6293-461b-4282-9c7c-de1a18b27046 req-be86d449-fc67-4fc2-b5eb-e7a7da39cc98 service nova] Lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:52:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-7eed6293-461b-4282-9c7c-de1a18b27046 req-be86d449-fc67-4fc2-b5eb-e7a7da39cc98 service nova] Lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:52:24 user nova-compute[72820]: DEBUG nova.compute.manager [req-7eed6293-461b-4282-9c7c-de1a18b27046 req-be86d449-fc67-4fc2-b5eb-e7a7da39cc98 service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] No waiting events found dispatching network-vif-plugged-e9176c10-fdb2-40ee-9286-6b514d803b63 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:52:24 user nova-compute[72820]: WARNING nova.compute.manager [req-7eed6293-461b-4282-9c7c-de1a18b27046 req-be86d449-fc67-4fc2-b5eb-e7a7da39cc98 service nova] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Received unexpected event network-vif-plugged-e9176c10-fdb2-40ee-9286-6b514d803b63 for instance with vm_state active and task_state deleting.
Aug 27 02:52:24 user nova-compute[72820]: INFO nova.compute.manager [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Took 0.78 seconds to detach 1 volumes for instance.
Aug 27 02:52:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:52:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:52:24 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:52:24 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:52:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:52:24 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Deleted allocations for instance a470ac6a-b748-4142-84fe-ea073cf9f4a7
Aug 27 02:52:24 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b40303e7-7837-49eb-aca3-b91dd12d0eb1 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "a470ac6a-b748-4142-84fe-ea073cf9f4a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.849s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:52:26 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:52:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:30 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:52:30 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:52:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:52:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:52:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:52:33 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:52:37 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104742.3692923, a470ac6a-b748-4142-84fe-ea073cf9f4a7 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:52:37 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] VM Stopped (Lifecycle Event)
Aug 27 02:52:37 user nova-compute[72820]: DEBUG nova.compute.manager [None req-4324c228-f90c-40a2-a603-ff84b746f998 None None] [instance: a470ac6a-b748-4142-84fe-ea073cf9f4a7] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:52:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:52:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:52:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:52:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:52:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:38 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:52:40 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:52:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:52:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:52:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:52:40 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:52:40 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:52:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:52:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:52:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:52:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:52:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:52:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:52:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:52:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:52:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:52:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:52:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:52:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:52:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:52:41 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:52:41 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:52:41 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8341MB free_disk=25.041244506835938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:52:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:52:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:52:41 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 4480b84a-32b2-4276-ab6d-8c47f4057e55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:52:41 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 5bff5ccf-6365-4086-9307-adb1c488617f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:52:41 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:52:41 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f6349e97-f14d-4104-9959-1193781a2c4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:52:41 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:52:42 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:52:42 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:52:42 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:52:42 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:52:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:52:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:43 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:52:43 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:52:43 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 02:52:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:52:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:52:43 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:52:43 user nova-compute[72820]: DEBUG nova.objects.instance [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lazy-loading 'info_cache' on Instance uuid 4480b84a-32b2-4276-ab6d-8c47f4057e55 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:52:44 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Updating instance_info_cache with network_info: [{"id": "90b1244f-a157-42c2-976d-126d71109e67", "address": "fa:16:3e:4c:2c:25", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b1244f-a1", "ovs_interfaceid": "90b1244f-a157-42c2-976d-126d71109e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:52:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:52:44 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:52:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:52:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:52:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:52:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:52:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:52:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:53:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:53:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:53:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:53:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:53:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:53:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:16 user nova-compute[72820]: DEBUG nova.compute.manager [req-27647ff1-94b2-488e-b9bc-86675a01303e req-01bf99d9-b8e5-4be4-8ff1-63696500d17b service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Received event network-changed-9558ff30-3839-4db9-9ced-1410b2dffc76 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:53:16 user nova-compute[72820]: DEBUG nova.compute.manager [req-27647ff1-94b2-488e-b9bc-86675a01303e req-01bf99d9-b8e5-4be4-8ff1-63696500d17b service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Refreshing instance network info cache due to event network-changed-9558ff30-3839-4db9-9ced-1410b2dffc76. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:53:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-27647ff1-94b2-488e-b9bc-86675a01303e req-01bf99d9-b8e5-4be4-8ff1-63696500d17b service nova] Acquiring lock "refresh_cache-ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:53:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-27647ff1-94b2-488e-b9bc-86675a01303e req-01bf99d9-b8e5-4be4-8ff1-63696500d17b service nova] Acquired lock "refresh_cache-ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:53:16 user nova-compute[72820]: DEBUG nova.network.neutron [req-27647ff1-94b2-488e-b9bc-86675a01303e req-01bf99d9-b8e5-4be4-8ff1-63696500d17b service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Refreshing network info cache for port 9558ff30-3839-4db9-9ced-1410b2dffc76 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:53:16 user nova-compute[72820]: DEBUG nova.network.neutron [req-27647ff1-94b2-488e-b9bc-86675a01303e req-01bf99d9-b8e5-4be4-8ff1-63696500d17b service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Updated VIF entry in instance network info cache for port 9558ff30-3839-4db9-9ced-1410b2dffc76. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:53:16 user nova-compute[72820]: DEBUG nova.network.neutron [req-27647ff1-94b2-488e-b9bc-86675a01303e req-01bf99d9-b8e5-4be4-8ff1-63696500d17b service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Updating instance_info_cache with network_info: [{"id": "9558ff30-3839-4db9-9ced-1410b2dffc76", "address": "fa:16:3e:e5:e3:1b", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9558ff30-38", "ovs_interfaceid": "9558ff30-3839-4db9-9ced-1410b2dffc76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:53:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-27647ff1-94b2-488e-b9bc-86675a01303e req-01bf99d9-b8e5-4be4-8ff1-63696500d17b service nova] Releasing lock "refresh_cache-ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:53:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:53:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:53:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:53:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:53:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:53:17 user nova-compute[72820]: INFO nova.compute.manager [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Terminating instance
Aug 27 02:53:17 user nova-compute[72820]: DEBUG nova.compute.manager [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:53:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:17 user nova-compute[72820]: DEBUG nova.compute.manager [req-d1d6b1b5-5d80-480e-ae6f-8e49f082c1b4 req-455702d5-c083-463e-821d-96c36b3559a0 service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Received event network-vif-unplugged-9558ff30-3839-4db9-9ced-1410b2dffc76 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:53:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d1d6b1b5-5d80-480e-ae6f-8e49f082c1b4 req-455702d5-c083-463e-821d-96c36b3559a0 service nova] Acquiring lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:53:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d1d6b1b5-5d80-480e-ae6f-8e49f082c1b4 req-455702d5-c083-463e-821d-96c36b3559a0 service nova] Lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:53:17 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d1d6b1b5-5d80-480e-ae6f-8e49f082c1b4 req-455702d5-c083-463e-821d-96c36b3559a0 service nova] Lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:53:17 user nova-compute[72820]: DEBUG nova.compute.manager [req-d1d6b1b5-5d80-480e-ae6f-8e49f082c1b4 req-455702d5-c083-463e-821d-96c36b3559a0 service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] No waiting events found dispatching network-vif-unplugged-9558ff30-3839-4db9-9ced-1410b2dffc76 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:53:17 user nova-compute[72820]: DEBUG nova.compute.manager [req-d1d6b1b5-5d80-480e-ae6f-8e49f082c1b4 req-455702d5-c083-463e-821d-96c36b3559a0 service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Received event network-vif-unplugged-9558ff30-3839-4db9-9ced-1410b2dffc76 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:53:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:18 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Instance destroyed successfully.
Aug 27 02:53:18 user nova-compute[72820]: DEBUG nova.objects.instance [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lazy-loading 'resources' on Instance uuid ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:53:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:51:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2144700579',display_name='tempest-AttachVolumeNegativeTest-server-2144700579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2144700579',id=46,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhX7u0BiegyHCZNHwrqw5qGl4vPm4odHv7mztFxyYf3SuWvTYNCzmAB0ROnF4stniGnSQuDXp949SzXv+Om6Ns7dJ6C2GqgcPaex1aBq3F53i9aeIwSP6JiEj4j5IY9rA==',key_name='tempest-keypair-1385607554',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:51:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='117a0b3ffbe84eba93968f924fa7d2e9',ramdisk_id='',reservation_id='r-y5dn06x4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2145874992',owner_user_name='tempest-AttachVolumeNegativeTest-2145874992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:51:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='391718f05f07460f9388d168d1ebdc98',uuid=ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9558ff30-3839-4db9-9ced-1410b2dffc76", "address": "fa:16:3e:e5:e3:1b", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9558ff30-38", "ovs_interfaceid": "9558ff30-3839-4db9-9ced-1410b2dffc76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:53:18 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converting VIF {"id": "9558ff30-3839-4db9-9ced-1410b2dffc76", "address": "fa:16:3e:e5:e3:1b", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9558ff30-38", "ovs_interfaceid": "9558ff30-3839-4db9-9ced-1410b2dffc76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:53:18 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:e3:1b,bridge_name='br-int',has_traffic_filtering=True,id=9558ff30-3839-4db9-9ced-1410b2dffc76,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9558ff30-38') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:53:18 user nova-compute[72820]: DEBUG os_vif [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:e3:1b,bridge_name='br-int',has_traffic_filtering=True,id=9558ff30-3839-4db9-9ced-1410b2dffc76,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9558ff30-38') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:53:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9558ff30-38, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:53:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:53:18 user nova-compute[72820]: INFO os_vif [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:e3:1b,bridge_name='br-int',has_traffic_filtering=True,id=9558ff30-3839-4db9-9ced-1410b2dffc76,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9558ff30-38')
Aug 27 02:53:18 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Deleting instance files /opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d_del
Aug 27 02:53:18 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Deletion of /opt/stack/data/nova/instances/ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d_del complete
Aug 27 02:53:18 user nova-compute[72820]: INFO nova.compute.manager [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Took 0.65 seconds to destroy the instance on the hypervisor.
Aug 27 02:53:18 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:53:18 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:53:18 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:53:19 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:53:19 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Took 0.95 seconds to deallocate network for instance.
Aug 27 02:53:19 user nova-compute[72820]: DEBUG nova.compute.manager [req-8606246a-f3ef-404f-b4be-0b567b6aa10b req-5f5eef81-da14-4bbf-8129-03c152ced720 service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Received event network-vif-deleted-9558ff30-3839-4db9-9ced-1410b2dffc76 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:53:19 user nova-compute[72820]: INFO nova.compute.manager [req-8606246a-f3ef-404f-b4be-0b567b6aa10b req-5f5eef81-da14-4bbf-8129-03c152ced720 service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Neutron deleted interface 9558ff30-3839-4db9-9ced-1410b2dffc76; detaching it from the instance and deleting it from the info cache
Aug 27 02:53:19 user nova-compute[72820]: DEBUG nova.network.neutron [req-8606246a-f3ef-404f-b4be-0b567b6aa10b req-5f5eef81-da14-4bbf-8129-03c152ced720 service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:53:19 user nova-compute[72820]: DEBUG nova.compute.manager [req-8606246a-f3ef-404f-b4be-0b567b6aa10b req-5f5eef81-da14-4bbf-8129-03c152ced720 service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Detach interface failed, port_id=9558ff30-3839-4db9-9ced-1410b2dffc76, reason: Instance ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 02:53:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:53:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:53:19 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:53:19 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:53:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:53:19 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Deleted allocations for instance ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d
Aug 27 02:53:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-446b0783-d4d3-46b5-a294-99bfd9868942 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.995s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:53:19 user nova-compute[72820]: DEBUG nova.compute.manager [req-8afaaaf5-b962-4c71-af73-10f1aaed509c req-c202fb4e-f4c2-45f4-b20b-0dac307927b4 service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Received event network-vif-plugged-9558ff30-3839-4db9-9ced-1410b2dffc76 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:53:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8afaaaf5-b962-4c71-af73-10f1aaed509c req-c202fb4e-f4c2-45f4-b20b-0dac307927b4 service nova] Acquiring lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:53:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8afaaaf5-b962-4c71-af73-10f1aaed509c req-c202fb4e-f4c2-45f4-b20b-0dac307927b4 service nova] Lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:53:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-8afaaaf5-b962-4c71-af73-10f1aaed509c req-c202fb4e-f4c2-45f4-b20b-0dac307927b4 service nova] Lock "ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:53:19 user nova-compute[72820]: DEBUG nova.compute.manager [req-8afaaaf5-b962-4c71-af73-10f1aaed509c req-c202fb4e-f4c2-45f4-b20b-0dac307927b4 service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] No waiting events found dispatching network-vif-plugged-9558ff30-3839-4db9-9ced-1410b2dffc76 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:53:19 user nova-compute[72820]: WARNING nova.compute.manager [req-8afaaaf5-b962-4c71-af73-10f1aaed509c req-c202fb4e-f4c2-45f4-b20b-0dac307927b4 service nova] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Received unexpected event network-vif-plugged-9558ff30-3839-4db9-9ced-1410b2dffc76 for instance with vm_state deleted and task_state None.
Aug 27 02:53:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:23 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:53:25 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:53:26 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:53:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "f6349e97-f14d-4104-9959-1193781a2c4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG nova.objects.instance [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lazy-loading 'flavor' on Instance uuid f6349e97-f14d-4104-9959-1193781a2c4c {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "f6349e97-f14d-4104-9959-1193781a2c4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "f6349e97-f14d-4104-9959-1193781a2c4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:53:31 user nova-compute[72820]: INFO nova.compute.manager [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Attaching volume ca54944b-850a-4206-8b31-373ab69b4780 to /dev/vdb
Aug 27 02:53:31 user nova-compute[72820]: DEBUG os_brick.utils [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd37726a-e8bb-415a-b02d-d43d3b5dcd69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1c4dcf-dbde-4ca3-944a-36b249903381]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e33077-fc67-4713-8332-a6a310e5a1b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0918ffb9-3bfc-4ef3-880c-586f9737b241]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:53:31 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:53:31 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1730b8-de23-4b23-9d0f-c42262023b73]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG os_brick.utils [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:53:31 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updating existing volume attachment record: ae9b1b23-ee8e-482f-8716-d7a0968a8963 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:53:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-452c27bc-ca3d-4a32-a9a4-429ea08090dd req-676b8d90-1171-4936-8bfc-0e33889ec5ac service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Received event network-changed-90b1244f-a157-42c2-976d-126d71109e67 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:53:32 user nova-compute[72820]: DEBUG nova.compute.manager [req-452c27bc-ca3d-4a32-a9a4-429ea08090dd req-676b8d90-1171-4936-8bfc-0e33889ec5ac service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Refreshing instance network info cache due to event network-changed-90b1244f-a157-42c2-976d-126d71109e67. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:53:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-452c27bc-ca3d-4a32-a9a4-429ea08090dd req-676b8d90-1171-4936-8bfc-0e33889ec5ac service nova] Acquiring lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:53:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-452c27bc-ca3d-4a32-a9a4-429ea08090dd req-676b8d90-1171-4936-8bfc-0e33889ec5ac service nova] Acquired lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:53:32 user nova-compute[72820]: DEBUG nova.network.neutron [req-452c27bc-ca3d-4a32-a9a4-429ea08090dd req-676b8d90-1171-4936-8bfc-0e33889ec5ac service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Refreshing network info cache for port 90b1244f-a157-42c2-976d-126d71109e67 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:53:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "4480b84a-32b2-4276-ab6d-8c47f4057e55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:53:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "4480b84a-32b2-4276-ab6d-8c47f4057e55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:53:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "4480b84a-32b2-4276-ab6d-8c47f4057e55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:53:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "4480b84a-32b2-4276-ab6d-8c47f4057e55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:53:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "4480b84a-32b2-4276-ab6d-8c47f4057e55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:53:32 user nova-compute[72820]: INFO nova.compute.manager [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Terminating instance
Aug 27 02:53:32 user nova-compute[72820]: DEBUG nova.compute.manager [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:53:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104798.1419547, ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:53:33 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] VM Stopped (Lifecycle Event)
Aug 27 02:53:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-c65efd59-82e5-4f6e-8947-9b7882c07fb7 None None] [instance: ee87c597-1b9d-4d9a-b8d6-6b4c2878e21d] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG nova.network.neutron [req-452c27bc-ca3d-4a32-a9a4-429ea08090dd req-676b8d90-1171-4936-8bfc-0e33889ec5ac service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Updated VIF entry in instance network info cache for port 90b1244f-a157-42c2-976d-126d71109e67. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG nova.network.neutron [req-452c27bc-ca3d-4a32-a9a4-429ea08090dd req-676b8d90-1171-4936-8bfc-0e33889ec5ac service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Updating instance_info_cache with network_info: [{"id": "90b1244f-a157-42c2-976d-126d71109e67", "address": "fa:16:3e:4c:2c:25", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b1244f-a1", "ovs_interfaceid": "90b1244f-a157-42c2-976d-126d71109e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-452c27bc-ca3d-4a32-a9a4-429ea08090dd req-676b8d90-1171-4936-8bfc-0e33889ec5ac service nova] Releasing lock "refresh_cache-4480b84a-32b2-4276-ab6d-8c47f4057e55" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:53:33 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Instance destroyed successfully.
Aug 27 02:53:33 user nova-compute[72820]: DEBUG nova.objects.instance [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lazy-loading 'resources' on Instance uuid 4480b84a-32b2-4276-ab6d-8c47f4057e55 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-753987207',display_name='tempest-TestVolumeBootPattern-server-753987207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-753987207',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRxkQgla9cymo6EFmZDbQk1Vd9PsMUw375tHpE3C+G7XWKJ2wNxA3Wp7pGzZ5jGLrv690Dj/yrsqixKPzVZE/Db7oYR6ptdQgKfU5EdVib0jmGNDhSHb8FtGbnW3QaTgA==',key_name='tempest-TestVolumeBootPattern-410715465',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:48:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84f02ddcfa2b4571a4d7cacf1287aebd',ramdisk_id='',reservation_id='r-veeocn8e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-631676638',owner_user_name='tempest-TestVolumeBootPattern-631676638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:48:32Z,user_data=None,user_id='878038feacda4094b5d2c9e3814c8bf0',uuid=4480b84a-32b2-4276-ab6d-8c47f4057e55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90b1244f-a157-42c2-976d-126d71109e67", "address": "fa:16:3e:4c:2c:25", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b1244f-a1", "ovs_interfaceid": "90b1244f-a157-42c2-976d-126d71109e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converting VIF {"id": "90b1244f-a157-42c2-976d-126d71109e67", "address": "fa:16:3e:4c:2c:25", "network": {"id": "a51e1ea4-883a-4891-a3cc-e26f22140e6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-314023407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84f02ddcfa2b4571a4d7cacf1287aebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b1244f-a1", "ovs_interfaceid": "90b1244f-a157-42c2-976d-126d71109e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:2c:25,bridge_name='br-int',has_traffic_filtering=True,id=90b1244f-a157-42c2-976d-126d71109e67,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b1244f-a1') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_vif [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:2c:25,bridge_name='br-int',has_traffic_filtering=True,id=90b1244f-a157-42c2-976d-126d71109e67,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b1244f-a1') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90b1244f-a1, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:53:33 user nova-compute[72820]: INFO os_vif [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:2c:25,bridge_name='br-int',has_traffic_filtering=True,id=90b1244f-a157-42c2-976d-126d71109e67,network=Network(a51e1ea4-883a-4891-a3cc-e26f22140e6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b1244f-a1')
Aug 27 02:53:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvBMRPFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:53:33 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e153a4f1-9954-4bfb-af79-272d371b01ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:53:33 user nova-compute[72820]: No targets found.
Aug 27 02:53:33 user nova-compute[72820]: iSNS:
Aug 27 02:53:33 user nova-compute[72820]: No targets found.
Aug 27 02:53:33 user nova-compute[72820]: STATIC:
Aug 27 02:53:33 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac
Aug 27 02:53:33 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:53:33 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:53:33 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4
Aug 27 02:53:33 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:53:33 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:53:33 user nova-compute[72820]: FIRMWARE:
Aug 27 02:53:33 user nova-compute[72820]: No targets found.
Aug 27 02:53:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:53:33 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:53:33 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c647b6d3-4845-425b-a6c6-5c58a601d6ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7550c09-a2ae-4ab6-9be1-b506392fa62b]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)
Aug 27 02:53:33 user nova-compute[72820]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 (non-flash)
Aug 27 02:53:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac (non-flash)
Aug 27 02:53:33 user nova-compute[72820]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 (non-flash)
Aug 27 02:53:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c02ed360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac'): ({'sdb'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Removing single pathed devices sdb {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0965240-0a85-427b-afef-9050839dc488]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7682d0-b5f1-4604-b26a-caa0bf48eaf1]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Flushing IO for device /dev/sdb {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4a1789-4138-45bf-8f26-37c002e3acce]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2756b71f-dc72-4e98-be0c-ed02c4b4a14b]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[af624187-05c9-47b8-93d3-88df16f3c69d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e483a249-a98d-49d8-8988-aa535c8e25e5]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac, portal: 172.16.0.220,3260]
Aug 27 02:53:33 user nova-compute[72820]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac, portal: 172.16.0.220,3260] successful.
Aug 27 02:53:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf4d7e0-e457-4f47-830c-0820098fe4ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f6e292-8408-41e0-bb08-92be67503679]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] <== disconnect_volume: return (330ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:53:33 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Deleting instance files /opt/stack/data/nova/instances/4480b84a-32b2-4276-ab6d-8c47f4057e55_del
Aug 27 02:53:33 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Deletion of /opt/stack/data/nova/instances/4480b84a-32b2-4276-ab6d-8c47f4057e55_del complete
Aug 27 02:53:33 user nova-compute[72820]: INFO nova.compute.manager [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 27 02:53:33 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:53:33 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:53:34 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:53:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-6223ecb7-9b9b-42c7-97b1-d75ed8e28d8c req-6bfce0a2-ce9d-4a56-8660-3e9f9eaeb75d service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Received event network-vif-unplugged-90b1244f-a157-42c2-976d-126d71109e67 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:53:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6223ecb7-9b9b-42c7-97b1-d75ed8e28d8c req-6bfce0a2-ce9d-4a56-8660-3e9f9eaeb75d service nova] Acquiring lock "4480b84a-32b2-4276-ab6d-8c47f4057e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:53:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6223ecb7-9b9b-42c7-97b1-d75ed8e28d8c req-6bfce0a2-ce9d-4a56-8660-3e9f9eaeb75d service nova] Lock "4480b84a-32b2-4276-ab6d-8c47f4057e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:53:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6223ecb7-9b9b-42c7-97b1-d75ed8e28d8c req-6bfce0a2-ce9d-4a56-8660-3e9f9eaeb75d service nova] Lock "4480b84a-32b2-4276-ab6d-8c47f4057e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:53:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-6223ecb7-9b9b-42c7-97b1-d75ed8e28d8c req-6bfce0a2-ce9d-4a56-8660-3e9f9eaeb75d service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] No waiting events found dispatching network-vif-unplugged-90b1244f-a157-42c2-976d-126d71109e67 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:53:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-6223ecb7-9b9b-42c7-97b1-d75ed8e28d8c req-6bfce0a2-ce9d-4a56-8660-3e9f9eaeb75d service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Received event network-vif-unplugged-90b1244f-a157-42c2-976d-126d71109e67 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:53:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-6223ecb7-9b9b-42c7-97b1-d75ed8e28d8c req-6bfce0a2-ce9d-4a56-8660-3e9f9eaeb75d service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Received event network-vif-plugged-90b1244f-a157-42c2-976d-126d71109e67 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:53:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6223ecb7-9b9b-42c7-97b1-d75ed8e28d8c req-6bfce0a2-ce9d-4a56-8660-3e9f9eaeb75d service nova] Acquiring lock "4480b84a-32b2-4276-ab6d-8c47f4057e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:53:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6223ecb7-9b9b-42c7-97b1-d75ed8e28d8c req-6bfce0a2-ce9d-4a56-8660-3e9f9eaeb75d service nova] Lock "4480b84a-32b2-4276-ab6d-8c47f4057e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:53:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6223ecb7-9b9b-42c7-97b1-d75ed8e28d8c req-6bfce0a2-ce9d-4a56-8660-3e9f9eaeb75d service nova] Lock "4480b84a-32b2-4276-ab6d-8c47f4057e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:53:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-6223ecb7-9b9b-42c7-97b1-d75ed8e28d8c req-6bfce0a2-ce9d-4a56-8660-3e9f9eaeb75d service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] No waiting events found dispatching network-vif-plugged-90b1244f-a157-42c2-976d-126d71109e67 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:53:34 user nova-compute[72820]: WARNING nova.compute.manager [req-6223ecb7-9b9b-42c7-97b1-d75ed8e28d8c req-6bfce0a2-ce9d-4a56-8660-3e9f9eaeb75d service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Received unexpected event network-vif-plugged-90b1244f-a157-42c2-976d-126d71109e67 for instance with vm_state active and task_state deleting.
Aug 27 02:53:34 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Took 0.82 seconds to deallocate network for instance.
Aug 27 02:53:34 user nova-compute[72820]: DEBUG nova.compute.manager [req-b47fd9b2-0b9e-4ced-8bc7-7d9eed9e5367 req-12026148-a457-4579-8353-cb32ea387362 service nova] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Received event network-vif-deleted-90b1244f-a157-42c2-976d-126d71109e67 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:53:35 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:53:35 user nova-compute[72820]: INFO nova.compute.manager [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Took 0.80 seconds to detach 1 volumes for instance.
Aug 27 02:53:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:53:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:53:35 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:53:35 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:53:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:53:35 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Deleted allocations for instance 4480b84a-32b2-4276-ab6d-8c47f4057e55
Aug 27 02:53:35 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afa264ea-f5d8-4aaa-a2cd-f212d9ab4507 tempest-TestVolumeBootPattern-631676638 tempest-TestVolumeBootPattern-631676638-project-member] Lock "4480b84a-32b2-4276-ab6d-8c47f4057e55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.175s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:53:38 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:53:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:40 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:53:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:53:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:53:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:53:40 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:53:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:40 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:41 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:41 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:53:41 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:53:41 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:53:41 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8615MB free_disk=25.067729949951172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:53:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:53:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:53:41 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 5bff5ccf-6365-4086-9307-adb1c488617f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:53:41 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f6349e97-f14d-4104-9959-1193781a2c4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:53:41 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:53:41 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:53:41 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:53:41 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:53:41 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:53:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkJWquTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:53:42 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:53:42 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:53:42 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19767df-00ac-4bfc-afe0-8a90300afed8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:53:42 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76a9aba-6301-43e3-9a9f-3fe18fc8b744]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780] added
Aug 27 02:53:42 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0245033-5e63-425e-876f-b5413e78c776]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cead5f-1896-4911-baa3-09b2abcccdc3]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QkJWquTg {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QkJWquTg" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[67039f22-5043-4786-aaec-30211e42d033]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QkJWquTg'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e870e9-193f-41c6-960d-3a68883bfedf]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f2be39-11cd-4587-bb41-4a5a203ffd6b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 (non-flash)
Aug 27 02:53:42 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 (non-flash)
Aug 27 02:53:42 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5673e41-c15f-49ba-8612-29236bccc174]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780, portal: 172.16.0.220,3260]
Aug 27 02:53:42 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780, portal: 172.16.0.220,3260] successful.
Aug 27 02:53:42 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e0f4fc-0e79-4ca3-83c3-b19957171b23]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c05e576-41da-4903-8f44-c2b35e65073e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 (non-flash)
Aug 27 02:53:42 user nova-compute[72820]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 (non-flash)
Aug 27 02:53:42 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 (non-flash)
Aug 27 02:53:42 user nova-compute[72820]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 (non-flash)
Aug 27 02:53:42 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2a1c89-a29e-4f64-a5c7-d11b7fdc62d1]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:53:42 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:53:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:53:43 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:53:43 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:53:43 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:53:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkJWquTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:53:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:53:43 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26630646661646364', 'path': '/dev/sdb'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:53:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630646661646364', 'path': '/dev/sdb'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:53:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-5bff5ccf-6365-4086-9307-adb1c488617f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:53:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-5bff5ccf-6365-4086-9307-adb1c488617f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:53:43 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:53:43 user nova-compute[72820]: DEBUG nova.objects.instance [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lazy-loading 'flavor' on Instance uuid f6349e97-f14d-4104-9959-1193781a2c4c {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:53:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:53:43 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:53:43 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:53:43 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:53:43 user nova-compute[72820]:   <serial>ca54944b-850a-4206-8b31-373ab69b4780</serial>
Aug 27 02:53:43 user nova-compute[72820]: </disk>
Aug 27 02:53:43 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:53:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:53:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:53:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] No VIF found with MAC fa:16:3e:d3:84:d7, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:53:44 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Updating instance_info_cache with network_info: [{"id": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "address": "fa:16:3e:4d:50:a9", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe642e-4c", "ovs_interfaceid": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:53:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-5bff5ccf-6365-4086-9307-adb1c488617f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:53:44 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:53:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e780d81a-4398-4dcf-9ef3-c52171f79325 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "f6349e97-f14d-4104-9959-1193781a2c4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.790s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:53:48 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104813.4706674, 4480b84a-32b2-4276-ab6d-8c47f4057e55 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:53:48 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] VM Stopped (Lifecycle Event)
Aug 27 02:53:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-3eeff294-d16e-4b8f-95dd-526b28f144fd None None] [instance: 4480b84a-32b2-4276-ab6d-8c47f4057e55] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:53:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:53:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:53:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:53:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:53:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:53:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-393b98cf-6cc9-402b-98fd-785a27d725ca req-f90ceecc-6036-4c88-a53a-696451311e8f service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-changed-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:53:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-393b98cf-6cc9-402b-98fd-785a27d725ca req-f90ceecc-6036-4c88-a53a-696451311e8f service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Refreshing instance network info cache due to event network-changed-b17ed63b-2125-4530-a7e3-e715affe9d50. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:53:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-393b98cf-6cc9-402b-98fd-785a27d725ca req-f90ceecc-6036-4c88-a53a-696451311e8f service nova] Acquiring lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:53:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-393b98cf-6cc9-402b-98fd-785a27d725ca req-f90ceecc-6036-4c88-a53a-696451311e8f service nova] Acquired lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:53:57 user nova-compute[72820]: DEBUG nova.network.neutron [req-393b98cf-6cc9-402b-98fd-785a27d725ca req-f90ceecc-6036-4c88-a53a-696451311e8f service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Refreshing network info cache for port b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:53:58 user nova-compute[72820]: DEBUG nova.network.neutron [req-393b98cf-6cc9-402b-98fd-785a27d725ca req-f90ceecc-6036-4c88-a53a-696451311e8f service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updated VIF entry in instance network info cache for port b17ed63b-2125-4530-a7e3-e715affe9d50. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:53:58 user nova-compute[72820]: DEBUG nova.network.neutron [req-393b98cf-6cc9-402b-98fd-785a27d725ca req-f90ceecc-6036-4c88-a53a-696451311e8f service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updating instance_info_cache with network_info: [{"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:53:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:53:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-393b98cf-6cc9-402b-98fd-785a27d725ca req-f90ceecc-6036-4c88-a53a-696451311e8f service nova] Releasing lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:53:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-219b8ede-5f3e-43ce-a1e2-1332492dd078 req-cdd2ce50-58b2-47da-b675-b08d1d4f45df service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-changed-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:53:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-219b8ede-5f3e-43ce-a1e2-1332492dd078 req-cdd2ce50-58b2-47da-b675-b08d1d4f45df service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Refreshing instance network info cache due to event network-changed-b17ed63b-2125-4530-a7e3-e715affe9d50. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:53:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-219b8ede-5f3e-43ce-a1e2-1332492dd078 req-cdd2ce50-58b2-47da-b675-b08d1d4f45df service nova] Acquiring lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:53:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-219b8ede-5f3e-43ce-a1e2-1332492dd078 req-cdd2ce50-58b2-47da-b675-b08d1d4f45df service nova] Acquired lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:53:59 user nova-compute[72820]: DEBUG nova.network.neutron [req-219b8ede-5f3e-43ce-a1e2-1332492dd078 req-cdd2ce50-58b2-47da-b675-b08d1d4f45df service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Refreshing network info cache for port b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:54:00 user nova-compute[72820]: DEBUG nova.network.neutron [req-219b8ede-5f3e-43ce-a1e2-1332492dd078 req-cdd2ce50-58b2-47da-b675-b08d1d4f45df service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updated VIF entry in instance network info cache for port b17ed63b-2125-4530-a7e3-e715affe9d50. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:54:00 user nova-compute[72820]: DEBUG nova.network.neutron [req-219b8ede-5f3e-43ce-a1e2-1332492dd078 req-cdd2ce50-58b2-47da-b675-b08d1d4f45df service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updating instance_info_cache with network_info: [{"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:54:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-219b8ede-5f3e-43ce-a1e2-1332492dd078 req-cdd2ce50-58b2-47da-b675-b08d1d4f45df service nova] Releasing lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:54:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "5bff5ccf-6365-4086-9307-adb1c488617f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:54:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "5bff5ccf-6365-4086-9307-adb1c488617f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:54:08 user nova-compute[72820]: INFO nova.compute.manager [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Detaching volume 4dbac620-7b96-490d-a1eb-a3cf1727e5f4
Aug 27 02:54:09 user nova-compute[72820]: INFO nova.virt.block_device [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Attempting to driver detach volume 4dbac620-7b96-490d-a1eb-a3cf1727e5f4 from mountpoint /dev/vdb
Aug 27 02:54:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Attempting to detach device vdb from instance 5bff5ccf-6365-4086-9307-adb1c488617f from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:54:09 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:54:09 user nova-compute[72820]:   <source dev="/dev/sdd"/>
Aug 27 02:54:09 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:54:09 user nova-compute[72820]:   <serial>4dbac620-7b96-490d-a1eb-a3cf1727e5f4</serial>
Aug 27 02:54:09 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:54:09 user nova-compute[72820]: </disk>
Aug 27 02:54:09 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:54:09 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Successfully detached device vdb from instance 5bff5ccf-6365-4086-9307-adb1c488617f from the persistent domain config.
Aug 27 02:54:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5bff5ccf-6365-4086-9307-adb1c488617f from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:54:09 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:54:09 user nova-compute[72820]:   <source dev="/dev/sdd"/>
Aug 27 02:54:09 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:54:09 user nova-compute[72820]:   <serial>4dbac620-7b96-490d-a1eb-a3cf1727e5f4</serial>
Aug 27 02:54:09 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:54:09 user nova-compute[72820]: </disk>
Aug 27 02:54:09 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693104849.4858856, 5bff5ccf-6365-4086-9307-adb1c488617f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5bff5ccf-6365-4086-9307-adb1c488617f {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:54:09 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Successfully detached device vdb from instance 5bff5ccf-6365-4086-9307-adb1c488617f from the live domain config.
Aug 27 02:54:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWBFAvCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:54:09 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b0d3a0-20e1-4a06-99e6-cd89dc94d743]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:54:09 user nova-compute[72820]: No targets found.
Aug 27 02:54:09 user nova-compute[72820]: iSNS:
Aug 27 02:54:09 user nova-compute[72820]: No targets found.
Aug 27 02:54:09 user nova-compute[72820]: STATIC:
Aug 27 02:54:09 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780
Aug 27 02:54:09 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:54:09 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:54:09 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4
Aug 27 02:54:09 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:54:09 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:54:09 user nova-compute[72820]: FIRMWARE:
Aug 27 02:54:09 user nova-compute[72820]: No targets found.
Aug 27 02:54:09 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:54:09 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:54:09 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e374965e-0fef-40a8-812f-1d7720b25b53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1fb00c-8c3c-40ac-9313-605cf1cf5e26]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 (non-flash)
Aug 27 02:54:09 user nova-compute[72820]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 (non-flash)
Aug 27 02:54:09 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 (non-flash)
Aug 27 02:54:09 user nova-compute[72820]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 (non-flash)
Aug 27 02:54:09 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c02db7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4'): ({'sdd'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Removing single pathed devices sdd {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0dde13-dfec-420f-a939-5ef2323fe307]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50c9ea3-4be9-4db3-8c7c-f847f2de3413]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Flushing IO for device /dev/sdd {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe9bcff-4d2c-4f96-8e51-92135a4ea498]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9881adf-ffa9-42fb-8ad6-a784e1c76115]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] SCSI volumes sdd have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce0e509-26a1-43fa-9d9e-83cb059e6d21]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b464456-fcd0-4468-89d5-56f560afd089]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4, portal: 172.16.0.220,3260]
Aug 27 02:54:09 user nova-compute[72820]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4, portal: 172.16.0.220,3260] successful.
Aug 27 02:54:09 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbac620-7b96-490d-a1eb-a3cf1727e5f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf3f9a7-2ef0-4120-a888-81a5868d06a8]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] <== disconnect_volume: return (295ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:54:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:54:10 user nova-compute[72820]: DEBUG nova.objects.instance [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lazy-loading 'flavor' on Instance uuid 5bff5ccf-6365-4086-9307-adb1c488617f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:54:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-5d17b1af-9901-4b17-a27b-18142f389367 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "5bff5ccf-6365-4086-9307-adb1c488617f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.661s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:54:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:54:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "f6349e97-f14d-4104-9959-1193781a2c4c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:54:11 user nova-compute[72820]: INFO nova.compute.manager [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Rebooting instance
Aug 27 02:54:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:54:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquired lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:54:11 user nova-compute[72820]: DEBUG nova.network.neutron [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:54:11 user nova-compute[72820]: DEBUG nova.network.neutron [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updating instance_info_cache with network_info: [{"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:54:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Releasing lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:54:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:54:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.compute.manager [req-d147d13d-b42a-4e1f-9671-8d5a46cdd14f req-4d3201c7-cfe1-4297-8616-f4036a2c7d8d service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-vif-unplugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d147d13d-b42a-4e1f-9671-8d5a46cdd14f req-4d3201c7-cfe1-4297-8616-f4036a2c7d8d service nova] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d147d13d-b42a-4e1f-9671-8d5a46cdd14f req-4d3201c7-cfe1-4297-8616-f4036a2c7d8d service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d147d13d-b42a-4e1f-9671-8d5a46cdd14f req-4d3201c7-cfe1-4297-8616-f4036a2c7d8d service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.compute.manager [req-d147d13d-b42a-4e1f-9671-8d5a46cdd14f req-4d3201c7-cfe1-4297-8616-f4036a2c7d8d service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] No waiting events found dispatching network-vif-unplugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:54:12 user nova-compute[72820]: WARNING nova.compute.manager [req-d147d13d-b42a-4e1f-9671-8d5a46cdd14f req-4d3201c7-cfe1-4297-8616-f4036a2c7d8d service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received unexpected event network-vif-unplugged-b17ed63b-2125-4530-a7e3-e715affe9d50 for instance with vm_state active and task_state reboot_started_hard.
Aug 27 02:54:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:12 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Instance destroyed successfully.
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.objects.instance [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lazy-loading 'resources' on Instance uuid f6349e97-f14d-4104-9959-1193781a2c4c {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:51:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2074165623',display_name='tempest-TestMinimumBasicScenario-server-2074165623',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2074165623',id=47,image_ref='f9f62467-2436-4491-9ef0-eb671acdf108',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcX2jA7sDNPWUQhjs1FiyFD7h6MX0eLaDB9NFR3NOAlF+VbO89wFOHA4K1huE1Hf1P/pKJKuIAlKoEIkWrI9gLcvVOOBWxzx/5z1ZwxvOP9NtZa00eV9AfXmisNGspKWg==',key_name='tempest-TestMinimumBasicScenario-815937332',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:51:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54352cfd7c104bd9acb2d479ccefc214',ramdisk_id='',reservation_id='r-c1uyhvmg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f9f62467-2436-4491-9ef0-eb671acdf108',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-181769521',owner_user_name='tempest-TestMinimumBasicScenario-181769521-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:54:12Z,user_data=None,user_id='a767e402c070429caad7dd8a4cedf72d',uuid=f6349e97-f14d-4104-9959-1193781a2c4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Converting VIF {"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=b17ed63b-2125-4530-a7e3-e715affe9d50,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb17ed63b-21') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_vif [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=b17ed63b-2125-4530-a7e3-e715affe9d50,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb17ed63b-21') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb17ed63b-21, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:12 user nova-compute[72820]: INFO os_vif [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=b17ed63b-2125-4530-a7e3-e715affe9d50,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb17ed63b-21')
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkJWquTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:54:12 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5642a54-522b-4332-ba27-fb6ff9603e4e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:54:12 user nova-compute[72820]: No targets found.
Aug 27 02:54:12 user nova-compute[72820]: iSNS:
Aug 27 02:54:12 user nova-compute[72820]: No targets found.
Aug 27 02:54:12 user nova-compute[72820]: STATIC:
Aug 27 02:54:12 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780
Aug 27 02:54:12 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:54:12 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:54:12 user nova-compute[72820]: FIRMWARE:
Aug 27 02:54:12 user nova-compute[72820]: No targets found.
Aug 27 02:54:12 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:54:12 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:54:12 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7da9e0-9188-4e76-95c5-f7649e1c0def]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cad4992-018f-4263-a7ed-56ba286ad40c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 (non-flash)
Aug 27 02:54:12 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 (non-flash)
Aug 27 02:54:12 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a0423490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780'): ({'sdb'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Removing single pathed devices sdb {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8921eb43-4c10-47fc-8644-aba9228f859f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2486fd31-c6af-46a0-b1b2-fb0e19ae037a]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Flushing IO for device /dev/sdb {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d1109e-d623-4b2b-bd46-1a15faf701e8]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a776053b-2c87-4adf-aa29-12a28b84843c]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f734ae9-5775-410f-8ce7-02718c33c3af]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd5052d-1047-4bab-b19f-2eb970ea2a9e]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780, portal: 172.16.0.220,3260]
Aug 27 02:54:12 user nova-compute[72820]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780, portal: 172.16.0.220,3260] successful.
Aug 27 02:54:12 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e442a8aa-1534-43f3-8e33-c3dd2fbb5a3d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] <== disconnect_volume: return (297ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Start _get_guest_xml network_info=[{"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f9f62467-2436-4491-9ef0-eb671acdf108,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': 'f9f62467-2436-4491-9ef0-eb671acdf108'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ae9b1b23-ee8e-482f-8716-d7a0968a8963', 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkJWquTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f6349e97-f14d-4104-9959-1193781a2c4c', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca54944b-850a-4206-8b31-373ab69b4780', 'serial': 'ca54944b-850a-4206-8b31-373ab69b4780'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:54:12 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:54:12 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f9f62467-2436-4491-9ef0-eb671acdf108,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.objects.instance [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lazy-loading 'vcpu_model' on Instance uuid f6349e97-f14d-4104-9959-1193781a2c4c {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.objects.base [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Object Instance<f6349e97-f14d-4104-9959-1193781a2c4c> lazy-loaded attributes: resources,vcpu_model {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkJWquTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:54:12 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:54:12 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:54:12 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3055df75-d580-4e3a-92d1-de45dd941064]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:54:12 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7809af89-23a8-43fa-9222-72b6ed488fa9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780] added
Aug 27 02:54:12 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:54:12 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[09985504-d397-4485-b9eb-271d54747f33]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76fc985-2659-4d7b-9260-dbddcaaa4473]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QkJWquTg {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QkJWquTg" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b963c4f-14a7-4b0f-be64-ef90bf496191]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QkJWquTg'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33ad146-c463-4d3a-880e-205326e771b4]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9a231e-5374-4a55-9c73-082353ccaf5e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 02:54:13 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 02:54:13 user nova-compute[72820]:  {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:54:13 user nova-compute[72820]: WARNING os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 02:54:13 user nova-compute[72820]: 
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd8c4b4-3bea-41a0-91ca-e83bfa1e8925]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780, portal: 172.16.0.220,3260]
Aug 27 02:54:13 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780, portal: 172.16.0.220,3260] successful.
Aug 27 02:54:13 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1740ebd6-bb14-4601-ac98-0ca782bdf99a]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0042e3a2-3368-4326-a184-9aac43a6a36c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 (non-flash)
Aug 27 02:54:13 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 (non-flash)
Aug 27 02:54:13 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[247137e2-19cf-40b6-a374-5cca22547a1e]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:54:13 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkJWquTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] No waiting events found dispatching network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:54:14 user nova-compute[72820]: WARNING nova.compute.manager [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received unexpected event network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 for instance with vm_state active and task_state reboot_started_hard.
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] No waiting events found dispatching network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:54:14 user nova-compute[72820]: WARNING nova.compute.manager [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received unexpected event network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 for instance with vm_state active and task_state reboot_started_hard.
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] No waiting events found dispatching network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:54:14 user nova-compute[72820]: WARNING nova.compute.manager [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received unexpected event network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 for instance with vm_state active and task_state reboot_started_hard.
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-vif-unplugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] No waiting events found dispatching network-vif-unplugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:54:14 user nova-compute[72820]: WARNING nova.compute.manager [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received unexpected event network-vif-unplugged-b17ed63b-2125-4530-a7e3-e715affe9d50 for instance with vm_state active and task_state reboot_started_hard.
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] No waiting events found dispatching network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:54:14 user nova-compute[72820]: WARNING nova.compute.manager [req-5b019dea-d104-41a5-80c5-a8ed697bce44 req-41cb540e-e408-487f-9b86-09fcb47ff681 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received unexpected event network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 for instance with vm_state active and task_state reboot_started_hard.
Aug 27 02:54:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26630646661646364', 'path': '/dev/sdb'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630646661646364', 'path': '/dev/sdb'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:51:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2074165623',display_name='tempest-TestMinimumBasicScenario-server-2074165623',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2074165623',id=47,image_ref='f9f62467-2436-4491-9ef0-eb671acdf108',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcX2jA7sDNPWUQhjs1FiyFD7h6MX0eLaDB9NFR3NOAlF+VbO89wFOHA4K1huE1Hf1P/pKJKuIAlKoEIkWrI9gLcvVOOBWxzx/5z1ZwxvOP9NtZa00eV9AfXmisNGspKWg==',key_name='tempest-TestMinimumBasicScenario-815937332',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:51:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54352cfd7c104bd9acb2d479ccefc214',ramdisk_id='',reservation_id='r-c1uyhvmg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f9f62467-2436-4491-9ef0-eb671acdf108',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-181769521',owner_user_name='tempest-TestMinimumBasicScenario-181769521-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:54:12Z,user_data=None,user_id='a767e402c070429caad7dd8a4cedf72d',uuid=f6349e97-f14d-4104-9959-1193781a2c4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Converting VIF {"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=b17ed63b-2125-4530-a7e3-e715affe9d50,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb17ed63b-21') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.objects.instance [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lazy-loading 'pci_devices' on Instance uuid f6349e97-f14d-4104-9959-1193781a2c4c {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.objects.base [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Object Instance<f6349e97-f14d-4104-9959-1193781a2c4c> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:54:14 user nova-compute[72820]:   <uuid>f6349e97-f14d-4104-9959-1193781a2c4c</uuid>
Aug 27 02:54:14 user nova-compute[72820]:   <name>instance-0000002f</name>
Aug 27 02:54:14 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:54:14 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:54:14 user nova-compute[72820]:   <metadata>
Aug 27 02:54:14 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:54:14 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:54:14 user nova-compute[72820]:       <nova:name>tempest-TestMinimumBasicScenario-server-2074165623</nova:name>
Aug 27 02:54:14 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:54:12</nova:creationTime>
Aug 27 02:54:14 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:54:14 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:54:14 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:54:14 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:54:14 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:54:14 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:54:14 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:54:14 user nova-compute[72820]:       <nova:owner>
Aug 27 02:54:14 user nova-compute[72820]:         <nova:user uuid="a767e402c070429caad7dd8a4cedf72d">tempest-TestMinimumBasicScenario-181769521-project-member</nova:user>
Aug 27 02:54:14 user nova-compute[72820]:         <nova:project uuid="54352cfd7c104bd9acb2d479ccefc214">tempest-TestMinimumBasicScenario-181769521</nova:project>
Aug 27 02:54:14 user nova-compute[72820]:       </nova:owner>
Aug 27 02:54:14 user nova-compute[72820]:       <nova:root type="image" uuid="f9f62467-2436-4491-9ef0-eb671acdf108"/>
Aug 27 02:54:14 user nova-compute[72820]:       <nova:ports>
Aug 27 02:54:14 user nova-compute[72820]:         <nova:port uuid="b17ed63b-2125-4530-a7e3-e715affe9d50">
Aug 27 02:54:14 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 02:54:14 user nova-compute[72820]:         </nova:port>
Aug 27 02:54:14 user nova-compute[72820]:       </nova:ports>
Aug 27 02:54:14 user nova-compute[72820]:     </nova:instance>
Aug 27 02:54:14 user nova-compute[72820]:   </metadata>
Aug 27 02:54:14 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:54:14 user nova-compute[72820]:     <system>
Aug 27 02:54:14 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:54:14 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:54:14 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:54:14 user nova-compute[72820]:       <entry name="serial">f6349e97-f14d-4104-9959-1193781a2c4c</entry>
Aug 27 02:54:14 user nova-compute[72820]:       <entry name="uuid">f6349e97-f14d-4104-9959-1193781a2c4c</entry>
Aug 27 02:54:14 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:54:14 user nova-compute[72820]:     </system>
Aug 27 02:54:14 user nova-compute[72820]:   </sysinfo>
Aug 27 02:54:14 user nova-compute[72820]:   <os>
Aug 27 02:54:14 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:54:14 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:54:14 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:54:14 user nova-compute[72820]:   </os>
Aug 27 02:54:14 user nova-compute[72820]:   <features>
Aug 27 02:54:14 user nova-compute[72820]:     <acpi/>
Aug 27 02:54:14 user nova-compute[72820]:     <apic/>
Aug 27 02:54:14 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:54:14 user nova-compute[72820]:   </features>
Aug 27 02:54:14 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:54:14 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:54:14 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:54:14 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:54:14 user nova-compute[72820]:   </clock>
Aug 27 02:54:14 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:54:14 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:54:14 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:54:14 user nova-compute[72820]:   </cpu>
Aug 27 02:54:14 user nova-compute[72820]:   <devices>
Aug 27 02:54:14 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:54:14 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:54:14 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk"/>
Aug 27 02:54:14 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:54:14 user nova-compute[72820]:     </disk>
Aug 27 02:54:14 user nova-compute[72820]:     <disk type="block" device="disk">
Aug 27 02:54:14 user nova-compute[72820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:54:14 user nova-compute[72820]:       <source dev="/dev/sdb"/>
Aug 27 02:54:14 user nova-compute[72820]:       <target dev="vdb" bus="virtio"/>
Aug 27 02:54:14 user nova-compute[72820]:       <serial>ca54944b-850a-4206-8b31-373ab69b4780</serial>
Aug 27 02:54:14 user nova-compute[72820]:     </disk>
Aug 27 02:54:14 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:54:14 user nova-compute[72820]:       <mac address="fa:16:3e:d3:84:d7"/>
Aug 27 02:54:14 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:54:14 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:54:14 user nova-compute[72820]:       <target dev="tapb17ed63b-21"/>
Aug 27 02:54:14 user nova-compute[72820]:     </interface>
Aug 27 02:54:14 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:54:14 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/console.log" append="off"/>
Aug 27 02:54:14 user nova-compute[72820]:     </serial>
Aug 27 02:54:14 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:54:14 user nova-compute[72820]:     <video>
Aug 27 02:54:14 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:54:14 user nova-compute[72820]:     </video>
Aug 27 02:54:14 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:54:14 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:54:14 user nova-compute[72820]:     </rng>
Aug 27 02:54:14 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:54:14 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:54:14 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:54:14 user nova-compute[72820]:     </memballoon>
Aug 27 02:54:14 user nova-compute[72820]:   </devices>
Aug 27 02:54:14 user nova-compute[72820]: </domain>
Aug 27 02:54:14 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.objects.instance [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lazy-loading 'trusted_certs' on Instance uuid f6349e97-f14d-4104-9959-1193781a2c4c {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.objects.base [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Object Instance<f6349e97-f14d-4104-9959-1193781a2c4c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a --force-share --output=json" returned: 0 in 0.172s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:54:14 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:15 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:15 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Cannot resize image /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:54:15 user nova-compute[72820]: DEBUG nova.objects.instance [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lazy-loading 'migration_context' on Instance uuid f6349e97-f14d-4104-9959-1193781a2c4c {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:54:15 user nova-compute[72820]: DEBUG nova.objects.base [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Object Instance<f6349e97-f14d-4104-9959-1193781a2c4c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=72820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 02:54:15 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:51:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2074165623',display_name='tempest-TestMinimumBasicScenario-server-2074165623',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2074165623',id=47,image_ref='f9f62467-2436-4491-9ef0-eb671acdf108',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcX2jA7sDNPWUQhjs1FiyFD7h6MX0eLaDB9NFR3NOAlF+VbO89wFOHA4K1huE1Hf1P/pKJKuIAlKoEIkWrI9gLcvVOOBWxzx/5z1ZwxvOP9NtZa00eV9AfXmisNGspKWg==',key_name='tempest-TestMinimumBasicScenario-815937332',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:51:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='54352cfd7c104bd9acb2d479ccefc214',ramdisk_id='',reservation_id='r-c1uyhvmg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f9f62467-2436-4491-9ef0-eb671acdf108',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-181769521',owner_user_name='tempest-TestMinimumBasicScenario-181769521-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:54:12Z,user_data=None,user_id='a767e402c070429caad7dd8a4cedf72d',uuid=f6349e97-f14d-4104-9959-1193781a2c4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:54:15 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Converting VIF {"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:54:15 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=b17ed63b-2125-4530-a7e3-e715affe9d50,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb17ed63b-21') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:54:15 user nova-compute[72820]: DEBUG os_vif [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=b17ed63b-2125-4530-a7e3-e715affe9d50,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb17ed63b-21') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:54:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:54:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:54:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb17ed63b-21, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:54:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb17ed63b-21, col_values=(('external_ids', {'iface-id': 'b17ed63b-2125-4530-a7e3-e715affe9d50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:84:d7', 'vm-uuid': 'f6349e97-f14d-4104-9959-1193781a2c4c'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:54:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:54:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:15 user nova-compute[72820]: INFO os_vif [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=b17ed63b-2125-4530-a7e3-e715affe9d50,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb17ed63b-21')
Aug 27 02:54:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:16 user nova-compute[72820]: DEBUG nova.compute.manager [req-605a1683-465e-499b-84d4-189b3b241dd8 req-86e932cc-c328-4fb3-8812-0d03860ce8ef service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:54:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-605a1683-465e-499b-84d4-189b3b241dd8 req-86e932cc-c328-4fb3-8812-0d03860ce8ef service nova] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:54:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-605a1683-465e-499b-84d4-189b3b241dd8 req-86e932cc-c328-4fb3-8812-0d03860ce8ef service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:54:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-605a1683-465e-499b-84d4-189b3b241dd8 req-86e932cc-c328-4fb3-8812-0d03860ce8ef service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:54:16 user nova-compute[72820]: DEBUG nova.compute.manager [req-605a1683-465e-499b-84d4-189b3b241dd8 req-86e932cc-c328-4fb3-8812-0d03860ce8ef service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] No waiting events found dispatching network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:54:16 user nova-compute[72820]: WARNING nova.compute.manager [req-605a1683-465e-499b-84d4-189b3b241dd8 req-86e932cc-c328-4fb3-8812-0d03860ce8ef service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received unexpected event network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 for instance with vm_state active and task_state reboot_started_hard.
Aug 27 02:54:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:18 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Removed pending event for f6349e97-f14d-4104-9959-1193781a2c4c due to event {{(pid=72820) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 02:54:18 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104858.5684648, f6349e97-f14d-4104-9959-1193781a2c4c => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:54:18 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] VM Resumed (Lifecycle Event)
Aug 27 02:54:18 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:54:18 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Instance rebooted successfully.
Aug 27 02:54:18 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:54:18 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:54:18 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:54:18 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 27 02:54:18 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104858.5702024, f6349e97-f14d-4104-9959-1193781a2c4c => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:54:18 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] VM Started (Lifecycle Event)
Aug 27 02:54:18 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:54:18 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:54:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ae01eca8-4903-427b-9553-5f21f3b8bb05 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "f6349e97-f14d-4104-9959-1193781a2c4c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.549s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:54:18 user nova-compute[72820]: DEBUG nova.compute.manager [req-219806f9-cdb5-4789-b405-d74f5b54cd57 req-a94add0a-d064-48f0-8587-9a3c74b991cd service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:54:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-219806f9-cdb5-4789-b405-d74f5b54cd57 req-a94add0a-d064-48f0-8587-9a3c74b991cd service nova] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:54:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-219806f9-cdb5-4789-b405-d74f5b54cd57 req-a94add0a-d064-48f0-8587-9a3c74b991cd service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:54:18 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-219806f9-cdb5-4789-b405-d74f5b54cd57 req-a94add0a-d064-48f0-8587-9a3c74b991cd service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:54:18 user nova-compute[72820]: DEBUG nova.compute.manager [req-219806f9-cdb5-4789-b405-d74f5b54cd57 req-a94add0a-d064-48f0-8587-9a3c74b991cd service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] No waiting events found dispatching network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:54:18 user nova-compute[72820]: WARNING nova.compute.manager [req-219806f9-cdb5-4789-b405-d74f5b54cd57 req-a94add0a-d064-48f0-8587-9a3c74b991cd service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received unexpected event network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 for instance with vm_state active and task_state None.
Aug 27 02:54:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:23 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:54:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:27 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:54:27 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:54:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:54:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:54:32 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:54:32 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:54:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:36 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:54:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:40 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:54:42 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:54:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:54:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:54:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:54:42 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:54:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:54:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:43 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:54:43 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:54:43 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:54:43 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:54:43 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8569MB free_disk=25.064483642578125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:54:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:54:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:54:43 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 5bff5ccf-6365-4086-9307-adb1c488617f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:54:43 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f6349e97-f14d-4104-9959-1193781a2c4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:54:43 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:54:43 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:54:43 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:54:43 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:54:43 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:54:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:54:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:45 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:54:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:54:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:54:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:54:45 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:54:46 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updating instance_info_cache with network_info: [{"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:54:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:54:46 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:54:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:54:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "5bff5ccf-6365-4086-9307-adb1c488617f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:54:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "5bff5ccf-6365-4086-9307-adb1c488617f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:54:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "5bff5ccf-6365-4086-9307-adb1c488617f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:54:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "5bff5ccf-6365-4086-9307-adb1c488617f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:54:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "5bff5ccf-6365-4086-9307-adb1c488617f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:54:59 user nova-compute[72820]: INFO nova.compute.manager [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Terminating instance
Aug 27 02:54:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:54:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:59 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:54:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-b0d19627-d227-460b-b6b0-2034341d5159 req-f1dbfb73-2520-4c7e-a30a-88c5f6b44683 service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Received event network-vif-unplugged-fafe642e-4c06-4eec-90ae-751c8cb746ca {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:54:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b0d19627-d227-460b-b6b0-2034341d5159 req-f1dbfb73-2520-4c7e-a30a-88c5f6b44683 service nova] Acquiring lock "5bff5ccf-6365-4086-9307-adb1c488617f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:54:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b0d19627-d227-460b-b6b0-2034341d5159 req-f1dbfb73-2520-4c7e-a30a-88c5f6b44683 service nova] Lock "5bff5ccf-6365-4086-9307-adb1c488617f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:54:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-b0d19627-d227-460b-b6b0-2034341d5159 req-f1dbfb73-2520-4c7e-a30a-88c5f6b44683 service nova] Lock "5bff5ccf-6365-4086-9307-adb1c488617f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:54:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-b0d19627-d227-460b-b6b0-2034341d5159 req-f1dbfb73-2520-4c7e-a30a-88c5f6b44683 service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] No waiting events found dispatching network-vif-unplugged-fafe642e-4c06-4eec-90ae-751c8cb746ca {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:54:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-b0d19627-d227-460b-b6b0-2034341d5159 req-f1dbfb73-2520-4c7e-a30a-88c5f6b44683 service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Received event network-vif-unplugged-fafe642e-4c06-4eec-90ae-751c8cb746ca for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:55:00 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Instance destroyed successfully.
Aug 27 02:55:00 user nova-compute[72820]: DEBUG nova.objects.instance [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lazy-loading 'resources' on Instance uuid 5bff5ccf-6365-4086-9307-adb1c488617f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:55:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1711660628',display_name='tempest-AttachVolumeNegativeTest-server-1711660628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1711660628',id=44,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEh7Q50iNoJJni6mf5cZ5twTHkoWbM9AzSB/bXk3TQ2WpHjF53JNLADYCT14ICQLdueDCi743Z5ZFSZ0yBSrza0Yf3EiSeOT0NQngzyRXmoSDM6goZm9/UYFppFQJzkTQw==',key_name='tempest-keypair-2099163185',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='117a0b3ffbe84eba93968f924fa7d2e9',ramdisk_id='',reservation_id='r-9pdh7f9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2145874992',owner_user_name='tempest-AttachVolumeNegativeTest-2145874992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:49:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='391718f05f07460f9388d168d1ebdc98',uuid=5bff5ccf-6365-4086-9307-adb1c488617f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "address": "fa:16:3e:4d:50:a9", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe642e-4c", "ovs_interfaceid": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:55:00 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converting VIF {"id": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "address": "fa:16:3e:4d:50:a9", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe642e-4c", "ovs_interfaceid": "fafe642e-4c06-4eec-90ae-751c8cb746ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:55:00 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:50:a9,bridge_name='br-int',has_traffic_filtering=True,id=fafe642e-4c06-4eec-90ae-751c8cb746ca,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfafe642e-4c') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:55:00 user nova-compute[72820]: DEBUG os_vif [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:50:a9,bridge_name='br-int',has_traffic_filtering=True,id=fafe642e-4c06-4eec-90ae-751c8cb746ca,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfafe642e-4c') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:55:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfafe642e-4c, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:55:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:55:00 user nova-compute[72820]: INFO os_vif [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:50:a9,bridge_name='br-int',has_traffic_filtering=True,id=fafe642e-4c06-4eec-90ae-751c8cb746ca,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfafe642e-4c')
Aug 27 02:55:00 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Deleting instance files /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f_del
Aug 27 02:55:00 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Deletion of /opt/stack/data/nova/instances/5bff5ccf-6365-4086-9307-adb1c488617f_del complete
Aug 27 02:55:00 user nova-compute[72820]: INFO nova.compute.manager [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 27 02:55:00 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:55:00 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:55:00 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:55:01 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:55:01 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Took 0.92 seconds to deallocate network for instance.
Aug 27 02:55:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-3739d972-855a-4814-a6ef-2e3c7f317a42 req-4d22da3e-2c4c-4b77-820b-c24e1dee016e service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Received event network-vif-deleted-fafe642e-4c06-4eec-90ae-751c8cb746ca {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:55:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:55:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:55:01 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:55:01 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:55:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:55:01 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Deleted allocations for instance 5bff5ccf-6365-4086-9307-adb1c488617f
Aug 27 02:55:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-889b0789-28cf-4801-9856-c2684936252f tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "5bff5ccf-6365-4086-9307-adb1c488617f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.199s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:55:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-6665763b-8f8a-45aa-8336-29c4c0058541 req-74c50da0-3041-46aa-8426-f6d34aa1fea9 service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Received event network-vif-plugged-fafe642e-4c06-4eec-90ae-751c8cb746ca {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:55:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6665763b-8f8a-45aa-8336-29c4c0058541 req-74c50da0-3041-46aa-8426-f6d34aa1fea9 service nova] Acquiring lock "5bff5ccf-6365-4086-9307-adb1c488617f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:55:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6665763b-8f8a-45aa-8336-29c4c0058541 req-74c50da0-3041-46aa-8426-f6d34aa1fea9 service nova] Lock "5bff5ccf-6365-4086-9307-adb1c488617f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:55:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6665763b-8f8a-45aa-8336-29c4c0058541 req-74c50da0-3041-46aa-8426-f6d34aa1fea9 service nova] Lock "5bff5ccf-6365-4086-9307-adb1c488617f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:55:01 user nova-compute[72820]: DEBUG nova.compute.manager [req-6665763b-8f8a-45aa-8336-29c4c0058541 req-74c50da0-3041-46aa-8426-f6d34aa1fea9 service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] No waiting events found dispatching network-vif-plugged-fafe642e-4c06-4eec-90ae-751c8cb746ca {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:55:01 user nova-compute[72820]: WARNING nova.compute.manager [req-6665763b-8f8a-45aa-8336-29c4c0058541 req-74c50da0-3041-46aa-8426-f6d34aa1fea9 service nova] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Received unexpected event network-vif-plugged-fafe642e-4c06-4eec-90ae-751c8cb746ca for instance with vm_state deleted and task_state None.
Aug 27 02:55:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:55:15 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693104900.063508, 5bff5ccf-6365-4086-9307-adb1c488617f => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:55:15 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] VM Stopped (Lifecycle Event)
Aug 27 02:55:15 user nova-compute[72820]: DEBUG nova.compute.manager [None req-b582d1ac-c73f-4113-99a2-cf8846bc9d59 None None] [instance: 5bff5ccf-6365-4086-9307-adb1c488617f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:55:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:55:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:55:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:55:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:55:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:55:25 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:55:27 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:55:28 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:55:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:55:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:55:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:55:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:55:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:33 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:55:33 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:55:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:55:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:55:36 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:55:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:42 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:55:42 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:55:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:55:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:55:42 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:55:42 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:55:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:55:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:55:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:55:42 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:55:42 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 02:55:43 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:55:43 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:55:43 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8708MB free_disk=25.0906982421875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:55:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:55:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:55:43 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f6349e97-f14d-4104-9959-1193781a2c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:55:43 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:55:43 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:55:43 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:55:43 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:55:43 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:55:43 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:55:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:55:47 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:55:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:55:47 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 02:55:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:55:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:55:47 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:55:47 user nova-compute[72820]: DEBUG nova.objects.instance [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lazy-loading 'info_cache' on Instance uuid f6349e97-f14d-4104-9959-1193781a2c4c {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:55:48 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updating instance_info_cache with network_info: [{"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:55:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:55:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:55:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "48a0e032-b120-47f7-9346-72fe53938d2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "48a0e032-b120-47f7-9346-72fe53938d2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG nova.compute.manager [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:55:53 user nova-compute[72820]: INFO nova.compute.claims [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Claim successful on node user
Aug 27 02:55:53 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG nova.compute.manager [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG nova.compute.manager [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG nova.network.neutron [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:55:53 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:55:53 user nova-compute[72820]: DEBUG nova.compute.manager [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG nova.policy [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '391718f05f07460f9388d168d1ebdc98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '117a0b3ffbe84eba93968f924fa7d2e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG nova.compute.manager [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:55:53 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Creating image(s)
Aug 27 02:55:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "/opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "/opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "/opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.171s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:55:53 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:55:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.180s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:55:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:55:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk 1073741824" returned: 0 in 0.054s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:55:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:55:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:55:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.183s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:55:54 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:55:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:55:54 user nova-compute[72820]: DEBUG nova.network.neutron [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Successfully created port: e89d4c7e-f02c-48c5-888b-f51aefb68108 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:55:54 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:55:54 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Cannot resize image /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:55:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:55:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Ensure instance console log exists: /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:55:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:55:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:55:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.network.neutron [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Successfully updated port: e89d4c7e-f02c-48c5-888b-f51aefb68108 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "refresh_cache-48a0e032-b120-47f7-9346-72fe53938d2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquired lock "refresh_cache-48a0e032-b120-47f7-9346-72fe53938d2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.network.neutron [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-82d566c0-d390-4e6a-a0a9-07e51b5f5f6d req-9a2f0739-af67-4385-b14a-c865585db235 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Received event network-changed-e89d4c7e-f02c-48c5-888b-f51aefb68108 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-82d566c0-d390-4e6a-a0a9-07e51b5f5f6d req-9a2f0739-af67-4385-b14a-c865585db235 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Refreshing instance network info cache due to event network-changed-e89d4c7e-f02c-48c5-888b-f51aefb68108. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-82d566c0-d390-4e6a-a0a9-07e51b5f5f6d req-9a2f0739-af67-4385-b14a-c865585db235 service nova] Acquiring lock "refresh_cache-48a0e032-b120-47f7-9346-72fe53938d2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.network.neutron [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.network.neutron [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Updating instance_info_cache with network_info: [{"id": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "address": "fa:16:3e:b9:5e:b2", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89d4c7e-f0", "ovs_interfaceid": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Releasing lock "refresh_cache-48a0e032-b120-47f7-9346-72fe53938d2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Instance network_info: |[{"id": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "address": "fa:16:3e:b9:5e:b2", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89d4c7e-f0", "ovs_interfaceid": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-82d566c0-d390-4e6a-a0a9-07e51b5f5f6d req-9a2f0739-af67-4385-b14a-c865585db235 service nova] Acquired lock "refresh_cache-48a0e032-b120-47f7-9346-72fe53938d2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.network.neutron [req-82d566c0-d390-4e6a-a0a9-07e51b5f5f6d req-9a2f0739-af67-4385-b14a-c865585db235 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Refreshing network info cache for port e89d4c7e-f02c-48c5-888b-f51aefb68108 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Start _get_guest_xml network_info=[{"id": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "address": "fa:16:3e:b9:5e:b2", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89d4c7e-f0", "ovs_interfaceid": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:55:55 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:55:55 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:55:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1953300572',display_name='tempest-AttachVolumeNegativeTest-server-1953300572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1953300572',id=48,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSlC31P+bzhXWDYI9+CfPU/GRzkbLKVAudD0tWNdhNlx/cg9ZlYzQfWnOgLX78qfHY/BWqUA7nBgrmUJK2tf7PBIBHZKyDRB3DxncnoBK3gqt0eXeYQoRSg9uM5CmNlog==',key_name='tempest-keypair-180827860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='117a0b3ffbe84eba93968f924fa7d2e9',ramdisk_id='',reservation_id='r-vorairo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2145874992',owner_user_name='tempest-AttachVolumeNegativeTest-2145874992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:55:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='391718f05f07460f9388d168d1ebdc98',uuid=48a0e032-b120-47f7-9346-72fe53938d2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "address": "fa:16:3e:b9:5e:b2", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89d4c7e-f0", "ovs_interfaceid": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converting VIF {"id": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "address": "fa:16:3e:b9:5e:b2", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89d4c7e-f0", "ovs_interfaceid": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:5e:b2,bridge_name='br-int',has_traffic_filtering=True,id=e89d4c7e-f02c-48c5-888b-f51aefb68108,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape89d4c7e-f0') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.objects.instance [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lazy-loading 'pci_devices' on Instance uuid 48a0e032-b120-47f7-9346-72fe53938d2f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:55:55 user nova-compute[72820]:   <uuid>48a0e032-b120-47f7-9346-72fe53938d2f</uuid>
Aug 27 02:55:55 user nova-compute[72820]:   <name>instance-00000030</name>
Aug 27 02:55:55 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:55:55 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:55:55 user nova-compute[72820]:   <metadata>
Aug 27 02:55:55 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:55:55 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:55:55 user nova-compute[72820]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1953300572</nova:name>
Aug 27 02:55:55 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:55:55</nova:creationTime>
Aug 27 02:55:55 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:55:55 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:55:55 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:55:55 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:55:55 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:55:55 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:55:55 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:55:55 user nova-compute[72820]:       <nova:owner>
Aug 27 02:55:55 user nova-compute[72820]:         <nova:user uuid="391718f05f07460f9388d168d1ebdc98">tempest-AttachVolumeNegativeTest-2145874992-project-member</nova:user>
Aug 27 02:55:55 user nova-compute[72820]:         <nova:project uuid="117a0b3ffbe84eba93968f924fa7d2e9">tempest-AttachVolumeNegativeTest-2145874992</nova:project>
Aug 27 02:55:55 user nova-compute[72820]:       </nova:owner>
Aug 27 02:55:55 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:55:55 user nova-compute[72820]:       <nova:ports>
Aug 27 02:55:55 user nova-compute[72820]:         <nova:port uuid="e89d4c7e-f02c-48c5-888b-f51aefb68108">
Aug 27 02:55:55 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 02:55:55 user nova-compute[72820]:         </nova:port>
Aug 27 02:55:55 user nova-compute[72820]:       </nova:ports>
Aug 27 02:55:55 user nova-compute[72820]:     </nova:instance>
Aug 27 02:55:55 user nova-compute[72820]:   </metadata>
Aug 27 02:55:55 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:55:55 user nova-compute[72820]:     <system>
Aug 27 02:55:55 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:55:55 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:55:55 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:55:55 user nova-compute[72820]:       <entry name="serial">48a0e032-b120-47f7-9346-72fe53938d2f</entry>
Aug 27 02:55:55 user nova-compute[72820]:       <entry name="uuid">48a0e032-b120-47f7-9346-72fe53938d2f</entry>
Aug 27 02:55:55 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:55:55 user nova-compute[72820]:     </system>
Aug 27 02:55:55 user nova-compute[72820]:   </sysinfo>
Aug 27 02:55:55 user nova-compute[72820]:   <os>
Aug 27 02:55:55 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:55:55 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:55:55 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:55:55 user nova-compute[72820]:   </os>
Aug 27 02:55:55 user nova-compute[72820]:   <features>
Aug 27 02:55:55 user nova-compute[72820]:     <acpi/>
Aug 27 02:55:55 user nova-compute[72820]:     <apic/>
Aug 27 02:55:55 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:55:55 user nova-compute[72820]:   </features>
Aug 27 02:55:55 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:55:55 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:55:55 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:55:55 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:55:55 user nova-compute[72820]:   </clock>
Aug 27 02:55:55 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:55:55 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:55:55 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:55:55 user nova-compute[72820]:   </cpu>
Aug 27 02:55:55 user nova-compute[72820]:   <devices>
Aug 27 02:55:55 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:55:55 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:55:55 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk"/>
Aug 27 02:55:55 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:55:55 user nova-compute[72820]:     </disk>
Aug 27 02:55:55 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:55:55 user nova-compute[72820]:       <mac address="fa:16:3e:b9:5e:b2"/>
Aug 27 02:55:55 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:55:55 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:55:55 user nova-compute[72820]:       <target dev="tape89d4c7e-f0"/>
Aug 27 02:55:55 user nova-compute[72820]:     </interface>
Aug 27 02:55:55 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:55:55 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/console.log" append="off"/>
Aug 27 02:55:55 user nova-compute[72820]:     </serial>
Aug 27 02:55:55 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:55:55 user nova-compute[72820]:     <video>
Aug 27 02:55:55 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:55:55 user nova-compute[72820]:     </video>
Aug 27 02:55:55 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:55:55 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:55:55 user nova-compute[72820]:     </rng>
Aug 27 02:55:55 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:55:55 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:55:55 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:55:55 user nova-compute[72820]:     </memballoon>
Aug 27 02:55:55 user nova-compute[72820]:   </devices>
Aug 27 02:55:55 user nova-compute[72820]: </domain>
Aug 27 02:55:55 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:55:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1953300572',display_name='tempest-AttachVolumeNegativeTest-server-1953300572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1953300572',id=48,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSlC31P+bzhXWDYI9+CfPU/GRzkbLKVAudD0tWNdhNlx/cg9ZlYzQfWnOgLX78qfHY/BWqUA7nBgrmUJK2tf7PBIBHZKyDRB3DxncnoBK3gqt0eXeYQoRSg9uM5CmNlog==',key_name='tempest-keypair-180827860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='117a0b3ffbe84eba93968f924fa7d2e9',ramdisk_id='',reservation_id='r-vorairo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2145874992',owner_user_name='tempest-AttachVolumeNegativeTest-2145874992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:55:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='391718f05f07460f9388d168d1ebdc98',uuid=48a0e032-b120-47f7-9346-72fe53938d2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "address": "fa:16:3e:b9:5e:b2", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89d4c7e-f0", "ovs_interfaceid": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converting VIF {"id": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "address": "fa:16:3e:b9:5e:b2", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89d4c7e-f0", "ovs_interfaceid": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:5e:b2,bridge_name='br-int',has_traffic_filtering=True,id=e89d4c7e-f02c-48c5-888b-f51aefb68108,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape89d4c7e-f0') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG os_vif [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:5e:b2,bridge_name='br-int',has_traffic_filtering=True,id=e89d4c7e-f02c-48c5-888b-f51aefb68108,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape89d4c7e-f0') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape89d4c7e-f0, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape89d4c7e-f0, col_values=(('external_ids', {'iface-id': 'e89d4c7e-f02c-48c5-888b-f51aefb68108', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:5e:b2', 'vm-uuid': '48a0e032-b120-47f7-9346-72fe53938d2f'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:55 user nova-compute[72820]: INFO os_vif [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:5e:b2,bridge_name='br-int',has_traffic_filtering=True,id=e89d4c7e-f02c-48c5-888b-f51aefb68108,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape89d4c7e-f0')
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:55:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] No VIF found with MAC fa:16:3e:b9:5e:b2, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:55:56 user nova-compute[72820]: DEBUG nova.network.neutron [req-82d566c0-d390-4e6a-a0a9-07e51b5f5f6d req-9a2f0739-af67-4385-b14a-c865585db235 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Updated VIF entry in instance network info cache for port e89d4c7e-f02c-48c5-888b-f51aefb68108. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:55:56 user nova-compute[72820]: DEBUG nova.network.neutron [req-82d566c0-d390-4e6a-a0a9-07e51b5f5f6d req-9a2f0739-af67-4385-b14a-c865585db235 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Updating instance_info_cache with network_info: [{"id": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "address": "fa:16:3e:b9:5e:b2", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89d4c7e-f0", "ovs_interfaceid": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:55:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-82d566c0-d390-4e6a-a0a9-07e51b5f5f6d req-9a2f0739-af67-4385-b14a-c865585db235 service nova] Releasing lock "refresh_cache-48a0e032-b120-47f7-9346-72fe53938d2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:55:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-ec0715ef-8934-4915-9778-0f5b8ef37514 req-fec4f419-48a3-4b45-b006-a220903be745 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Received event network-vif-plugged-e89d4c7e-f02c-48c5-888b-f51aefb68108 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:55:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ec0715ef-8934-4915-9778-0f5b8ef37514 req-fec4f419-48a3-4b45-b006-a220903be745 service nova] Acquiring lock "48a0e032-b120-47f7-9346-72fe53938d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:55:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ec0715ef-8934-4915-9778-0f5b8ef37514 req-fec4f419-48a3-4b45-b006-a220903be745 service nova] Lock "48a0e032-b120-47f7-9346-72fe53938d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:55:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ec0715ef-8934-4915-9778-0f5b8ef37514 req-fec4f419-48a3-4b45-b006-a220903be745 service nova] Lock "48a0e032-b120-47f7-9346-72fe53938d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:55:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-ec0715ef-8934-4915-9778-0f5b8ef37514 req-fec4f419-48a3-4b45-b006-a220903be745 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] No waiting events found dispatching network-vif-plugged-e89d4c7e-f02c-48c5-888b-f51aefb68108 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:55:57 user nova-compute[72820]: WARNING nova.compute.manager [req-ec0715ef-8934-4915-9778-0f5b8ef37514 req-fec4f419-48a3-4b45-b006-a220903be745 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Received unexpected event network-vif-plugged-e89d4c7e-f02c-48c5-888b-f51aefb68108 for instance with vm_state building and task_state spawning.
Aug 27 02:55:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Verify base images {{(pid=72820) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Image id 68b7ab8d-6942-4500-ab2d-968640e48617 yields fingerprint b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d {{(pid=72820) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 27 02:55:58 user nova-compute[72820]: INFO nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] image 68b7ab8d-6942-4500-ab2d-968640e48617 at (/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d): checking
Aug 27 02:55:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] image 68b7ab8d-6942-4500-ab2d-968640e48617 at (/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d): image is in use {{(pid=72820) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72820) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Image id f9f62467-2436-4491-9ef0-eb671acdf108 yields fingerprint 24c93ab9f46be2dfd2a40dfa937dc9b88e88011a {{(pid=72820) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 27 02:55:58 user nova-compute[72820]: INFO nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] image f9f62467-2436-4491-9ef0-eb671acdf108 at (/opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a): checking
Aug 27 02:55:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] image f9f62467-2436-4491-9ef0-eb671acdf108 at (/opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a): image is in use {{(pid=72820) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] f6349e97-f14d-4104-9959-1193781a2c4c is a valid instance name {{(pid=72820) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] f6349e97-f14d-4104-9959-1193781a2c4c has a disk file {{(pid=72820) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f6349e97-f14d-4104-9959-1193781a2c4c is backed by 24c93ab9f46be2dfd2a40dfa937dc9b88e88011a {{(pid=72820) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] 48a0e032-b120-47f7-9346-72fe53938d2f is a valid instance name {{(pid=72820) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] 48a0e032-b120-47f7-9346-72fe53938d2f has a disk file {{(pid=72820) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 48a0e032-b120-47f7-9346-72fe53938d2f is backed by b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d {{(pid=72820) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 27 02:55:58 user nova-compute[72820]: WARNING nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Unknown base file: /opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5
Aug 27 02:55:58 user nova-compute[72820]: WARNING nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Unknown base file: /opt/stack/data/nova/instances/_base/04cabe174fe722a23b5de7a74b0e835155211fb3
Aug 27 02:55:58 user nova-compute[72820]: WARNING nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Unknown base file: /opt/stack/data/nova/instances/_base/cae77ae7ad9e1826eca1825711becaa414202414
Aug 27 02:55:58 user nova-compute[72820]: WARNING nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Unknown base file: /opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4
Aug 27 02:55:58 user nova-compute[72820]: WARNING nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Unknown base file: /opt/stack/data/nova/instances/_base/a042f21652059be98bfced14d07ee71ab8cbca7e
Aug 27 02:55:58 user nova-compute[72820]: WARNING nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Unknown base file: /opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c
Aug 27 02:55:58 user nova-compute[72820]: INFO nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Active base files: /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d /opt/stack/data/nova/instances/_base/24c93ab9f46be2dfd2a40dfa937dc9b88e88011a
Aug 27 02:55:58 user nova-compute[72820]: INFO nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Removable base files: /opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5 /opt/stack/data/nova/instances/_base/04cabe174fe722a23b5de7a74b0e835155211fb3 /opt/stack/data/nova/instances/_base/cae77ae7ad9e1826eca1825711becaa414202414 /opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4 /opt/stack/data/nova/instances/_base/a042f21652059be98bfced14d07ee71ab8cbca7e /opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c
Aug 27 02:55:58 user nova-compute[72820]: INFO nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/be1bfee436cb12031a9639f24434737b151279e5
Aug 27 02:55:58 user nova-compute[72820]: INFO nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/04cabe174fe722a23b5de7a74b0e835155211fb3
Aug 27 02:55:58 user nova-compute[72820]: INFO nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cae77ae7ad9e1826eca1825711becaa414202414
Aug 27 02:55:58 user nova-compute[72820]: INFO nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/16966179790c70105691b5dcec1d7910988cf5a4
Aug 27 02:55:58 user nova-compute[72820]: INFO nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a042f21652059be98bfced14d07ee71ab8cbca7e
Aug 27 02:55:58 user nova-compute[72820]: INFO nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d4a4b85e96963070506340f91c7c8734173a931c
Aug 27 02:55:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Verification complete {{(pid=72820) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Verify swap images {{(pid=72820) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 27 02:55:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.imagecache [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Verify ephemeral images {{(pid=72820) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 27 02:55:59 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104959.43402, 48a0e032-b120-47f7-9346-72fe53938d2f => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:55:59 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] VM Resumed (Lifecycle Event)
Aug 27 02:55:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:55:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:55:59 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Instance spawned successfully.
Aug 27 02:55:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:55:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:55:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:55:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:55:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:55:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:55:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:55:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:55:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:55:59 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:55:59 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693104959.4442937, 48a0e032-b120-47f7-9346-72fe53938d2f => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:55:59 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] VM Started (Lifecycle Event)
Aug 27 02:55:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:55:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:55:59 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:55:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-1fae2ab0-b7a7-457d-b331-09514c3ac510 req-014b6e29-185d-45f6-b7fe-8f0f6c91ca29 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Received event network-vif-plugged-e89d4c7e-f02c-48c5-888b-f51aefb68108 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:55:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1fae2ab0-b7a7-457d-b331-09514c3ac510 req-014b6e29-185d-45f6-b7fe-8f0f6c91ca29 service nova] Acquiring lock "48a0e032-b120-47f7-9346-72fe53938d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:55:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1fae2ab0-b7a7-457d-b331-09514c3ac510 req-014b6e29-185d-45f6-b7fe-8f0f6c91ca29 service nova] Lock "48a0e032-b120-47f7-9346-72fe53938d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:55:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-1fae2ab0-b7a7-457d-b331-09514c3ac510 req-014b6e29-185d-45f6-b7fe-8f0f6c91ca29 service nova] Lock "48a0e032-b120-47f7-9346-72fe53938d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:55:59 user nova-compute[72820]: DEBUG nova.compute.manager [req-1fae2ab0-b7a7-457d-b331-09514c3ac510 req-014b6e29-185d-45f6-b7fe-8f0f6c91ca29 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] No waiting events found dispatching network-vif-plugged-e89d4c7e-f02c-48c5-888b-f51aefb68108 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:55:59 user nova-compute[72820]: WARNING nova.compute.manager [req-1fae2ab0-b7a7-457d-b331-09514c3ac510 req-014b6e29-185d-45f6-b7fe-8f0f6c91ca29 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Received unexpected event network-vif-plugged-e89d4c7e-f02c-48c5-888b-f51aefb68108 for instance with vm_state building and task_state spawning.
Aug 27 02:55:59 user nova-compute[72820]: INFO nova.compute.manager [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Took 5.90 seconds to spawn the instance on the hypervisor.
Aug 27 02:55:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:55:59 user nova-compute[72820]: INFO nova.compute.manager [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Took 6.44 seconds to build instance.
Aug 27 02:55:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-683f67d4-475e-4e00-84f9-0e0f99161484 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "48a0e032-b120-47f7-9346-72fe53938d2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.525s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:56:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:56:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:56:03 user nova-compute[72820]: DEBUG nova.compute.manager [req-ff02fd44-9f30-4119-8434-840dcfa2311c req-dea0a596-553f-499d-a081-86d7bc348479 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-changed-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:56:03 user nova-compute[72820]: DEBUG nova.compute.manager [req-ff02fd44-9f30-4119-8434-840dcfa2311c req-dea0a596-553f-499d-a081-86d7bc348479 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Refreshing instance network info cache due to event network-changed-b17ed63b-2125-4530-a7e3-e715affe9d50. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:56:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ff02fd44-9f30-4119-8434-840dcfa2311c req-dea0a596-553f-499d-a081-86d7bc348479 service nova] Acquiring lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:56:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ff02fd44-9f30-4119-8434-840dcfa2311c req-dea0a596-553f-499d-a081-86d7bc348479 service nova] Acquired lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:56:03 user nova-compute[72820]: DEBUG nova.network.neutron [req-ff02fd44-9f30-4119-8434-840dcfa2311c req-dea0a596-553f-499d-a081-86d7bc348479 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Refreshing network info cache for port b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:56:03 user nova-compute[72820]: DEBUG nova.network.neutron [req-ff02fd44-9f30-4119-8434-840dcfa2311c req-dea0a596-553f-499d-a081-86d7bc348479 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updated VIF entry in instance network info cache for port b17ed63b-2125-4530-a7e3-e715affe9d50. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:56:03 user nova-compute[72820]: DEBUG nova.network.neutron [req-ff02fd44-9f30-4119-8434-840dcfa2311c req-dea0a596-553f-499d-a081-86d7bc348479 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updating instance_info_cache with network_info: [{"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:56:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ff02fd44-9f30-4119-8434-840dcfa2311c req-dea0a596-553f-499d-a081-86d7bc348479 service nova] Releasing lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:56:04 user nova-compute[72820]: DEBUG nova.compute.manager [req-870ab2d3-3fe5-4b98-94bb-940c4fea6b49 req-a897f95d-fe65-419b-8fd4-481fad495626 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-changed-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:56:04 user nova-compute[72820]: DEBUG nova.compute.manager [req-870ab2d3-3fe5-4b98-94bb-940c4fea6b49 req-a897f95d-fe65-419b-8fd4-481fad495626 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Refreshing instance network info cache due to event network-changed-b17ed63b-2125-4530-a7e3-e715affe9d50. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:56:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-870ab2d3-3fe5-4b98-94bb-940c4fea6b49 req-a897f95d-fe65-419b-8fd4-481fad495626 service nova] Acquiring lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:56:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-870ab2d3-3fe5-4b98-94bb-940c4fea6b49 req-a897f95d-fe65-419b-8fd4-481fad495626 service nova] Acquired lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:56:04 user nova-compute[72820]: DEBUG nova.network.neutron [req-870ab2d3-3fe5-4b98-94bb-940c4fea6b49 req-a897f95d-fe65-419b-8fd4-481fad495626 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Refreshing network info cache for port b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:56:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:56:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "f6349e97-f14d-4104-9959-1193781a2c4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:56:04 user nova-compute[72820]: INFO nova.compute.manager [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Detaching volume ca54944b-850a-4206-8b31-373ab69b4780
Aug 27 02:56:04 user nova-compute[72820]: INFO nova.virt.block_device [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Attempting to driver detach volume ca54944b-850a-4206-8b31-373ab69b4780 from mountpoint /dev/vdb
Aug 27 02:56:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Attempting to detach device vdb from instance f6349e97-f14d-4104-9959-1193781a2c4c from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:56:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:56:04 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:56:04 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:56:04 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:56:04 user nova-compute[72820]:   <serial>ca54944b-850a-4206-8b31-373ab69b4780</serial>
Aug 27 02:56:04 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 02:56:04 user nova-compute[72820]: </disk>
Aug 27 02:56:04 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:56:04 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Successfully detached device vdb from instance f6349e97-f14d-4104-9959-1193781a2c4c from the persistent domain config.
Aug 27 02:56:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6349e97-f14d-4104-9959-1193781a2c4c from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:56:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:56:04 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:56:04 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:56:04 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:56:04 user nova-compute[72820]:   <serial>ca54944b-850a-4206-8b31-373ab69b4780</serial>
Aug 27 02:56:04 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 02:56:04 user nova-compute[72820]: </disk>
Aug 27 02:56:04 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG nova.network.neutron [req-870ab2d3-3fe5-4b98-94bb-940c4fea6b49 req-a897f95d-fe65-419b-8fd4-481fad495626 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updated VIF entry in instance network info cache for port b17ed63b-2125-4530-a7e3-e715affe9d50. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG nova.network.neutron [req-870ab2d3-3fe5-4b98-94bb-940c4fea6b49 req-a897f95d-fe65-419b-8fd4-481fad495626 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updating instance_info_cache with network_info: [{"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-870ab2d3-3fe5-4b98-94bb-940c4fea6b49 req-a897f95d-fe65-419b-8fd4-481fad495626 service nova] Releasing lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693104965.329174, f6349e97-f14d-4104-9959-1193781a2c4c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6349e97-f14d-4104-9959-1193781a2c4c {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:56:05 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Successfully detached device vdb from instance f6349e97-f14d-4104-9959-1193781a2c4c from the live domain config.
Aug 27 02:56:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkJWquTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:56:05 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6a5139-252e-4e34-b59c-4651e9df7837]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:56:05 user nova-compute[72820]: No targets found.
Aug 27 02:56:05 user nova-compute[72820]: iSNS:
Aug 27 02:56:05 user nova-compute[72820]: No targets found.
Aug 27 02:56:05 user nova-compute[72820]: STATIC:
Aug 27 02:56:05 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780
Aug 27 02:56:05 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:56:05 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:56:05 user nova-compute[72820]: FIRMWARE:
Aug 27 02:56:05 user nova-compute[72820]: No targets found.
Aug 27 02:56:05 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:56:05 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:56:05 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3b6533-b039-4712-bf49-790460f8f217]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8b1b73-50a1-4abd-9072-1ec0aff48baf]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 (non-flash)
Aug 27 02:56:05 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 (non-flash)
Aug 27 02:56:05 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a05f5870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780'): ({'sdb'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Removing single pathed devices sdb {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a826ca3b-514b-4e4e-bde8-7b2422c09ad7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0b093a-2aae-499f-9ce9-2ba9f9e280cb]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Flushing IO for device /dev/sdb {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4170dc-91a4-4bfe-9c64-6d8eed04f8e0]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[266336e5-99d9-48d6-be6a-11a3c6225e6a]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[65992a85-6d95-4d21-8eb5-65924fcaac74]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34642c3-1d8d-4b79-a7b6-26398a09d125]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780, portal: 172.16.0.220,3260]
Aug 27 02:56:05 user nova-compute[72820]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780, portal: 172.16.0.220,3260] successful.
Aug 27 02:56:05 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca54944b-850a-4206-8b31-373ab69b4780 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[17869a0d-606a-430d-8c9d-975f6d35ae2b]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] <== disconnect_volume: return (322ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:56:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:56:06 user nova-compute[72820]: DEBUG nova.objects.instance [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lazy-loading 'flavor' on Instance uuid f6349e97-f14d-4104-9959-1193781a2c4c {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:56:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-7cbf5b8a-5cec-473d-a7ac-3d62c5a615cd tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "f6349e97-f14d-4104-9959-1193781a2c4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.939s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:56:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:56:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:56:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:56:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:56:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:56:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:56:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:56:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:56:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:56:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:56:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:56:27 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:56:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:56:29 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:56:30 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:56:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:56:33 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:56:33 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:56:33 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:56:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:56:36 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:56:36 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:56:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:56:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:56:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:56:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:56:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:56:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:56:43 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:56:44 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:56:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:56:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:56:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:56:44 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:56:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:56:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:56:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:56:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:56:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:56:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:56:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:56:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:56:45 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:56:45 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:56:45 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8593MB free_disk=25.05184555053711GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:56:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:56:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:56:45 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance f6349e97-f14d-4104-9959-1193781a2c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:56:45 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 48a0e032-b120-47f7-9346-72fe53938d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:56:45 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:56:45 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:56:45 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing inventories for resource provider a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 02:56:45 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Updating ProviderTree inventory for provider a962b30a-2750-431c-be10-075d0f991065 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 02:56:45 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Updating inventory in ProviderTree for provider a962b30a-2750-431c-be10-075d0f991065 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 02:56:45 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing aggregate associations for resource provider a962b30a-2750-431c-be10-075d0f991065, aggregates: None {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 02:56:45 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing trait associations for resource provider a962b30a-2750-431c-be10-075d0f991065, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 02:56:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:56:45 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:56:46 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:56:46 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:56:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG nova.objects.instance [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lazy-loading 'info_cache' on Instance uuid f6349e97-f14d-4104-9959-1193781a2c4c {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updating instance_info_cache with network_info: [{"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-f6349e97-f14d-4104-9959-1193781a2c4c" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] There are 0 instances to clean {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:56:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:56:51 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:56:51 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 02:56:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:56:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:56:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:56:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:56:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:56:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:57:00 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:57:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:57:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:57:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:57:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:57:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:57:06 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:57:06 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid f6349e97-f14d-4104-9959-1193781a2c4c {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:57:06 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Triggering sync for uuid 48a0e032-b120-47f7-9346-72fe53938d2f {{(pid=72820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 02:57:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:57:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "f6349e97-f14d-4104-9959-1193781a2c4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:57:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "48a0e032-b120-47f7-9346-72fe53938d2f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:57:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "48a0e032-b120-47f7-9346-72fe53938d2f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:57:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "f6349e97-f14d-4104-9959-1193781a2c4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:57:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "48a0e032-b120-47f7-9346-72fe53938d2f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:57:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:57:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "f6349e97-f14d-4104-9959-1193781a2c4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:57:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:57:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:57:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:57:06 user nova-compute[72820]: INFO nova.compute.manager [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Terminating instance
Aug 27 02:57:06 user nova-compute[72820]: DEBUG nova.compute.manager [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:57:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-6528d9cb-8973-49f0-b84d-ef8b3de50049 req-54cdf74c-3cad-4aec-ae15-0e6043e084cf service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-vif-unplugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:57:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6528d9cb-8973-49f0-b84d-ef8b3de50049 req-54cdf74c-3cad-4aec-ae15-0e6043e084cf service nova] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:57:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6528d9cb-8973-49f0-b84d-ef8b3de50049 req-54cdf74c-3cad-4aec-ae15-0e6043e084cf service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:57:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6528d9cb-8973-49f0-b84d-ef8b3de50049 req-54cdf74c-3cad-4aec-ae15-0e6043e084cf service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:57:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-6528d9cb-8973-49f0-b84d-ef8b3de50049 req-54cdf74c-3cad-4aec-ae15-0e6043e084cf service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] No waiting events found dispatching network-vif-unplugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:57:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-6528d9cb-8973-49f0-b84d-ef8b3de50049 req-54cdf74c-3cad-4aec-ae15-0e6043e084cf service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-vif-unplugged-b17ed63b-2125-4530-a7e3-e715affe9d50 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:57:07 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Instance destroyed successfully.
Aug 27 02:57:07 user nova-compute[72820]: DEBUG nova.objects.instance [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lazy-loading 'resources' on Instance uuid f6349e97-f14d-4104-9959-1193781a2c4c {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:57:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:07 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:51:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2074165623',display_name='tempest-TestMinimumBasicScenario-server-2074165623',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2074165623',id=47,image_ref='f9f62467-2436-4491-9ef0-eb671acdf108',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcX2jA7sDNPWUQhjs1FiyFD7h6MX0eLaDB9NFR3NOAlF+VbO89wFOHA4K1huE1Hf1P/pKJKuIAlKoEIkWrI9gLcvVOOBWxzx/5z1ZwxvOP9NtZa00eV9AfXmisNGspKWg==',key_name='tempest-TestMinimumBasicScenario-815937332',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:51:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54352cfd7c104bd9acb2d479ccefc214',ramdisk_id='',reservation_id='r-c1uyhvmg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f9f62467-2436-4491-9ef0-eb671acdf108',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-181769521',owner_user_name='tempest-TestMinimumBasicScenario-181769521-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:54:19Z,user_data=None,user_id='a767e402c070429caad7dd8a4cedf72d',uuid=f6349e97-f14d-4104-9959-1193781a2c4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:57:07 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Converting VIF {"id": "b17ed63b-2125-4530-a7e3-e715affe9d50", "address": "fa:16:3e:d3:84:d7", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb17ed63b-21", "ovs_interfaceid": "b17ed63b-2125-4530-a7e3-e715affe9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:57:07 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=b17ed63b-2125-4530-a7e3-e715affe9d50,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb17ed63b-21') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:57:07 user nova-compute[72820]: DEBUG os_vif [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=b17ed63b-2125-4530-a7e3-e715affe9d50,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb17ed63b-21') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:57:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb17ed63b-21, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:57:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:57:07 user nova-compute[72820]: INFO os_vif [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=b17ed63b-2125-4530-a7e3-e715affe9d50,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb17ed63b-21')
Aug 27 02:57:07 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Deleting instance files /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c_del
Aug 27 02:57:07 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Deletion of /opt/stack/data/nova/instances/f6349e97-f14d-4104-9959-1193781a2c4c_del complete
Aug 27 02:57:07 user nova-compute[72820]: INFO nova.compute.manager [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 27 02:57:07 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:57:07 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:57:07 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:57:08 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:57:08 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Took 0.76 seconds to deallocate network for instance.
Aug 27 02:57:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-81683d9c-4c4b-49a5-a38e-b9a03be251c5 req-a2b602ee-3245-4426-a096-422bf500336b service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-vif-deleted-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:57:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:57:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:57:08 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:57:08 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:57:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:57:08 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Deleted allocations for instance f6349e97-f14d-4104-9959-1193781a2c4c
Aug 27 02:57:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-9c1e0805-faae-4ae4-9bc0-d827451744c3 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "f6349e97-f14d-4104-9959-1193781a2c4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.131s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:57:09 user nova-compute[72820]: DEBUG nova.compute.manager [req-cb443e9c-ef0b-4159-acfe-6cba80f595fb req-7d1e41b8-2509-4686-b43d-fd2afc632bf5 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received event network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:57:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-cb443e9c-ef0b-4159-acfe-6cba80f595fb req-7d1e41b8-2509-4686-b43d-fd2afc632bf5 service nova] Acquiring lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:57:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-cb443e9c-ef0b-4159-acfe-6cba80f595fb req-7d1e41b8-2509-4686-b43d-fd2afc632bf5 service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:57:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-cb443e9c-ef0b-4159-acfe-6cba80f595fb req-7d1e41b8-2509-4686-b43d-fd2afc632bf5 service nova] Lock "f6349e97-f14d-4104-9959-1193781a2c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:57:09 user nova-compute[72820]: DEBUG nova.compute.manager [req-cb443e9c-ef0b-4159-acfe-6cba80f595fb req-7d1e41b8-2509-4686-b43d-fd2afc632bf5 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] No waiting events found dispatching network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:57:09 user nova-compute[72820]: WARNING nova.compute.manager [req-cb443e9c-ef0b-4159-acfe-6cba80f595fb req-7d1e41b8-2509-4686-b43d-fd2afc632bf5 service nova] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Received unexpected event network-vif-plugged-b17ed63b-2125-4530-a7e3-e715affe9d50 for instance with vm_state deleted and task_state None.
Aug 27 02:57:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:57:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:57:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:57:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:57:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:22 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693105027.6344, f6349e97-f14d-4104-9959-1193781a2c4c => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:57:22 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] VM Stopped (Lifecycle Event)
Aug 27 02:57:22 user nova-compute[72820]: DEBUG nova.compute.manager [None req-179bcdab-f2f2-410b-b5f1-4d54df682781 None None] [instance: f6349e97-f14d-4104-9959-1193781a2c4c] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:57:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:57:27 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:57:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:57:30 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:57:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:57:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:57:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:57:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:57:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:57:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:35 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:57:35 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:57:35 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:57:36 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:57:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:44 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:57:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:57:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:57:44 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:57:44 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:57:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:57:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:57:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:57:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:57:45 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:57:45 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:57:45 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8709MB free_disk=25.077800750732422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:57:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:57:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:57:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-f1e0295c-b535-4ed5-87cd-dadbd79eed23 req-c8e11df1-96a5-4171-8378-647219c8cd61 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Received event network-changed-e89d4c7e-f02c-48c5-888b-f51aefb68108 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:57:45 user nova-compute[72820]: DEBUG nova.compute.manager [req-f1e0295c-b535-4ed5-87cd-dadbd79eed23 req-c8e11df1-96a5-4171-8378-647219c8cd61 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Refreshing instance network info cache due to event network-changed-e89d4c7e-f02c-48c5-888b-f51aefb68108. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:57:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f1e0295c-b535-4ed5-87cd-dadbd79eed23 req-c8e11df1-96a5-4171-8378-647219c8cd61 service nova] Acquiring lock "refresh_cache-48a0e032-b120-47f7-9346-72fe53938d2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:57:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f1e0295c-b535-4ed5-87cd-dadbd79eed23 req-c8e11df1-96a5-4171-8378-647219c8cd61 service nova] Acquired lock "refresh_cache-48a0e032-b120-47f7-9346-72fe53938d2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:57:45 user nova-compute[72820]: DEBUG nova.network.neutron [req-f1e0295c-b535-4ed5-87cd-dadbd79eed23 req-c8e11df1-96a5-4171-8378-647219c8cd61 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Refreshing network info cache for port e89d4c7e-f02c-48c5-888b-f51aefb68108 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:57:45 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 48a0e032-b120-47f7-9346-72fe53938d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:57:45 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:57:45 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:57:45 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:57:45 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:57:45 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:57:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:57:45 user nova-compute[72820]: DEBUG nova.network.neutron [req-f1e0295c-b535-4ed5-87cd-dadbd79eed23 req-c8e11df1-96a5-4171-8378-647219c8cd61 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Updated VIF entry in instance network info cache for port e89d4c7e-f02c-48c5-888b-f51aefb68108. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:57:45 user nova-compute[72820]: DEBUG nova.network.neutron [req-f1e0295c-b535-4ed5-87cd-dadbd79eed23 req-c8e11df1-96a5-4171-8378-647219c8cd61 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Updating instance_info_cache with network_info: [{"id": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "address": "fa:16:3e:b9:5e:b2", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89d4c7e-f0", "ovs_interfaceid": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:57:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-f1e0295c-b535-4ed5-87cd-dadbd79eed23 req-c8e11df1-96a5-4171-8378-647219c8cd61 service nova] Releasing lock "refresh_cache-48a0e032-b120-47f7-9346-72fe53938d2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:57:46 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:57:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:57:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:57:48 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:57:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:57:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:57:48 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:57:48 user nova-compute[72820]: INFO nova.compute.claims [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Claim successful on node user
Aug 27 02:57:49 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG nova.network.neutron [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:57:49 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:57:49 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG nova.policy [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffcf2a6b2a25478396e51631fd874c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac0972a24bb4362ab3d814a870cb3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:57:49 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Creating image(s)
Aug 27 02:57:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "/opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "/opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.174s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.180s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk 1073741824" returned: 0 in 0.050s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "48a0e032-b120-47f7-9346-72fe53938d2f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "48a0e032-b120-47f7-9346-72fe53938d2f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.196s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:57:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG nova.objects.instance [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lazy-loading 'flavor' on Instance uuid 48a0e032-b120-47f7-9346-72fe53938d2f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "48a0e032-b120-47f7-9346-72fe53938d2f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Successfully created port: bab32c26-3329-444a-a85b-d799d989001b {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Cannot resize image /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Ensure instance console log exists: /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "48a0e032-b120-47f7-9346-72fe53938d2f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "48a0e032-b120-47f7-9346-72fe53938d2f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:57:50 user nova-compute[72820]: INFO nova.compute.manager [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Attaching volume 50e1f2e3-6bbf-43c3-b4e4-bd6459290198 to /dev/vdb
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG os_brick.utils [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-48a0e032-b120-47f7-9346-72fe53938d2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-48a0e032-b120-47f7-9346-72fe53938d2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba77174b-d287-439f-b82f-713181d204dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b32802f-a3b1-4ff9-b8b6-b7a4aef0a200]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[659c669b-16e9-4197-baba-2e79b769cc36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b51c64-71fd-4e3e-9d8a-a7e060a0e6bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:57:50 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[716702e3-4417-4d72-b762-6337bd6bbeeb]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG os_brick.utils [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Updating existing volume attachment record: 13139532-ca06-4ac8-929b-e9b2921913ce {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Successfully updated port: bab32c26-3329-444a-a85b-d799d989001b {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquired lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG nova.compute.manager [req-afdfcdee-89b9-4abe-9e86-2ac4250a9279 req-941740b1-152f-4254-8af0-30a05b7df321 service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Received event network-changed-bab32c26-3329-444a-a85b-d799d989001b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG nova.compute.manager [req-afdfcdee-89b9-4abe-9e86-2ac4250a9279 req-941740b1-152f-4254-8af0-30a05b7df321 service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Refreshing instance network info cache due to event network-changed-bab32c26-3329-444a-a85b-d799d989001b. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-afdfcdee-89b9-4abe-9e86-2ac4250a9279 req-941740b1-152f-4254-8af0-30a05b7df321 service nova] Acquiring lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Updating instance_info_cache with network_info: [{"id": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "address": "fa:16:3e:b9:5e:b2", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89d4c7e-f0", "ovs_interfaceid": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-48a0e032-b120-47f7-9346-72fe53938d2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:57:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.network.neutron [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Updating instance_info_cache with network_info: [{"id": "bab32c26-3329-444a-a85b-d799d989001b", "address": "fa:16:3e:39:1d:d2", "network": {"id": "60f55925-2c0c-4cb5-8594-5077a5ad46c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-573392329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cac0972a24bb4362ab3d814a870cb3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab32c26-33", "ovs_interfaceid": "bab32c26-3329-444a-a85b-d799d989001b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Releasing lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Instance network_info: |[{"id": "bab32c26-3329-444a-a85b-d799d989001b", "address": "fa:16:3e:39:1d:d2", "network": {"id": "60f55925-2c0c-4cb5-8594-5077a5ad46c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-573392329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cac0972a24bb4362ab3d814a870cb3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab32c26-33", "ovs_interfaceid": "bab32c26-3329-444a-a85b-d799d989001b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-afdfcdee-89b9-4abe-9e86-2ac4250a9279 req-941740b1-152f-4254-8af0-30a05b7df321 service nova] Acquired lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.network.neutron [req-afdfcdee-89b9-4abe-9e86-2ac4250a9279 req-941740b1-152f-4254-8af0-30a05b7df321 service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Refreshing network info cache for port bab32c26-3329-444a-a85b-d799d989001b {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Start _get_guest_xml network_info=[{"id": "bab32c26-3329-444a-a85b-d799d989001b", "address": "fa:16:3e:39:1d:d2", "network": {"id": "60f55925-2c0c-4cb5-8594-5077a5ad46c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-573392329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cac0972a24bb4362ab3d814a870cb3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab32c26-33", "ovs_interfaceid": "bab32c26-3329-444a-a85b-d799d989001b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:57:51 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:57:51 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1289349205',display_name='tempest-SnapshotDataIntegrityTests-server-1289349205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1289349205',id=49,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG32lOvsDNiT4vuJRP/tIL8quML7tAeTS5Br3J4DUK2D7bjBrAG2P1ri1IFjtrLgGJit5FE81DKuoJSi9p3rbJ1MuCqfQybIuKiOWSGXoKq+H4mQd0xN0n9ZlaMuh5I8sA==',key_name='tempest-keypair-1450068098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cac0972a24bb4362ab3d814a870cb3d0',ramdisk_id='',reservation_id='r-14shu0u5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1735637744',owner_user_name='tempest-SnapshotDataIntegrityTests-1735637744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:57:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffcf2a6b2a25478396e51631fd874c7e',uuid=2fe2ee1f-9fce-4bf4-8571-31de5e6747bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bab32c26-3329-444a-a85b-d799d989001b", "address": "fa:16:3e:39:1d:d2", "network": {"id": "60f55925-2c0c-4cb5-8594-5077a5ad46c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-573392329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cac0972a24bb4362ab3d814a870cb3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab32c26-33", "ovs_interfaceid": "bab32c26-3329-444a-a85b-d799d989001b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Converting VIF {"id": "bab32c26-3329-444a-a85b-d799d989001b", "address": "fa:16:3e:39:1d:d2", "network": {"id": "60f55925-2c0c-4cb5-8594-5077a5ad46c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-573392329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cac0972a24bb4362ab3d814a870cb3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab32c26-33", "ovs_interfaceid": "bab32c26-3329-444a-a85b-d799d989001b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:1d:d2,bridge_name='br-int',has_traffic_filtering=True,id=bab32c26-3329-444a-a85b-d799d989001b,network=Network(60f55925-2c0c-4cb5-8594-5077a5ad46c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbab32c26-33') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.objects.instance [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:57:51 user nova-compute[72820]:   <uuid>2fe2ee1f-9fce-4bf4-8571-31de5e6747bb</uuid>
Aug 27 02:57:51 user nova-compute[72820]:   <name>instance-00000031</name>
Aug 27 02:57:51 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:57:51 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:57:51 user nova-compute[72820]:   <metadata>
Aug 27 02:57:51 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:57:51 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:57:51 user nova-compute[72820]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1289349205</nova:name>
Aug 27 02:57:51 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:57:51</nova:creationTime>
Aug 27 02:57:51 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:57:51 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:57:51 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:57:51 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:57:51 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:57:51 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:57:51 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:57:51 user nova-compute[72820]:       <nova:owner>
Aug 27 02:57:51 user nova-compute[72820]:         <nova:user uuid="ffcf2a6b2a25478396e51631fd874c7e">tempest-SnapshotDataIntegrityTests-1735637744-project-member</nova:user>
Aug 27 02:57:51 user nova-compute[72820]:         <nova:project uuid="cac0972a24bb4362ab3d814a870cb3d0">tempest-SnapshotDataIntegrityTests-1735637744</nova:project>
Aug 27 02:57:51 user nova-compute[72820]:       </nova:owner>
Aug 27 02:57:51 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:57:51 user nova-compute[72820]:       <nova:ports>
Aug 27 02:57:51 user nova-compute[72820]:         <nova:port uuid="bab32c26-3329-444a-a85b-d799d989001b">
Aug 27 02:57:51 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 02:57:51 user nova-compute[72820]:         </nova:port>
Aug 27 02:57:51 user nova-compute[72820]:       </nova:ports>
Aug 27 02:57:51 user nova-compute[72820]:     </nova:instance>
Aug 27 02:57:51 user nova-compute[72820]:   </metadata>
Aug 27 02:57:51 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:57:51 user nova-compute[72820]:     <system>
Aug 27 02:57:51 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:57:51 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:57:51 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:57:51 user nova-compute[72820]:       <entry name="serial">2fe2ee1f-9fce-4bf4-8571-31de5e6747bb</entry>
Aug 27 02:57:51 user nova-compute[72820]:       <entry name="uuid">2fe2ee1f-9fce-4bf4-8571-31de5e6747bb</entry>
Aug 27 02:57:51 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:57:51 user nova-compute[72820]:     </system>
Aug 27 02:57:51 user nova-compute[72820]:   </sysinfo>
Aug 27 02:57:51 user nova-compute[72820]:   <os>
Aug 27 02:57:51 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:57:51 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:57:51 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:57:51 user nova-compute[72820]:   </os>
Aug 27 02:57:51 user nova-compute[72820]:   <features>
Aug 27 02:57:51 user nova-compute[72820]:     <acpi/>
Aug 27 02:57:51 user nova-compute[72820]:     <apic/>
Aug 27 02:57:51 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:57:51 user nova-compute[72820]:   </features>
Aug 27 02:57:51 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:57:51 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:57:51 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:57:51 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:57:51 user nova-compute[72820]:   </clock>
Aug 27 02:57:51 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:57:51 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:57:51 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:57:51 user nova-compute[72820]:   </cpu>
Aug 27 02:57:51 user nova-compute[72820]:   <devices>
Aug 27 02:57:51 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:57:51 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:57:51 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk"/>
Aug 27 02:57:51 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:57:51 user nova-compute[72820]:     </disk>
Aug 27 02:57:51 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:57:51 user nova-compute[72820]:       <mac address="fa:16:3e:39:1d:d2"/>
Aug 27 02:57:51 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:57:51 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:57:51 user nova-compute[72820]:       <target dev="tapbab32c26-33"/>
Aug 27 02:57:51 user nova-compute[72820]:     </interface>
Aug 27 02:57:51 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:57:51 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/console.log" append="off"/>
Aug 27 02:57:51 user nova-compute[72820]:     </serial>
Aug 27 02:57:51 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:57:51 user nova-compute[72820]:     <video>
Aug 27 02:57:51 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:57:51 user nova-compute[72820]:     </video>
Aug 27 02:57:51 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:57:51 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:57:51 user nova-compute[72820]:     </rng>
Aug 27 02:57:51 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:57:51 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:57:51 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:57:51 user nova-compute[72820]:     </memballoon>
Aug 27 02:57:51 user nova-compute[72820]:   </devices>
Aug 27 02:57:51 user nova-compute[72820]: </domain>
Aug 27 02:57:51 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1289349205',display_name='tempest-SnapshotDataIntegrityTests-server-1289349205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1289349205',id=49,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG32lOvsDNiT4vuJRP/tIL8quML7tAeTS5Br3J4DUK2D7bjBrAG2P1ri1IFjtrLgGJit5FE81DKuoJSi9p3rbJ1MuCqfQybIuKiOWSGXoKq+H4mQd0xN0n9ZlaMuh5I8sA==',key_name='tempest-keypair-1450068098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cac0972a24bb4362ab3d814a870cb3d0',ramdisk_id='',reservation_id='r-14shu0u5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1735637744',owner_user_name='tempest-SnapshotDataIntegrityTests-1735637744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:57:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffcf2a6b2a25478396e51631fd874c7e',uuid=2fe2ee1f-9fce-4bf4-8571-31de5e6747bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bab32c26-3329-444a-a85b-d799d989001b", "address": "fa:16:3e:39:1d:d2", "network": {"id": "60f55925-2c0c-4cb5-8594-5077a5ad46c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-573392329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cac0972a24bb4362ab3d814a870cb3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab32c26-33", "ovs_interfaceid": "bab32c26-3329-444a-a85b-d799d989001b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Converting VIF {"id": "bab32c26-3329-444a-a85b-d799d989001b", "address": "fa:16:3e:39:1d:d2", "network": {"id": "60f55925-2c0c-4cb5-8594-5077a5ad46c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-573392329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cac0972a24bb4362ab3d814a870cb3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab32c26-33", "ovs_interfaceid": "bab32c26-3329-444a-a85b-d799d989001b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:1d:d2,bridge_name='br-int',has_traffic_filtering=True,id=bab32c26-3329-444a-a85b-d799d989001b,network=Network(60f55925-2c0c-4cb5-8594-5077a5ad46c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbab32c26-33') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG os_vif [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:1d:d2,bridge_name='br-int',has_traffic_filtering=True,id=bab32c26-3329-444a-a85b-d799d989001b,network=Network(60f55925-2c0c-4cb5-8594-5077a5ad46c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbab32c26-33') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbab32c26-33, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbab32c26-33, col_values=(('external_ids', {'iface-id': 'bab32c26-3329-444a-a85b-d799d989001b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:1d:d2', 'vm-uuid': '2fe2ee1f-9fce-4bf4-8571-31de5e6747bb'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:51 user nova-compute[72820]: INFO os_vif [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:1d:d2,bridge_name='br-int',has_traffic_filtering=True,id=bab32c26-3329-444a-a85b-d799d989001b,network=Network(60f55925-2c0c-4cb5-8594-5077a5ad46c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbab32c26-33')
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] No VIF found with MAC fa:16:3e:39:1d:d2, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.network.neutron [req-afdfcdee-89b9-4abe-9e86-2ac4250a9279 req-941740b1-152f-4254-8af0-30a05b7df321 service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Updated VIF entry in instance network info cache for port bab32c26-3329-444a-a85b-d799d989001b. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG nova.network.neutron [req-afdfcdee-89b9-4abe-9e86-2ac4250a9279 req-941740b1-152f-4254-8af0-30a05b7df321 service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Updating instance_info_cache with network_info: [{"id": "bab32c26-3329-444a-a85b-d799d989001b", "address": "fa:16:3e:39:1d:d2", "network": {"id": "60f55925-2c0c-4cb5-8594-5077a5ad46c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-573392329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cac0972a24bb4362ab3d814a870cb3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab32c26-33", "ovs_interfaceid": "bab32c26-3329-444a-a85b-d799d989001b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:57:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-afdfcdee-89b9-4abe-9e86-2ac4250a9279 req-941740b1-152f-4254-8af0-30a05b7df321 service nova] Releasing lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:57:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-09024535-3006-4501-acee-2f5728fd467e req-ebe37fef-f765-4deb-aca9-e6fcfaae4ee2 service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Received event network-vif-plugged-bab32c26-3329-444a-a85b-d799d989001b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:57:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-09024535-3006-4501-acee-2f5728fd467e req-ebe37fef-f765-4deb-aca9-e6fcfaae4ee2 service nova] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:57:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-09024535-3006-4501-acee-2f5728fd467e req-ebe37fef-f765-4deb-aca9-e6fcfaae4ee2 service nova] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:57:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-09024535-3006-4501-acee-2f5728fd467e req-ebe37fef-f765-4deb-aca9-e6fcfaae4ee2 service nova] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:57:52 user nova-compute[72820]: DEBUG nova.compute.manager [req-09024535-3006-4501-acee-2f5728fd467e req-ebe37fef-f765-4deb-aca9-e6fcfaae4ee2 service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] No waiting events found dispatching network-vif-plugged-bab32c26-3329-444a-a85b-d799d989001b {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:57:52 user nova-compute[72820]: WARNING nova.compute.manager [req-09024535-3006-4501-acee-2f5728fd467e req-ebe37fef-f765-4deb-aca9-e6fcfaae4ee2 service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Received unexpected event network-vif-plugged-bab32c26-3329-444a-a85b-d799d989001b for instance with vm_state building and task_state spawning.
Aug 27 02:57:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:54 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693105074.833697, 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:57:54 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] VM Resumed (Lifecycle Event)
Aug 27 02:57:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:57:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:57:54 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Instance spawned successfully.
Aug 27 02:57:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:57:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:57:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:57:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:57:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:57:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:57:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:57:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:57:54 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:57:54 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:57:54 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693105074.8372722, 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:57:54 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] VM Started (Lifecycle Event)
Aug 27 02:57:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:57:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:57:54 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:57:54 user nova-compute[72820]: INFO nova.compute.manager [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Took 5.63 seconds to spawn the instance on the hypervisor.
Aug 27 02:57:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:57:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-fb79e86a-85eb-4a0d-94d1-641990b4c583 req-15d042dd-8470-44b4-85ca-576ddf29ee73 service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Received event network-vif-plugged-bab32c26-3329-444a-a85b-d799d989001b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:57:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fb79e86a-85eb-4a0d-94d1-641990b4c583 req-15d042dd-8470-44b4-85ca-576ddf29ee73 service nova] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:57:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fb79e86a-85eb-4a0d-94d1-641990b4c583 req-15d042dd-8470-44b4-85ca-576ddf29ee73 service nova] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:57:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fb79e86a-85eb-4a0d-94d1-641990b4c583 req-15d042dd-8470-44b4-85ca-576ddf29ee73 service nova] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:57:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-fb79e86a-85eb-4a0d-94d1-641990b4c583 req-15d042dd-8470-44b4-85ca-576ddf29ee73 service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] No waiting events found dispatching network-vif-plugged-bab32c26-3329-444a-a85b-d799d989001b {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:57:55 user nova-compute[72820]: WARNING nova.compute.manager [req-fb79e86a-85eb-4a0d-94d1-641990b4c583 req-15d042dd-8470-44b4-85ca-576ddf29ee73 service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Received unexpected event network-vif-plugged-bab32c26-3329-444a-a85b-d799d989001b for instance with vm_state building and task_state spawning.
Aug 27 02:57:55 user nova-compute[72820]: INFO nova.compute.manager [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Took 6.30 seconds to build instance.
Aug 27 02:57:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-e7eab2b6-d996-444b-946d-d7893d9f24e5 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.398s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:57:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:57:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:58:01 user nova-compute[72820]: INFO nova.compute.claims [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Claim successful on node user
Aug 27 02:58:01 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG nova.network.neutron [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNrjbHSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:58:01 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:58:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:58:01 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:58:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:58:01 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:58:01 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a14a1f2-c300-4429-8bc0-73de11c9ac63]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:58:01 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[30583d95-955d-486e-9446-5007192d14c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198] added
Aug 27 02:58:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a576c1-e95c-4bdd-96db-2c2d99ecd275]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG nova.policy [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a767e402c070429caad7dd8a4cedf72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54352cfd7c104bd9acb2d479ccefc214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e8c23a-dcb5-4aa0-980c-74c737313abf]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MNrjbHSy {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MNrjbHSy" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[516e35ad-778e-4c83-812a-18fd102908f3]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MNrjbHSy'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG nova.compute.manager [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:58:01 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Creating image(s)
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "/opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "/opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "/opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9950daf4-b75d-486d-bf14-136a98fe96ff]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6db105-2b37-4b0a-8a60-dddae10abba6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 02:58:01 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 02:58:01 user nova-compute[72820]:  {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:58:01 user nova-compute[72820]: WARNING os_brick.initiator.connectors.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 02:58:01 user nova-compute[72820]: 
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e80566-30fe-477c-bfd0-228483e85e4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198, portal: 172.16.0.220,3260]
Aug 27 02:58:01 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198, portal: 172.16.0.220,3260] successful.
Aug 27 02:58:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a.part --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2869df7f-7f4f-405f-b5d0-f78ba583c49f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d33da4-3c60-4f66-aa69-c9454cbe9c10]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 (non-flash)
Aug 27 02:58:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 (non-flash)
Aug 27 02:58:02 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.880s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5e19c0-816a-4440-a541-0ab2d825101e]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNrjbHSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG nova.network.neutron [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Successfully created port: 9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a.part --force-share --output=json" returned: 0 in 0.209s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG nova.virt.images [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] 83d1620c-e3f7-4390-ba3b-8df656bf0a7b was qcow2, converting to raw {{(pid=72820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG nova.privsep.utils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a.part /opt/stack/data/nova/instances/_base/9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a.converted {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a.part /opt/stack/data/nova/instances/_base/9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a.converted" returned: 0 in 0.399s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:02 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a.converted --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.504s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG nova.network.neutron [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Successfully updated port: 9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquired lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG nova.network.neutron [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG nova.compute.manager [req-a4daee20-ea93-4f98-a04d-4aa4898b659e req-03892d0b-a009-4673-989e-227c50959179 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received event network-changed-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG nova.compute.manager [req-a4daee20-ea93-4f98-a04d-4aa4898b659e req-03892d0b-a009-4673-989e-227c50959179 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Refreshing instance network info cache due to event network-changed-9cfb2ed3-052d-49fa-8e62-495bfc033d19. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a4daee20-ea93-4f98-a04d-4aa4898b659e req-03892d0b-a009-4673-989e-227c50959179 service nova] Acquiring lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG nova.network.neutron [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.917s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] <== connect_volume: return (1920ms) {'type': 'block', 'scsi_wwn': '23363303032363936', 'path': '/dev/sdb'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363303032363936', 'path': '/dev/sdb'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG nova.objects.instance [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lazy-loading 'flavor' on Instance uuid 48a0e032-b120-47f7-9346-72fe53938d2f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:58:03 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:58:03 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:58:03 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:58:03 user nova-compute[72820]:   <serial>50e1f2e3-6bbf-43c3-b4e4-bd6459290198</serial>
Aug 27 02:58:03 user nova-compute[72820]: </disk>
Aug 27 02:58:03 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a --force-share --output=json" returned: 0 in 0.172s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a,backing_fmt=raw /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a,backing_fmt=raw /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk 1073741824" returned: 0 in 0.103s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f37011ff8fe18863ef25a973ab1a5d8a30e4e9a --force-share --output=json" returned: 0 in 0.238s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG nova.network.neutron [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updating instance_info_cache with network_info: [{"id": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "address": "fa:16:3e:16:27:7b", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfb2ed3-05", "ovs_interfaceid": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Releasing lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG nova.compute.manager [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Instance network_info: |[{"id": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "address": "fa:16:3e:16:27:7b", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfb2ed3-05", "ovs_interfaceid": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a4daee20-ea93-4f98-a04d-4aa4898b659e req-03892d0b-a009-4673-989e-227c50959179 service nova] Acquired lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:58:03 user nova-compute[72820]: DEBUG nova.network.neutron [req-a4daee20-ea93-4f98-a04d-4aa4898b659e req-03892d0b-a009-4673-989e-227c50959179 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Refreshing network info cache for port 9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] No VIF found with MAC fa:16:3e:b9:5e:b2, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Cannot resize image /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Ensure instance console log exists: /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Start _get_guest_xml network_info=[{"id": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "address": "fa:16:3e:16:27:7b", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfb2ed3-05", "ovs_interfaceid": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:57:58Z,direct_url=<?>,disk_format='qcow2',id=83d1620c-e3f7-4390-ba3b-8df656bf0a7b,min_disk=0,min_ram=0,name='tempest-scenario-img--1484961637',owner='54352cfd7c104bd9acb2d479ccefc214',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:58:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '83d1620c-e3f7-4390-ba3b-8df656bf0a7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:58:04 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:58:04 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:57:58Z,direct_url=<?>,disk_format='qcow2',id=83d1620c-e3f7-4390-ba3b-8df656bf0a7b,min_disk=0,min_ram=0,name='tempest-scenario-img--1484961637',owner='54352cfd7c104bd9acb2d479ccefc214',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:58:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:58:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-64352634',display_name='tempest-TestMinimumBasicScenario-server-64352634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-64352634',id=50,image_ref='83d1620c-e3f7-4390-ba3b-8df656bf0a7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAk1Sl7rSBqRUjIVi5LM8IiKkqyqSNd5NtkxFGlOMAjcboeJx4SGEZAJeIK3njEXIe+YIXi/JflOw+wt0fNH/TeMgRiyAZFyPzbbHYT9ovoTNBaKIWeglVeKOjsGbO5Aw==',key_name='tempest-TestMinimumBasicScenario-64515797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54352cfd7c104bd9acb2d479ccefc214',ramdisk_id='',reservation_id='r-wa105tea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='83d1620c-e3f7-4390-ba3b-8df656bf0a7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-181769521',owner_user_name='tempest-TestMinimumBasicScenario-181769521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:58:02Z,user_data=None,user_id='a767e402c070429caad7dd8a4cedf72d',uuid=8811f5aa-3fa1-4878-9ed3-c05913fd7808,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "address": "fa:16:3e:16:27:7b", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfb2ed3-05", "ovs_interfaceid": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Converting VIF {"id": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "address": "fa:16:3e:16:27:7b", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfb2ed3-05", "ovs_interfaceid": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=9cfb2ed3-052d-49fa-8e62-495bfc033d19,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cfb2ed3-05') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.objects.instance [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lazy-loading 'pci_devices' on Instance uuid 8811f5aa-3fa1-4878-9ed3-c05913fd7808 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:58:04 user nova-compute[72820]:   <uuid>8811f5aa-3fa1-4878-9ed3-c05913fd7808</uuid>
Aug 27 02:58:04 user nova-compute[72820]:   <name>instance-00000032</name>
Aug 27 02:58:04 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:58:04 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:58:04 user nova-compute[72820]:   <metadata>
Aug 27 02:58:04 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:58:04 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:58:04 user nova-compute[72820]:       <nova:name>tempest-TestMinimumBasicScenario-server-64352634</nova:name>
Aug 27 02:58:04 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:58:04</nova:creationTime>
Aug 27 02:58:04 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:58:04 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:58:04 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:58:04 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:58:04 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:58:04 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:58:04 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:58:04 user nova-compute[72820]:       <nova:owner>
Aug 27 02:58:04 user nova-compute[72820]:         <nova:user uuid="a767e402c070429caad7dd8a4cedf72d">tempest-TestMinimumBasicScenario-181769521-project-member</nova:user>
Aug 27 02:58:04 user nova-compute[72820]:         <nova:project uuid="54352cfd7c104bd9acb2d479ccefc214">tempest-TestMinimumBasicScenario-181769521</nova:project>
Aug 27 02:58:04 user nova-compute[72820]:       </nova:owner>
Aug 27 02:58:04 user nova-compute[72820]:       <nova:root type="image" uuid="83d1620c-e3f7-4390-ba3b-8df656bf0a7b"/>
Aug 27 02:58:04 user nova-compute[72820]:       <nova:ports>
Aug 27 02:58:04 user nova-compute[72820]:         <nova:port uuid="9cfb2ed3-052d-49fa-8e62-495bfc033d19">
Aug 27 02:58:04 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 02:58:04 user nova-compute[72820]:         </nova:port>
Aug 27 02:58:04 user nova-compute[72820]:       </nova:ports>
Aug 27 02:58:04 user nova-compute[72820]:     </nova:instance>
Aug 27 02:58:04 user nova-compute[72820]:   </metadata>
Aug 27 02:58:04 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:58:04 user nova-compute[72820]:     <system>
Aug 27 02:58:04 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:58:04 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:58:04 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:58:04 user nova-compute[72820]:       <entry name="serial">8811f5aa-3fa1-4878-9ed3-c05913fd7808</entry>
Aug 27 02:58:04 user nova-compute[72820]:       <entry name="uuid">8811f5aa-3fa1-4878-9ed3-c05913fd7808</entry>
Aug 27 02:58:04 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:58:04 user nova-compute[72820]:     </system>
Aug 27 02:58:04 user nova-compute[72820]:   </sysinfo>
Aug 27 02:58:04 user nova-compute[72820]:   <os>
Aug 27 02:58:04 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:58:04 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:58:04 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:58:04 user nova-compute[72820]:   </os>
Aug 27 02:58:04 user nova-compute[72820]:   <features>
Aug 27 02:58:04 user nova-compute[72820]:     <acpi/>
Aug 27 02:58:04 user nova-compute[72820]:     <apic/>
Aug 27 02:58:04 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:58:04 user nova-compute[72820]:   </features>
Aug 27 02:58:04 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:58:04 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:58:04 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:58:04 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:58:04 user nova-compute[72820]:   </clock>
Aug 27 02:58:04 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:58:04 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:58:04 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:58:04 user nova-compute[72820]:   </cpu>
Aug 27 02:58:04 user nova-compute[72820]:   <devices>
Aug 27 02:58:04 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:58:04 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:58:04 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk"/>
Aug 27 02:58:04 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:58:04 user nova-compute[72820]:     </disk>
Aug 27 02:58:04 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:58:04 user nova-compute[72820]:       <mac address="fa:16:3e:16:27:7b"/>
Aug 27 02:58:04 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:58:04 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:58:04 user nova-compute[72820]:       <target dev="tap9cfb2ed3-05"/>
Aug 27 02:58:04 user nova-compute[72820]:     </interface>
Aug 27 02:58:04 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:58:04 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/console.log" append="off"/>
Aug 27 02:58:04 user nova-compute[72820]:     </serial>
Aug 27 02:58:04 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:58:04 user nova-compute[72820]:     <video>
Aug 27 02:58:04 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:58:04 user nova-compute[72820]:     </video>
Aug 27 02:58:04 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:58:04 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:58:04 user nova-compute[72820]:     </rng>
Aug 27 02:58:04 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:58:04 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:58:04 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:58:04 user nova-compute[72820]:     </memballoon>
Aug 27 02:58:04 user nova-compute[72820]:   </devices>
Aug 27 02:58:04 user nova-compute[72820]: </domain>
Aug 27 02:58:04 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:58:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-64352634',display_name='tempest-TestMinimumBasicScenario-server-64352634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-64352634',id=50,image_ref='83d1620c-e3f7-4390-ba3b-8df656bf0a7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAk1Sl7rSBqRUjIVi5LM8IiKkqyqSNd5NtkxFGlOMAjcboeJx4SGEZAJeIK3njEXIe+YIXi/JflOw+wt0fNH/TeMgRiyAZFyPzbbHYT9ovoTNBaKIWeglVeKOjsGbO5Aw==',key_name='tempest-TestMinimumBasicScenario-64515797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54352cfd7c104bd9acb2d479ccefc214',ramdisk_id='',reservation_id='r-wa105tea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='83d1620c-e3f7-4390-ba3b-8df656bf0a7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-181769521',owner_user_name='tempest-TestMinimumBasicScenario-181769521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:58:02Z,user_data=None,user_id='a767e402c070429caad7dd8a4cedf72d',uuid=8811f5aa-3fa1-4878-9ed3-c05913fd7808,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "address": "fa:16:3e:16:27:7b", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfb2ed3-05", "ovs_interfaceid": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Converting VIF {"id": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "address": "fa:16:3e:16:27:7b", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfb2ed3-05", "ovs_interfaceid": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=9cfb2ed3-052d-49fa-8e62-495bfc033d19,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cfb2ed3-05') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG os_vif [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=9cfb2ed3-052d-49fa-8e62-495bfc033d19,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cfb2ed3-05') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cfb2ed3-05, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9cfb2ed3-05, col_values=(('external_ids', {'iface-id': '9cfb2ed3-052d-49fa-8e62-495bfc033d19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:27:7b', 'vm-uuid': '8811f5aa-3fa1-4878-9ed3-c05913fd7808'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-96dcf3eb-4dcb-436a-bcb2-72cb20424565 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "48a0e032-b120-47f7-9346-72fe53938d2f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.948s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:04 user nova-compute[72820]: INFO os_vif [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=9cfb2ed3-052d-49fa-8e62-495bfc033d19,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cfb2ed3-05')
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] No VIF found with MAC fa:16:3e:16:27:7b, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.network.neutron [req-a4daee20-ea93-4f98-a04d-4aa4898b659e req-03892d0b-a009-4673-989e-227c50959179 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updated VIF entry in instance network info cache for port 9cfb2ed3-052d-49fa-8e62-495bfc033d19. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG nova.network.neutron [req-a4daee20-ea93-4f98-a04d-4aa4898b659e req-03892d0b-a009-4673-989e-227c50959179 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updating instance_info_cache with network_info: [{"id": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "address": "fa:16:3e:16:27:7b", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfb2ed3-05", "ovs_interfaceid": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-a4daee20-ea93-4f98-a04d-4aa4898b659e req-03892d0b-a009-4673-989e-227c50959179 service nova] Releasing lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "48a0e032-b120-47f7-9346-72fe53938d2f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:58:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "48a0e032-b120-47f7-9346-72fe53938d2f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:58:04 user nova-compute[72820]: INFO nova.compute.manager [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Detaching volume 50e1f2e3-6bbf-43c3-b4e4-bd6459290198
Aug 27 02:58:05 user nova-compute[72820]: INFO nova.virt.block_device [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Attempting to driver detach volume 50e1f2e3-6bbf-43c3-b4e4-bd6459290198 from mountpoint /dev/vdb
Aug 27 02:58:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Attempting to detach device vdb from instance 48a0e032-b120-47f7-9346-72fe53938d2f from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:58:05 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:58:05 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:58:05 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:58:05 user nova-compute[72820]:   <serial>50e1f2e3-6bbf-43c3-b4e4-bd6459290198</serial>
Aug 27 02:58:05 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:58:05 user nova-compute[72820]: </disk>
Aug 27 02:58:05 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:58:05 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Successfully detached device vdb from instance 48a0e032-b120-47f7-9346-72fe53938d2f from the persistent domain config.
Aug 27 02:58:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 48a0e032-b120-47f7-9346-72fe53938d2f from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 02:58:05 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:58:05 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:58:05 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:58:05 user nova-compute[72820]:   <serial>50e1f2e3-6bbf-43c3-b4e4-bd6459290198</serial>
Aug 27 02:58:05 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 02:58:05 user nova-compute[72820]: </disk>
Aug 27 02:58:05 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693105085.633425, 48a0e032-b120-47f7-9346-72fe53938d2f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 48a0e032-b120-47f7-9346-72fe53938d2f {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 02:58:05 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Successfully detached device vdb from instance 48a0e032-b120-47f7-9346-72fe53938d2f from the live domain config.
Aug 27 02:58:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNrjbHSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:58:05 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[506f8c1c-405b-475b-b37c-94bb8f063615]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 02:58:05 user nova-compute[72820]: No targets found.
Aug 27 02:58:05 user nova-compute[72820]: iSNS:
Aug 27 02:58:05 user nova-compute[72820]: No targets found.
Aug 27 02:58:05 user nova-compute[72820]: STATIC:
Aug 27 02:58:05 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198
Aug 27 02:58:05 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 02:58:05 user nova-compute[72820]:                 Iface Name: default
Aug 27 02:58:05 user nova-compute[72820]: FIRMWARE:
Aug 27 02:58:05 user nova-compute[72820]: No targets found.
Aug 27 02:58:05 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 02:58:05 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 02:58:05 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[667fbd02-38cb-4397-b47b-726da731711d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[059d7442-762b-4487-8d8d-5f7ae2a575f5]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 (non-flash)
Aug 27 02:58:05 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 (non-flash)
Aug 27 02:58:05 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a0266ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198'): ({'sdb'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Removing single pathed devices sdb {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d073d554-5a01-41a3-a3fb-721a1122c385]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dab698-737f-4362-a114-4932af452084]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Flushing IO for device /dev/sdb {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b391d6e-1204-423b-9989-0aa5a05543ae]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1168ba-a768-4e4f-82ac-3b133e325817]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab2aa29-624f-46b4-bcdf-9eff42bff86e]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e415556a-a833-413a-baef-da8c21593df4]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198, portal: 172.16.0.220,3260]
Aug 27 02:58:05 user nova-compute[72820]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198, portal: 172.16.0.220,3260] successful.
Aug 27 02:58:05 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e1f2e3-6bbf-43c3-b4e4-bd6459290198 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec56d58-b308-44e5-b8dc-62ee8524fa88]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] <== disconnect_volume: return (297ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 02:58:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-783798ca-7299-4def-94c8-d53875de14a1 req-dcf7ff9f-998c-4311-a7af-0c378400e032 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received event network-vif-plugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:58:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-783798ca-7299-4def-94c8-d53875de14a1 req-dcf7ff9f-998c-4311-a7af-0c378400e032 service nova] Acquiring lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:58:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-783798ca-7299-4def-94c8-d53875de14a1 req-dcf7ff9f-998c-4311-a7af-0c378400e032 service nova] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:58:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-783798ca-7299-4def-94c8-d53875de14a1 req-dcf7ff9f-998c-4311-a7af-0c378400e032 service nova] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:58:06 user nova-compute[72820]: DEBUG nova.compute.manager [req-783798ca-7299-4def-94c8-d53875de14a1 req-dcf7ff9f-998c-4311-a7af-0c378400e032 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] No waiting events found dispatching network-vif-plugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:58:06 user nova-compute[72820]: WARNING nova.compute.manager [req-783798ca-7299-4def-94c8-d53875de14a1 req-dcf7ff9f-998c-4311-a7af-0c378400e032 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received unexpected event network-vif-plugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 for instance with vm_state building and task_state spawning.
Aug 27 02:58:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:06 user nova-compute[72820]: DEBUG nova.objects.instance [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lazy-loading 'flavor' on Instance uuid 48a0e032-b120-47f7-9346-72fe53938d2f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:58:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-55465ea1-3c99-4636-8975-bcb690120de1 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "48a0e032-b120-47f7-9346-72fe53938d2f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.952s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:58:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:08 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693105088.2585137, 8811f5aa-3fa1-4878-9ed3-c05913fd7808 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:58:08 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] VM Resumed (Lifecycle Event)
Aug 27 02:58:08 user nova-compute[72820]: DEBUG nova.compute.manager [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:58:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:58:08 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Instance spawned successfully.
Aug 27 02:58:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:58:08 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:58:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:58:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:58:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:58:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:58:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:58:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:58:08 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:58:08 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:58:08 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693105088.2587895, 8811f5aa-3fa1-4878-9ed3-c05913fd7808 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:58:08 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] VM Started (Lifecycle Event)
Aug 27 02:58:08 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:58:08 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:58:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-e81383c3-0571-41c4-8ef1-2955847868e5 req-408ae9a6-cc05-48a2-a528-e0a90016d240 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received event network-vif-plugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:58:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e81383c3-0571-41c4-8ef1-2955847868e5 req-408ae9a6-cc05-48a2-a528-e0a90016d240 service nova] Acquiring lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:58:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e81383c3-0571-41c4-8ef1-2955847868e5 req-408ae9a6-cc05-48a2-a528-e0a90016d240 service nova] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:58:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-e81383c3-0571-41c4-8ef1-2955847868e5 req-408ae9a6-cc05-48a2-a528-e0a90016d240 service nova] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:58:08 user nova-compute[72820]: DEBUG nova.compute.manager [req-e81383c3-0571-41c4-8ef1-2955847868e5 req-408ae9a6-cc05-48a2-a528-e0a90016d240 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] No waiting events found dispatching network-vif-plugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:58:08 user nova-compute[72820]: WARNING nova.compute.manager [req-e81383c3-0571-41c4-8ef1-2955847868e5 req-408ae9a6-cc05-48a2-a528-e0a90016d240 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received unexpected event network-vif-plugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 for instance with vm_state building and task_state spawning.
Aug 27 02:58:08 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:58:08 user nova-compute[72820]: INFO nova.compute.manager [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Took 6.79 seconds to spawn the instance on the hypervisor.
Aug 27 02:58:08 user nova-compute[72820]: DEBUG nova.compute.manager [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:58:08 user nova-compute[72820]: INFO nova.compute.manager [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Took 7.37 seconds to build instance.
Aug 27 02:58:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b1ea4388-a6f2-412b-93aa-5b6f9a6b8374 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.491s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:58:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:14 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:19 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:24 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:27 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:58:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:29 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:30 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:58:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:33 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:58:34 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:35 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:58:35 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:58:36 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:58:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:38 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:58:39 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:39 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:58:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:44 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:45 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:58:46 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:58:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:58:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:58:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:58:46 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:58:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:58:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:58:48 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:58:48 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:58:48 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8439MB free_disk=24.997699737548828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:58:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:58:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:58:48 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 48a0e032-b120-47f7-9346-72fe53938d2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:58:48 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:58:48 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 8811f5aa-3fa1-4878-9ed3-c05913fd7808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:58:48 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:58:48 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:58:48 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:58:48 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:58:48 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:58:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.260s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:58:49 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:58:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:54 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:58:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:58:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 02:58:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-48a0e032-b120-47f7-9346-72fe53938d2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:58:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-48a0e032-b120-47f7-9346-72fe53938d2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:58:54 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:58:54 user nova-compute[72820]: DEBUG nova.objects.instance [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lazy-loading 'info_cache' on Instance uuid 48a0e032-b120-47f7-9346-72fe53938d2f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:58:54 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Updating instance_info_cache with network_info: [{"id": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "address": "fa:16:3e:b9:5e:b2", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89d4c7e-f0", "ovs_interfaceid": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:58:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-48a0e032-b120-47f7-9346-72fe53938d2f" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:58:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:58:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "48a0e032-b120-47f7-9346-72fe53938d2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:58:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "48a0e032-b120-47f7-9346-72fe53938d2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:58:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "48a0e032-b120-47f7-9346-72fe53938d2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:58:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "48a0e032-b120-47f7-9346-72fe53938d2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:58:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "48a0e032-b120-47f7-9346-72fe53938d2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:58:55 user nova-compute[72820]: INFO nova.compute.manager [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Terminating instance
Aug 27 02:58:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 02:58:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-26307534-9129-474e-b3ff-98090706cadb req-db9273c1-d100-4876-a82a-8264a3681f22 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Received event network-vif-unplugged-e89d4c7e-f02c-48c5-888b-f51aefb68108 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:58:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-26307534-9129-474e-b3ff-98090706cadb req-db9273c1-d100-4876-a82a-8264a3681f22 service nova] Acquiring lock "48a0e032-b120-47f7-9346-72fe53938d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:58:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-26307534-9129-474e-b3ff-98090706cadb req-db9273c1-d100-4876-a82a-8264a3681f22 service nova] Lock "48a0e032-b120-47f7-9346-72fe53938d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:58:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-26307534-9129-474e-b3ff-98090706cadb req-db9273c1-d100-4876-a82a-8264a3681f22 service nova] Lock "48a0e032-b120-47f7-9346-72fe53938d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:58:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-26307534-9129-474e-b3ff-98090706cadb req-db9273c1-d100-4876-a82a-8264a3681f22 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] No waiting events found dispatching network-vif-unplugged-e89d4c7e-f02c-48c5-888b-f51aefb68108 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:58:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-26307534-9129-474e-b3ff-98090706cadb req-db9273c1-d100-4876-a82a-8264a3681f22 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Received event network-vif-unplugged-e89d4c7e-f02c-48c5-888b-f51aefb68108 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 02:58:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:56 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Instance destroyed successfully.
Aug 27 02:58:56 user nova-compute[72820]: DEBUG nova.objects.instance [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lazy-loading 'resources' on Instance uuid 48a0e032-b120-47f7-9346-72fe53938d2f {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:58:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:55:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1953300572',display_name='tempest-AttachVolumeNegativeTest-server-1953300572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1953300572',id=48,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSlC31P+bzhXWDYI9+CfPU/GRzkbLKVAudD0tWNdhNlx/cg9ZlYzQfWnOgLX78qfHY/BWqUA7nBgrmUJK2tf7PBIBHZKyDRB3DxncnoBK3gqt0eXeYQoRSg9uM5CmNlog==',key_name='tempest-keypair-180827860',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:55:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='117a0b3ffbe84eba93968f924fa7d2e9',ramdisk_id='',reservation_id='r-vorairo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2145874992',owner_user_name='tempest-AttachVolumeNegativeTest-2145874992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:56:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='391718f05f07460f9388d168d1ebdc98',uuid=48a0e032-b120-47f7-9346-72fe53938d2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "address": "fa:16:3e:b9:5e:b2", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89d4c7e-f0", "ovs_interfaceid": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 02:58:56 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converting VIF {"id": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "address": "fa:16:3e:b9:5e:b2", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89d4c7e-f0", "ovs_interfaceid": "e89d4c7e-f02c-48c5-888b-f51aefb68108", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:58:56 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:5e:b2,bridge_name='br-int',has_traffic_filtering=True,id=e89d4c7e-f02c-48c5-888b-f51aefb68108,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape89d4c7e-f0') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:58:56 user nova-compute[72820]: DEBUG os_vif [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:5e:b2,bridge_name='br-int',has_traffic_filtering=True,id=e89d4c7e-f02c-48c5-888b-f51aefb68108,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape89d4c7e-f0') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 02:58:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape89d4c7e-f0, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:58:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:58:56 user nova-compute[72820]: INFO os_vif [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:5e:b2,bridge_name='br-int',has_traffic_filtering=True,id=e89d4c7e-f02c-48c5-888b-f51aefb68108,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape89d4c7e-f0')
Aug 27 02:58:56 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Deleting instance files /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f_del
Aug 27 02:58:56 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Deletion of /opt/stack/data/nova/instances/48a0e032-b120-47f7-9346-72fe53938d2f_del complete
Aug 27 02:58:56 user nova-compute[72820]: INFO nova.compute.manager [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 27 02:58:56 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 02:58:56 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 02:58:56 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 02:58:57 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:58:57 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Took 0.91 seconds to deallocate network for instance.
Aug 27 02:58:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:58:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:58:57 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:58:57 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:58:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:58:57 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Deleted allocations for instance 48a0e032-b120-47f7-9346-72fe53938d2f
Aug 27 02:58:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-20a587a0-b4cd-4dff-8ce4-5d794b6d12af tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "48a0e032-b120-47f7-9346-72fe53938d2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.075s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:58:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-53b91c25-3368-4ddf-89a1-9ca7bee43200 req-0e13e3db-c717-4547-8750-b0561af31340 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Received event network-vif-plugged-e89d4c7e-f02c-48c5-888b-f51aefb68108 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:58:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-53b91c25-3368-4ddf-89a1-9ca7bee43200 req-0e13e3db-c717-4547-8750-b0561af31340 service nova] Acquiring lock "48a0e032-b120-47f7-9346-72fe53938d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:58:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-53b91c25-3368-4ddf-89a1-9ca7bee43200 req-0e13e3db-c717-4547-8750-b0561af31340 service nova] Lock "48a0e032-b120-47f7-9346-72fe53938d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:58:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-53b91c25-3368-4ddf-89a1-9ca7bee43200 req-0e13e3db-c717-4547-8750-b0561af31340 service nova] Lock "48a0e032-b120-47f7-9346-72fe53938d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:58:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-53b91c25-3368-4ddf-89a1-9ca7bee43200 req-0e13e3db-c717-4547-8750-b0561af31340 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] No waiting events found dispatching network-vif-plugged-e89d4c7e-f02c-48c5-888b-f51aefb68108 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:58:57 user nova-compute[72820]: WARNING nova.compute.manager [req-53b91c25-3368-4ddf-89a1-9ca7bee43200 req-0e13e3db-c717-4547-8750-b0561af31340 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Received unexpected event network-vif-plugged-e89d4c7e-f02c-48c5-888b-f51aefb68108 for instance with vm_state deleted and task_state None.
Aug 27 02:58:57 user nova-compute[72820]: DEBUG nova.compute.manager [req-53b91c25-3368-4ddf-89a1-9ca7bee43200 req-0e13e3db-c717-4547-8750-b0561af31340 service nova] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Received event network-vif-deleted-e89d4c7e-f02c-48c5-888b-f51aefb68108 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:59:01 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:59:11 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693105136.0276136, 48a0e032-b120-47f7-9346-72fe53938d2f => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:59:11 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] VM Stopped (Lifecycle Event)
Aug 27 02:59:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-459a134d-5795-41a9-b7ba-b13485ee72f7 None None] [instance: 48a0e032-b120-47f7-9346-72fe53938d2f] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:59:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:59:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:59:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:59:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:59:11 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:16 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:59:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:59:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:59:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:59:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:59:26 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:29 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:59:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:59:35 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:59:36 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:59:36 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:59:36 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 02:59:37 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:59:38 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:59:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-df82275b-d630-4e90-a436-cfef5f56c4bd req-f11c9cf9-2e3f-4822-8606-3b983432382a service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Received event network-changed-bab32c26-3329-444a-a85b-d799d989001b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:59:39 user nova-compute[72820]: DEBUG nova.compute.manager [req-df82275b-d630-4e90-a436-cfef5f56c4bd req-f11c9cf9-2e3f-4822-8606-3b983432382a service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Refreshing instance network info cache due to event network-changed-bab32c26-3329-444a-a85b-d799d989001b. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:59:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-df82275b-d630-4e90-a436-cfef5f56c4bd req-f11c9cf9-2e3f-4822-8606-3b983432382a service nova] Acquiring lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:59:39 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-df82275b-d630-4e90-a436-cfef5f56c4bd req-f11c9cf9-2e3f-4822-8606-3b983432382a service nova] Acquired lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:59:39 user nova-compute[72820]: DEBUG nova.network.neutron [req-df82275b-d630-4e90-a436-cfef5f56c4bd req-f11c9cf9-2e3f-4822-8606-3b983432382a service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Refreshing network info cache for port bab32c26-3329-444a-a85b-d799d989001b {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:59:40 user nova-compute[72820]: DEBUG nova.network.neutron [req-df82275b-d630-4e90-a436-cfef5f56c4bd req-f11c9cf9-2e3f-4822-8606-3b983432382a service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Updated VIF entry in instance network info cache for port bab32c26-3329-444a-a85b-d799d989001b. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:59:40 user nova-compute[72820]: DEBUG nova.network.neutron [req-df82275b-d630-4e90-a436-cfef5f56c4bd req-f11c9cf9-2e3f-4822-8606-3b983432382a service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Updating instance_info_cache with network_info: [{"id": "bab32c26-3329-444a-a85b-d799d989001b", "address": "fa:16:3e:39:1d:d2", "network": {"id": "60f55925-2c0c-4cb5-8594-5077a5ad46c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-573392329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cac0972a24bb4362ab3d814a870cb3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab32c26-33", "ovs_interfaceid": "bab32c26-3329-444a-a85b-d799d989001b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:59:40 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-df82275b-d630-4e90-a436-cfef5f56c4bd req-f11c9cf9-2e3f-4822-8606-3b983432382a service nova] Releasing lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:59:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:59:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 02:59:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:59:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 02:59:41 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG nova.objects.instance [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lazy-loading 'flavor' on Instance uuid 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:59:45 user nova-compute[72820]: INFO nova.compute.manager [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Attaching volume 92c1928a-0edb-4e1a-abf0-91afbee2a365 to /dev/vdb
Aug 27 02:59:45 user nova-compute[72820]: DEBUG os_brick.utils [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a66c484-1a38-4a76-8038-bf1a5951d02b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[594acd5a-1b0d-437d-ad7b-1ad3c4149ecc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a667b9eb-e403-495e-8bf7-a50310496bc0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ae7add-a588-4e24-bf6c-635b4092d06e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:59:45 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:59:45 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3fe507-e676-48cc-a991-7c22f8d1ed41]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG os_brick.utils [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Updating existing volume attachment record: a419628d-e6ef-4299-9253-19ef364b066f {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:59:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:46 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:46 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:59:46 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:59:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:59:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:59:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:59:46 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 02:59:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:47 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:59:47 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:59:47 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8588MB free_disk=25.024490356445312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 02:59:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:59:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:59:47 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:59:47 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 8811f5aa-3fa1-4878-9ed3-c05913fd7808 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 02:59:47 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 02:59:47 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 02:59:47 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:59:47 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:59:47 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 02:59:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.260s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:59:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:59:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:59:49 user nova-compute[72820]: DEBUG nova.compute.manager [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Starting instance... {{(pid=72820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 02:59:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:59:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:59:49 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 02:59:49 user nova-compute[72820]: INFO nova.compute.claims [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Claim successful on node user
Aug 27 02:59:49 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 02:59:49 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 02:59:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:59:49 user nova-compute[72820]: DEBUG nova.compute.manager [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Start building networks asynchronously for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 02:59:49 user nova-compute[72820]: DEBUG nova.compute.manager [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Allocating IP information in the background. {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 02:59:49 user nova-compute[72820]: DEBUG nova.network.neutron [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] allocate_for_instance() {{(pid=72820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 02:59:49 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 02:59:49 user nova-compute[72820]: DEBUG nova.compute.manager [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Start building block device mappings for instance. {{(pid=72820) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG nova.policy [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '391718f05f07460f9388d168d1ebdc98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '117a0b3ffbe84eba93968f924fa7d2e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72820) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Start spawning the instance on the hypervisor. {{(pid=72820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Creating instance directory {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 02:59:50 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Creating image(s)
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "/opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "/opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.187s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.169s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk 1073741824 {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d,backing_fmt=raw /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk 1073741824" returned: 0 in 0.047s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95b7601a7674ff243bb9e1f79aa9f6c7cb2d44d --force-share --output=json" returned: 0 in 0.180s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk. size=1073741824 {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG nova.network.neutron [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Successfully created port: 7d196b97-5a33-4226-a6cd-7cbe243cc9fa {{(pid=72820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG nova.virt.disk.api [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Cannot resize image /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk to a smaller size. {{(pid=72820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Created local disks {{(pid=72820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Ensure instance console log exists: /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/console.log {{(pid=72820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:59:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:59:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:51 user nova-compute[72820]: DEBUG nova.network.neutron [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Successfully updated port: 7d196b97-5a33-4226-a6cd-7cbe243cc9fa {{(pid=72820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 02:59:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "refresh_cache-6e55f01f-98c2-4fb1-a25a-b8082e70eeed" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:59:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquired lock "refresh_cache-6e55f01f-98c2-4fb1-a25a-b8082e70eeed" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:59:51 user nova-compute[72820]: DEBUG nova.network.neutron [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 02:59:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-4a02ece1-bcd1-437c-8c0f-460b11b6f146 req-6475b3ca-2f0d-43d2-8cee-a3d2d0da3116 service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Received event network-changed-7d196b97-5a33-4226-a6cd-7cbe243cc9fa {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:59:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-4a02ece1-bcd1-437c-8c0f-460b11b6f146 req-6475b3ca-2f0d-43d2-8cee-a3d2d0da3116 service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Refreshing instance network info cache due to event network-changed-7d196b97-5a33-4226-a6cd-7cbe243cc9fa. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 02:59:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4a02ece1-bcd1-437c-8c0f-460b11b6f146 req-6475b3ca-2f0d-43d2-8cee-a3d2d0da3116 service nova] Acquiring lock "refresh_cache-6e55f01f-98c2-4fb1-a25a-b8082e70eeed" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:59:51 user nova-compute[72820]: DEBUG nova.network.neutron [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Instance cache missing network info. {{(pid=72820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.network.neutron [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Updating instance_info_cache with network_info: [{"id": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "address": "fa:16:3e:86:34:c6", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d196b97-5a", "ovs_interfaceid": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Releasing lock "refresh_cache-6e55f01f-98c2-4fb1-a25a-b8082e70eeed" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.compute.manager [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Instance network_info: |[{"id": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "address": "fa:16:3e:86:34:c6", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d196b97-5a", "ovs_interfaceid": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4a02ece1-bcd1-437c-8c0f-460b11b6f146 req-6475b3ca-2f0d-43d2-8cee-a3d2d0da3116 service nova] Acquired lock "refresh_cache-6e55f01f-98c2-4fb1-a25a-b8082e70eeed" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.network.neutron [req-4a02ece1-bcd1-437c-8c0f-460b11b6f146 req-6475b3ca-2f0d-43d2-8cee-a3d2d0da3116 service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Refreshing network info cache for port 7d196b97-5a33-4226-a6cd-7cbe243cc9fa {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Start _get_guest_xml network_info=[{"id": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "address": "fa:16:3e:86:34:c6", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d196b97-5a", "ovs_interfaceid": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'image_id': '68b7ab8d-6942-4500-ab2d-968640e48617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 02:59:52 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:59:52 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CPU controller missing on host. {{(pid=72820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CPU controller found on host. {{(pid=72820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T02:16:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T02:16:27Z,direct_url=<?>,disk_format='qcow2',id=68b7ab8d-6942-4500-ab2d-968640e48617,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='74aabc5a6b3140eeac78f2075029cb88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T02:16:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Flavor limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Image limits 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Flavor pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Image pref 0:0:0 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Got 1 possible topologies {{(pid=72820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.hardware [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-585885270',display_name='tempest-AttachVolumeNegativeTest-server-585885270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-585885270',id=51,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMszfYGD7Ws3KoqAcy7wwuXI7KdFWCY38saHWDVRvQzzdaMKw7cpsifvMOy62DJXlGgAU0TyL9bq1sAz5brqJWsAxD24ngMr8FtfRQ/vUsIsFqyICWrPlPJtXOQi4xgVQ==',key_name='tempest-keypair-265325938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='117a0b3ffbe84eba93968f924fa7d2e9',ramdisk_id='',reservation_id='r-xrjeui2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2145874992',owner_user_name='tempest-AttachVolumeNegativeTest-2145874992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:59:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='391718f05f07460f9388d168d1ebdc98',uuid=6e55f01f-98c2-4fb1-a25a-b8082e70eeed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "address": "fa:16:3e:86:34:c6", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d196b97-5a", "ovs_interfaceid": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converting VIF {"id": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "address": "fa:16:3e:86:34:c6", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d196b97-5a", "ovs_interfaceid": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:34:c6,bridge_name='br-int',has_traffic_filtering=True,id=7d196b97-5a33-4226-a6cd-7cbe243cc9fa,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d196b97-5a') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.objects.instance [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e55f01f-98c2-4fb1-a25a-b8082e70eeed {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] End _get_guest_xml xml=<domain type="kvm">
Aug 27 02:59:52 user nova-compute[72820]:   <uuid>6e55f01f-98c2-4fb1-a25a-b8082e70eeed</uuid>
Aug 27 02:59:52 user nova-compute[72820]:   <name>instance-00000033</name>
Aug 27 02:59:52 user nova-compute[72820]:   <memory>524288</memory>
Aug 27 02:59:52 user nova-compute[72820]:   <vcpu>1</vcpu>
Aug 27 02:59:52 user nova-compute[72820]:   <metadata>
Aug 27 02:59:52 user nova-compute[72820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 02:59:52 user nova-compute[72820]:       <nova:package version="0.0.0"/>
Aug 27 02:59:52 user nova-compute[72820]:       <nova:name>tempest-AttachVolumeNegativeTest-server-585885270</nova:name>
Aug 27 02:59:52 user nova-compute[72820]:       <nova:creationTime>2023-08-27 02:59:52</nova:creationTime>
Aug 27 02:59:52 user nova-compute[72820]:       <nova:flavor name="m1.tiny">
Aug 27 02:59:52 user nova-compute[72820]:         <nova:memory>512</nova:memory>
Aug 27 02:59:52 user nova-compute[72820]:         <nova:disk>1</nova:disk>
Aug 27 02:59:52 user nova-compute[72820]:         <nova:swap>0</nova:swap>
Aug 27 02:59:52 user nova-compute[72820]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 02:59:52 user nova-compute[72820]:         <nova:vcpus>1</nova:vcpus>
Aug 27 02:59:52 user nova-compute[72820]:       </nova:flavor>
Aug 27 02:59:52 user nova-compute[72820]:       <nova:owner>
Aug 27 02:59:52 user nova-compute[72820]:         <nova:user uuid="391718f05f07460f9388d168d1ebdc98">tempest-AttachVolumeNegativeTest-2145874992-project-member</nova:user>
Aug 27 02:59:52 user nova-compute[72820]:         <nova:project uuid="117a0b3ffbe84eba93968f924fa7d2e9">tempest-AttachVolumeNegativeTest-2145874992</nova:project>
Aug 27 02:59:52 user nova-compute[72820]:       </nova:owner>
Aug 27 02:59:52 user nova-compute[72820]:       <nova:root type="image" uuid="68b7ab8d-6942-4500-ab2d-968640e48617"/>
Aug 27 02:59:52 user nova-compute[72820]:       <nova:ports>
Aug 27 02:59:52 user nova-compute[72820]:         <nova:port uuid="7d196b97-5a33-4226-a6cd-7cbe243cc9fa">
Aug 27 02:59:52 user nova-compute[72820]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 02:59:52 user nova-compute[72820]:         </nova:port>
Aug 27 02:59:52 user nova-compute[72820]:       </nova:ports>
Aug 27 02:59:52 user nova-compute[72820]:     </nova:instance>
Aug 27 02:59:52 user nova-compute[72820]:   </metadata>
Aug 27 02:59:52 user nova-compute[72820]:   <sysinfo type="smbios">
Aug 27 02:59:52 user nova-compute[72820]:     <system>
Aug 27 02:59:52 user nova-compute[72820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 02:59:52 user nova-compute[72820]:       <entry name="product">OpenStack Nova</entry>
Aug 27 02:59:52 user nova-compute[72820]:       <entry name="version">0.0.0</entry>
Aug 27 02:59:52 user nova-compute[72820]:       <entry name="serial">6e55f01f-98c2-4fb1-a25a-b8082e70eeed</entry>
Aug 27 02:59:52 user nova-compute[72820]:       <entry name="uuid">6e55f01f-98c2-4fb1-a25a-b8082e70eeed</entry>
Aug 27 02:59:52 user nova-compute[72820]:       <entry name="family">Virtual Machine</entry>
Aug 27 02:59:52 user nova-compute[72820]:     </system>
Aug 27 02:59:52 user nova-compute[72820]:   </sysinfo>
Aug 27 02:59:52 user nova-compute[72820]:   <os>
Aug 27 02:59:52 user nova-compute[72820]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 02:59:52 user nova-compute[72820]:     <boot dev="hd"/>
Aug 27 02:59:52 user nova-compute[72820]:     <smbios mode="sysinfo"/>
Aug 27 02:59:52 user nova-compute[72820]:   </os>
Aug 27 02:59:52 user nova-compute[72820]:   <features>
Aug 27 02:59:52 user nova-compute[72820]:     <acpi/>
Aug 27 02:59:52 user nova-compute[72820]:     <apic/>
Aug 27 02:59:52 user nova-compute[72820]:     <vmcoreinfo/>
Aug 27 02:59:52 user nova-compute[72820]:   </features>
Aug 27 02:59:52 user nova-compute[72820]:   <clock offset="utc">
Aug 27 02:59:52 user nova-compute[72820]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 02:59:52 user nova-compute[72820]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 02:59:52 user nova-compute[72820]:     <timer name="hpet" present="no"/>
Aug 27 02:59:52 user nova-compute[72820]:   </clock>
Aug 27 02:59:52 user nova-compute[72820]:   <cpu mode="custom" match="exact">
Aug 27 02:59:52 user nova-compute[72820]:     <model>Nehalem</model>
Aug 27 02:59:52 user nova-compute[72820]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 02:59:52 user nova-compute[72820]:   </cpu>
Aug 27 02:59:52 user nova-compute[72820]:   <devices>
Aug 27 02:59:52 user nova-compute[72820]:     <disk type="file" device="disk">
Aug 27 02:59:52 user nova-compute[72820]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 02:59:52 user nova-compute[72820]:       <source file="/opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk"/>
Aug 27 02:59:52 user nova-compute[72820]:       <target dev="vda" bus="virtio"/>
Aug 27 02:59:52 user nova-compute[72820]:     </disk>
Aug 27 02:59:52 user nova-compute[72820]:     <interface type="ethernet">
Aug 27 02:59:52 user nova-compute[72820]:       <mac address="fa:16:3e:86:34:c6"/>
Aug 27 02:59:52 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:59:52 user nova-compute[72820]:       <mtu size="1442"/>
Aug 27 02:59:52 user nova-compute[72820]:       <target dev="tap7d196b97-5a"/>
Aug 27 02:59:52 user nova-compute[72820]:     </interface>
Aug 27 02:59:52 user nova-compute[72820]:     <serial type="pty">
Aug 27 02:59:52 user nova-compute[72820]:       <log file="/opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/console.log" append="off"/>
Aug 27 02:59:52 user nova-compute[72820]:     </serial>
Aug 27 02:59:52 user nova-compute[72820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 02:59:52 user nova-compute[72820]:     <video>
Aug 27 02:59:52 user nova-compute[72820]:       <model type="virtio"/>
Aug 27 02:59:52 user nova-compute[72820]:     </video>
Aug 27 02:59:52 user nova-compute[72820]:     <rng model="virtio">
Aug 27 02:59:52 user nova-compute[72820]:       <backend model="random">/dev/urandom</backend>
Aug 27 02:59:52 user nova-compute[72820]:     </rng>
Aug 27 02:59:52 user nova-compute[72820]:     <controller type="usb" index="0" model="none"/>
Aug 27 02:59:52 user nova-compute[72820]:     <memballoon model="virtio">
Aug 27 02:59:52 user nova-compute[72820]:       <stats period="10"/>
Aug 27 02:59:52 user nova-compute[72820]:     </memballoon>
Aug 27 02:59:52 user nova-compute[72820]:   </devices>
Aug 27 02:59:52 user nova-compute[72820]: </domain>
Aug 27 02:59:52 user nova-compute[72820]:  {{(pid=72820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-585885270',display_name='tempest-AttachVolumeNegativeTest-server-585885270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-585885270',id=51,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMszfYGD7Ws3KoqAcy7wwuXI7KdFWCY38saHWDVRvQzzdaMKw7cpsifvMOy62DJXlGgAU0TyL9bq1sAz5brqJWsAxD24ngMr8FtfRQ/vUsIsFqyICWrPlPJtXOQi4xgVQ==',key_name='tempest-keypair-265325938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='117a0b3ffbe84eba93968f924fa7d2e9',ramdisk_id='',reservation_id='r-xrjeui2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2145874992',owner_user_name='tempest-AttachVolumeNegativeTest-2145874992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T02:59:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='391718f05f07460f9388d168d1ebdc98',uuid=6e55f01f-98c2-4fb1-a25a-b8082e70eeed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "address": "fa:16:3e:86:34:c6", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d196b97-5a", "ovs_interfaceid": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converting VIF {"id": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "address": "fa:16:3e:86:34:c6", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d196b97-5a", "ovs_interfaceid": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:34:c6,bridge_name='br-int',has_traffic_filtering=True,id=7d196b97-5a33-4226-a6cd-7cbe243cc9fa,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d196b97-5a') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG os_vif [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:34:c6,bridge_name='br-int',has_traffic_filtering=True,id=7d196b97-5a33-4226-a6cd-7cbe243cc9fa,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d196b97-5a') {{(pid=72820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d196b97-5a, may_exist=True, interface_attrs={}) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7d196b97-5a, col_values=(('external_ids', {'iface-id': '7d196b97-5a33-4226-a6cd-7cbe243cc9fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:34:c6', 'vm-uuid': '6e55f01f-98c2-4fb1-a25a-b8082e70eeed'}),), if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:52 user nova-compute[72820]: INFO os_vif [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:34:c6,bridge_name='br-int',has_traffic_filtering=True,id=7d196b97-5a33-4226-a6cd-7cbe243cc9fa,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d196b97-5a')
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] No VIF found with MAC fa:16:3e:86:34:c6, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.network.neutron [req-4a02ece1-bcd1-437c-8c0f-460b11b6f146 req-6475b3ca-2f0d-43d2-8cee-a3d2d0da3116 service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Updated VIF entry in instance network info cache for port 7d196b97-5a33-4226-a6cd-7cbe243cc9fa. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG nova.network.neutron [req-4a02ece1-bcd1-437c-8c0f-460b11b6f146 req-6475b3ca-2f0d-43d2-8cee-a3d2d0da3116 service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Updating instance_info_cache with network_info: [{"id": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "address": "fa:16:3e:86:34:c6", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d196b97-5a", "ovs_interfaceid": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:59:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4a02ece1-bcd1-437c-8c0f-460b11b6f146 req-6475b3ca-2f0d-43d2-8cee-a3d2d0da3116 service nova] Releasing lock "refresh_cache-6e55f01f-98c2-4fb1-a25a-b8082e70eeed" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:59:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-61e11f2e-ed47-4c2f-a2a3-82f7d7d9ec5f req-ce5831a5-4d6a-4392-bfca-51c4863b0b0c service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Received event network-vif-plugged-7d196b97-5a33-4226-a6cd-7cbe243cc9fa {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:59:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-61e11f2e-ed47-4c2f-a2a3-82f7d7d9ec5f req-ce5831a5-4d6a-4392-bfca-51c4863b0b0c service nova] Acquiring lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:59:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-61e11f2e-ed47-4c2f-a2a3-82f7d7d9ec5f req-ce5831a5-4d6a-4392-bfca-51c4863b0b0c service nova] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:59:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-61e11f2e-ed47-4c2f-a2a3-82f7d7d9ec5f req-ce5831a5-4d6a-4392-bfca-51c4863b0b0c service nova] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:59:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-61e11f2e-ed47-4c2f-a2a3-82f7d7d9ec5f req-ce5831a5-4d6a-4392-bfca-51c4863b0b0c service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] No waiting events found dispatching network-vif-plugged-7d196b97-5a33-4226-a6cd-7cbe243cc9fa {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:59:53 user nova-compute[72820]: WARNING nova.compute.manager [req-61e11f2e-ed47-4c2f-a2a3-82f7d7d9ec5f req-ce5831a5-4d6a-4392-bfca-51c4863b0b0c service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Received unexpected event network-vif-plugged-7d196b97-5a33-4226-a6cd-7cbe243cc9fa for instance with vm_state building and task_state spawning.
Aug 27 02:59:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:54 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:54 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 02:59:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 02:59:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 02:59:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 02:59:54 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Updating instance_info_cache with network_info: [{"id": "bab32c26-3329-444a-a85b-d799d989001b", "address": "fa:16:3e:39:1d:d2", "network": {"id": "60f55925-2c0c-4cb5-8594-5077a5ad46c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-573392329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cac0972a24bb4362ab3d814a870cb3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab32c26-33", "ovs_interfaceid": "bab32c26-3329-444a-a85b-d799d989001b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693105195.9204388, 6e55f01f-98c2-4fb1-a25a-b8082e70eeed => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:59:55 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] VM Resumed (Lifecycle Event)
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Instance event wait completed in 0 seconds for  {{(pid=72820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Guest created on hypervisor {{(pid=72820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 02:59:55 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Instance spawned successfully.
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Found default for hw_cdrom_bus of ide {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Found default for hw_disk_bus of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Found default for hw_input_bus of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Found default for hw_pointer_model of None {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Found default for hw_video_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Found default for hw_vif_model of virtio {{(pid=72820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-da5ff851-3cfd-4da3-a6ef-5bb77ce09fd3 req-b34528ed-d7cd-4b62-88cd-e567ed82869a service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Received event network-vif-plugged-7d196b97-5a33-4226-a6cd-7cbe243cc9fa {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-da5ff851-3cfd-4da3-a6ef-5bb77ce09fd3 req-b34528ed-d7cd-4b62-88cd-e567ed82869a service nova] Acquiring lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-da5ff851-3cfd-4da3-a6ef-5bb77ce09fd3 req-b34528ed-d7cd-4b62-88cd-e567ed82869a service nova] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-da5ff851-3cfd-4da3-a6ef-5bb77ce09fd3 req-b34528ed-d7cd-4b62-88cd-e567ed82869a service nova] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.compute.manager [req-da5ff851-3cfd-4da3-a6ef-5bb77ce09fd3 req-b34528ed-d7cd-4b62-88cd-e567ed82869a service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] No waiting events found dispatching network-vif-plugged-7d196b97-5a33-4226-a6cd-7cbe243cc9fa {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 02:59:55 user nova-compute[72820]: WARNING nova.compute.manager [req-da5ff851-3cfd-4da3-a6ef-5bb77ce09fd3 req-b34528ed-d7cd-4b62-88cd-e567ed82869a service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Received unexpected event network-vif-plugged-7d196b97-5a33-4226-a6cd-7cbe243cc9fa for instance with vm_state building and task_state spawning.
Aug 27 02:59:55 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693105195.9219468, 6e55f01f-98c2-4fb1-a25a-b8082e70eeed => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 02:59:55 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] VM Started (Lifecycle Event)
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:59:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 02:59:56 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 02:59:56 user nova-compute[72820]: INFO nova.compute.manager [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Took 5.93 seconds to spawn the instance on the hypervisor.
Aug 27 02:59:56 user nova-compute[72820]: DEBUG nova.compute.manager [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 02:59:56 user nova-compute[72820]: INFO nova.compute.manager [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Took 6.47 seconds to build instance.
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-11b0897e-7112-4cdb-a9b7-1efc7c7d0745 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.577s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG nova.objects.instance [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lazy-loading 'flavor' on Instance uuid 8811f5aa-3fa1-4878-9ed3-c05913fd7808 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MaZVETfe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:59:56 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:59:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:59:56 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 02:59:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 02:59:56 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[61805dc1-302b-4040-add0-3c789955b57d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 02:59:56 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e602658c-6df8-4123-8e38-143070088544]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365] added
Aug 27 02:59:56 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e67e36-d8f1-4828-a1b2-e19cdb0ca20d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1524f87-2f7e-4a5c-9ee6-e8b154f3af5b]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MaZVETfe {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 02:59:56 user nova-compute[72820]: INFO nova.compute.manager [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Attaching volume 5eb8acd3-4512-489b-8f1a-c1f472375388 to /dev/vdb
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MaZVETfe" returned: 0 in 0.038s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e352ec-4590-4815-91fd-4afc6c85739a]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MaZVETfe'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[095cd26b-3df2-41b5-9200-6d54e2797228]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dda621a-e9c6-49c4-877f-411956fbe7cb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 02:59:56 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 02:59:56 user nova-compute[72820]:  {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:59:56 user nova-compute[72820]: WARNING os_brick.initiator.connectors.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 02:59:56 user nova-compute[72820]: 
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG os_brick.utils [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9165ceed-74f6-4f37-9f7f-75a5c51847cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c740659c-b154-4394-9ef0-e072a0131c95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a25465-bbce-4135-bb19-408dfefae5e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365, portal: 172.16.0.220,3260]
Aug 27 02:59:56 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365, portal: 172.16.0.220,3260] successful.
Aug 27 02:59:56 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9c817d-cf14-49ab-b750-060ec1c2ea5a]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2290ed-fa1b-44d8-9426-c43cbc911c1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[04729d52-399f-4dda-9154-b29b3e680b6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:56 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b87841-8e66-4e4b-b96d-20e7c9343d31]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 (non-flash)
Aug 27 02:59:57 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 (non-flash)
Aug 27 02:59:57 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 02:59:57 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 02:59:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c5a380-19c7-4f55-bdc3-e4f5c28a1c9a]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG os_brick.utils [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updating existing volume attachment record: 0dfe6d43-02ff-487a-abf4-aa4ff48ba92d {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d8c292-e5e5-4f46-808a-e8ec4faa335f]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MaZVETfe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 02:59:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 02:59:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23532633337313361', 'path': '/dev/sdb'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 02:59:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532633337313361', 'path': '/dev/sdb'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 02:59:58 user nova-compute[72820]: DEBUG nova.objects.instance [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lazy-loading 'flavor' on Instance uuid 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 02:59:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 02:59:58 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 02:59:58 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 02:59:58 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 02:59:58 user nova-compute[72820]:   <serial>92c1928a-0edb-4e1a-abf0-91afbee2a365</serial>
Aug 27 02:59:58 user nova-compute[72820]: </disk>
Aug 27 02:59:58 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 02:59:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 02:59:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:59:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 02:59:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] No VIF found with MAC fa:16:3e:39:1d:d2, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 02:59:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-fbc69e40-3b08-4bc2-81fe-dbff0fe0c823 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.201s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:00:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbVSKkoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:00:08 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:00:08 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:00:08 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06242d2-5a8e-4596-8579-7a1d807749df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:00:08 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b2950e-2a3f-4f83-99f8-439746bcb12e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388] added
Aug 27 03:00:08 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cf7102-6838-4e47-960d-87d9185b397f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd499a7-e9f2-494a-a520-9336955af49a]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zbVSKkoF {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zbVSKkoF" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe7b042-1c0f-4c3a-bb99-00b7bb31606b]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zbVSKkoF'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b382a4d-3624-41e4-85ac-8646555447bb]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdfb9a8-634e-4ace-8eb7-172fd8cb81d3]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 (non-flash)
Aug 27 03:00:08 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 (non-flash)
Aug 27 03:00:08 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecb679e-2886-4b1e-abee-08178d7af204]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388, portal: 172.16.0.220,3260]
Aug 27 03:00:08 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388, portal: 172.16.0.220,3260] successful.
Aug 27 03:00:08 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef6250c-95f8-48ec-a840-21e152935990]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b656b2-3905-4233-bb47-5126889488ab]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 (non-flash)
Aug 27 03:00:08 user nova-compute[72820]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)
Aug 27 03:00:08 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 (non-flash)
Aug 27 03:00:08 user nova-compute[72820]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)
Aug 27 03:00:08 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba87a1c9-d818-4ca7-89d1-bae8464ff01f]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:08 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:00:09 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:00:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbVSKkoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:00:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:00:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23138643636626334', 'path': '/dev/sdc'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:00:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138643636626334', 'path': '/dev/sdc'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:00:09 user nova-compute[72820]: DEBUG nova.objects.instance [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lazy-loading 'flavor' on Instance uuid 8811f5aa-3fa1-4878-9ed3-c05913fd7808 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:00:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 03:00:09 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:00:09 user nova-compute[72820]:   <source dev="/dev/sdc"/>
Aug 27 03:00:09 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:00:09 user nova-compute[72820]:   <serial>5eb8acd3-4512-489b-8f1a-c1f472375388</serial>
Aug 27 03:00:09 user nova-compute[72820]: </disk>
Aug 27 03:00:09 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:00:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:00:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:00:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] No VIF found with MAC fa:16:3e:16:27:7b, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:00:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-afd36632-c67f-4b61-af3d-d60bc43bae1e tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.330s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:00:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-6b68830d-62e2-4ce7-97e6-04eb75c96d2a req-e2a4b2a1-2321-4561-8b02-c07da4f33112 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received event network-changed-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:00:13 user nova-compute[72820]: DEBUG nova.compute.manager [req-6b68830d-62e2-4ce7-97e6-04eb75c96d2a req-e2a4b2a1-2321-4561-8b02-c07da4f33112 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Refreshing instance network info cache due to event network-changed-9cfb2ed3-052d-49fa-8e62-495bfc033d19. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:00:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6b68830d-62e2-4ce7-97e6-04eb75c96d2a req-e2a4b2a1-2321-4561-8b02-c07da4f33112 service nova] Acquiring lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:00:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6b68830d-62e2-4ce7-97e6-04eb75c96d2a req-e2a4b2a1-2321-4561-8b02-c07da4f33112 service nova] Acquired lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:00:13 user nova-compute[72820]: DEBUG nova.network.neutron [req-6b68830d-62e2-4ce7-97e6-04eb75c96d2a req-e2a4b2a1-2321-4561-8b02-c07da4f33112 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Refreshing network info cache for port 9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:00:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:13 user nova-compute[72820]: DEBUG nova.network.neutron [req-6b68830d-62e2-4ce7-97e6-04eb75c96d2a req-e2a4b2a1-2321-4561-8b02-c07da4f33112 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updated VIF entry in instance network info cache for port 9cfb2ed3-052d-49fa-8e62-495bfc033d19. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:00:13 user nova-compute[72820]: DEBUG nova.network.neutron [req-6b68830d-62e2-4ce7-97e6-04eb75c96d2a req-e2a4b2a1-2321-4561-8b02-c07da4f33112 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updating instance_info_cache with network_info: [{"id": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "address": "fa:16:3e:16:27:7b", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfb2ed3-05", "ovs_interfaceid": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:00:13 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6b68830d-62e2-4ce7-97e6-04eb75c96d2a req-e2a4b2a1-2321-4561-8b02-c07da4f33112 service nova] Releasing lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:00:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-fef7c528-2a21-4f2e-84bb-c63f91404c19 req-cf986abf-37f4-43ea-ab03-d1856c70b711 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received event network-changed-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:00:14 user nova-compute[72820]: DEBUG nova.compute.manager [req-fef7c528-2a21-4f2e-84bb-c63f91404c19 req-cf986abf-37f4-43ea-ab03-d1856c70b711 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Refreshing instance network info cache due to event network-changed-9cfb2ed3-052d-49fa-8e62-495bfc033d19. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:00:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fef7c528-2a21-4f2e-84bb-c63f91404c19 req-cf986abf-37f4-43ea-ab03-d1856c70b711 service nova] Acquiring lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:00:14 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fef7c528-2a21-4f2e-84bb-c63f91404c19 req-cf986abf-37f4-43ea-ab03-d1856c70b711 service nova] Acquired lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:00:14 user nova-compute[72820]: DEBUG nova.network.neutron [req-fef7c528-2a21-4f2e-84bb-c63f91404c19 req-cf986abf-37f4-43ea-ab03-d1856c70b711 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Refreshing network info cache for port 9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:00:15 user nova-compute[72820]: DEBUG nova.network.neutron [req-fef7c528-2a21-4f2e-84bb-c63f91404c19 req-cf986abf-37f4-43ea-ab03-d1856c70b711 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updated VIF entry in instance network info cache for port 9cfb2ed3-052d-49fa-8e62-495bfc033d19. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:00:15 user nova-compute[72820]: DEBUG nova.network.neutron [req-fef7c528-2a21-4f2e-84bb-c63f91404c19 req-cf986abf-37f4-43ea-ab03-d1856c70b711 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updating instance_info_cache with network_info: [{"id": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "address": "fa:16:3e:16:27:7b", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfb2ed3-05", "ovs_interfaceid": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:00:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-fef7c528-2a21-4f2e-84bb-c63f91404c19 req-cf986abf-37f4-43ea-ab03-d1856c70b711 service nova] Releasing lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:00:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-fb37fdd0-3f39-4713-a336-9ae8abbe04ef tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:00:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-fb37fdd0-3f39-4713-a336-9ae8abbe04ef tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:00:15 user nova-compute[72820]: INFO nova.compute.manager [None req-fb37fdd0-3f39-4713-a336-9ae8abbe04ef tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Rebooting instance
Aug 27 03:00:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-fb37fdd0-3f39-4713-a336-9ae8abbe04ef tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:00:15 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-fb37fdd0-3f39-4713-a336-9ae8abbe04ef tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquired lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:00:15 user nova-compute[72820]: DEBUG nova.network.neutron [None req-fb37fdd0-3f39-4713-a336-9ae8abbe04ef tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Building network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:00:16 user nova-compute[72820]: DEBUG nova.network.neutron [None req-fb37fdd0-3f39-4713-a336-9ae8abbe04ef tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updating instance_info_cache with network_info: [{"id": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "address": "fa:16:3e:16:27:7b", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfb2ed3-05", "ovs_interfaceid": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:00:16 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-fb37fdd0-3f39-4713-a336-9ae8abbe04ef tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Releasing lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:00:16 user nova-compute[72820]: DEBUG nova.compute.manager [None req-fb37fdd0-3f39-4713-a336-9ae8abbe04ef tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:00:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:18 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:19 user nova-compute[72820]: DEBUG nova.compute.manager [req-5abb2cda-82e3-45b1-abe4-d7927a785cd2 req-14c97807-6fd6-4119-8bb8-491521aa1180 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received event network-vif-unplugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:00:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5abb2cda-82e3-45b1-abe4-d7927a785cd2 req-14c97807-6fd6-4119-8bb8-491521aa1180 service nova] Acquiring lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:00:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5abb2cda-82e3-45b1-abe4-d7927a785cd2 req-14c97807-6fd6-4119-8bb8-491521aa1180 service nova] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:00:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-5abb2cda-82e3-45b1-abe4-d7927a785cd2 req-14c97807-6fd6-4119-8bb8-491521aa1180 service nova] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:00:19 user nova-compute[72820]: DEBUG nova.compute.manager [req-5abb2cda-82e3-45b1-abe4-d7927a785cd2 req-14c97807-6fd6-4119-8bb8-491521aa1180 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] No waiting events found dispatching network-vif-unplugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:00:19 user nova-compute[72820]: WARNING nova.compute.manager [req-5abb2cda-82e3-45b1-abe4-d7927a785cd2 req-14c97807-6fd6-4119-8bb8-491521aa1180 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received unexpected event network-vif-unplugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 for instance with vm_state active and task_state reboot_started.
Aug 27 03:00:19 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-fb37fdd0-3f39-4713-a336-9ae8abbe04ef tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Instance shutdown successfully.
Aug 27 03:00:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-4a3b17c5-a655-4142-905b-bcd437901a50 req-d6b67eaa-2396-4f48-8152-d3e1af7632f8 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received event network-vif-plugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:00:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4a3b17c5-a655-4142-905b-bcd437901a50 req-d6b67eaa-2396-4f48-8152-d3e1af7632f8 service nova] Acquiring lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:00:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4a3b17c5-a655-4142-905b-bcd437901a50 req-d6b67eaa-2396-4f48-8152-d3e1af7632f8 service nova] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:00:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4a3b17c5-a655-4142-905b-bcd437901a50 req-d6b67eaa-2396-4f48-8152-d3e1af7632f8 service nova] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:00:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-4a3b17c5-a655-4142-905b-bcd437901a50 req-d6b67eaa-2396-4f48-8152-d3e1af7632f8 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] No waiting events found dispatching network-vif-plugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:00:21 user nova-compute[72820]: WARNING nova.compute.manager [req-4a3b17c5-a655-4142-905b-bcd437901a50 req-d6b67eaa-2396-4f48-8152-d3e1af7632f8 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received unexpected event network-vif-plugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 for instance with vm_state active and task_state reboot_started.
Aug 27 03:00:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-4a3b17c5-a655-4142-905b-bcd437901a50 req-d6b67eaa-2396-4f48-8152-d3e1af7632f8 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received event network-vif-plugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:00:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4a3b17c5-a655-4142-905b-bcd437901a50 req-d6b67eaa-2396-4f48-8152-d3e1af7632f8 service nova] Acquiring lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:00:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4a3b17c5-a655-4142-905b-bcd437901a50 req-d6b67eaa-2396-4f48-8152-d3e1af7632f8 service nova] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:00:21 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-4a3b17c5-a655-4142-905b-bcd437901a50 req-d6b67eaa-2396-4f48-8152-d3e1af7632f8 service nova] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:00:21 user nova-compute[72820]: DEBUG nova.compute.manager [req-4a3b17c5-a655-4142-905b-bcd437901a50 req-d6b67eaa-2396-4f48-8152-d3e1af7632f8 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] No waiting events found dispatching network-vif-plugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:00:21 user nova-compute[72820]: WARNING nova.compute.manager [req-4a3b17c5-a655-4142-905b-bcd437901a50 req-d6b67eaa-2396-4f48-8152-d3e1af7632f8 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received unexpected event network-vif-plugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 for instance with vm_state active and task_state reboot_started.
Aug 27 03:00:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.host [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Removed pending event for 8811f5aa-3fa1-4878-9ed3-c05913fd7808 due to event {{(pid=72820) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 03:00:23 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693105223.0635884, 8811f5aa-3fa1-4878-9ed3-c05913fd7808 => Resumed> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:00:23 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] VM Resumed (Lifecycle Event)
Aug 27 03:00:23 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Instance running successfully.
Aug 27 03:00:23 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-fb37fdd0-3f39-4713-a336-9ae8abbe04ef tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Instance soft rebooted successfully.
Aug 27 03:00:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-fb37fdd0-3f39-4713-a336-9ae8abbe04ef tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:00:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:00:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:00:23 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 27 03:00:23 user nova-compute[72820]: DEBUG nova.virt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Emitting event <LifecycleEvent: 1693105223.06469, 8811f5aa-3fa1-4878-9ed3-c05913fd7808 => Started> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:00:23 user nova-compute[72820]: INFO nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] VM Started (Lifecycle Event)
Aug 27 03:00:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:00:23 user nova-compute[72820]: DEBUG nova.compute.manager [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72820) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:00:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-fb37fdd0-3f39-4713-a336-9ae8abbe04ef tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.675s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:00:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:23 user nova-compute[72820]: DEBUG nova.compute.manager [req-6436e472-6f89-4628-9bb1-9d2c1584eee0 req-a8d7cbeb-8d04-4696-a198-6ea685f1520a service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received event network-vif-plugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:00:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6436e472-6f89-4628-9bb1-9d2c1584eee0 req-a8d7cbeb-8d04-4696-a198-6ea685f1520a service nova] Acquiring lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:00:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6436e472-6f89-4628-9bb1-9d2c1584eee0 req-a8d7cbeb-8d04-4696-a198-6ea685f1520a service nova] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:00:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-6436e472-6f89-4628-9bb1-9d2c1584eee0 req-a8d7cbeb-8d04-4696-a198-6ea685f1520a service nova] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:00:23 user nova-compute[72820]: DEBUG nova.compute.manager [req-6436e472-6f89-4628-9bb1-9d2c1584eee0 req-a8d7cbeb-8d04-4696-a198-6ea685f1520a service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] No waiting events found dispatching network-vif-plugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:00:23 user nova-compute[72820]: WARNING nova.compute.manager [req-6436e472-6f89-4628-9bb1-9d2c1584eee0 req-a8d7cbeb-8d04-4696-a198-6ea685f1520a service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received unexpected event network-vif-plugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 for instance with vm_state active and task_state None.
Aug 27 03:00:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:29 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:00:32 user nova-compute[72820]: INFO nova.compute.manager [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Detaching volume 92c1928a-0edb-4e1a-abf0-91afbee2a365
Aug 27 03:00:32 user nova-compute[72820]: INFO nova.virt.block_device [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Attempting to driver detach volume 92c1928a-0edb-4e1a-abf0-91afbee2a365 from mountpoint /dev/vdb
Aug 27 03:00:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Attempting to detach device vdb from instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:00:32 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:00:32 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 03:00:32 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:00:32 user nova-compute[72820]:   <serial>92c1928a-0edb-4e1a-abf0-91afbee2a365</serial>
Aug 27 03:00:32 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:00:32 user nova-compute[72820]: </disk>
Aug 27 03:00:32 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:00:32 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Successfully detached device vdb from instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb from the persistent domain config.
Aug 27 03:00:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:00:32 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:00:32 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 03:00:32 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:00:32 user nova-compute[72820]:   <serial>92c1928a-0edb-4e1a-abf0-91afbee2a365</serial>
Aug 27 03:00:32 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:00:32 user nova-compute[72820]: </disk>
Aug 27 03:00:32 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693105232.875123, 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 03:00:32 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Successfully detached device vdb from instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb from the live domain config.
Aug 27 03:00:32 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MaZVETfe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:00:32 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:00:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c67ca5b-1818-4e8d-853f-32df26a9a53a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 03:00:32 user nova-compute[72820]: No targets found.
Aug 27 03:00:32 user nova-compute[72820]: iSNS:
Aug 27 03:00:32 user nova-compute[72820]: No targets found.
Aug 27 03:00:32 user nova-compute[72820]: STATIC:
Aug 27 03:00:32 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388
Aug 27 03:00:32 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 03:00:32 user nova-compute[72820]:                 Iface Name: default
Aug 27 03:00:32 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365
Aug 27 03:00:32 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 03:00:32 user nova-compute[72820]:                 Iface Name: default
Aug 27 03:00:32 user nova-compute[72820]: FIRMWARE:
Aug 27 03:00:32 user nova-compute[72820]: No targets found.
Aug 27 03:00:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 03:00:32 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 03:00:32 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c3f593-4ffc-4a02-83a1-7604de5b555c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[212aa27f-34ad-436c-b58c-663c2109fd8b]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 (non-flash)
Aug 27 03:00:32 user nova-compute[72820]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)
Aug 27 03:00:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 (non-flash)
Aug 27 03:00:32 user nova-compute[72820]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)
Aug 27 03:00:32 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a0388550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365'): ({'sdb'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Removing single pathed devices sdb {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1096e531-8268-4753-b677-92c6c4a2d29f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:32 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab33f01-0abe-4fcc-96f3-00d778155dff]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Flushing IO for device /dev/sdb {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eababd-0bc3-4ceb-bd3b-6288c05dd4ba]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6736423-7119-4b71-ac09-4cf44a76242c]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d088f362-30b7-4fe3-b6e9-7dfbf86e0072]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06a335c-c140-457d-81d6-c683bb80aef6]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365, portal: 172.16.0.220,3260]
Aug 27 03:00:33 user nova-compute[72820]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365, portal: 172.16.0.220,3260] successful.
Aug 27 03:00:33 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92c1928a-0edb-4e1a-abf0-91afbee2a365 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c410f956-8504-4bc9-bf62-6f9afb4591af]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] <== disconnect_volume: return (287ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:00:33 user nova-compute[72820]: DEBUG nova.objects.instance [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lazy-loading 'flavor' on Instance uuid 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:00:34 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-d4d033ac-f3cd-490b-a853-72cb34428389 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.718s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:00:36 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:00:37 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:00:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:00:38 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:38 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:00:38 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:00:38 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:00:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:43 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:00:46 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:00:47 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:00:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:00:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:00:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:00:47 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:00:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:00:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:00:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:00:48 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:00:48 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:00:48 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8447MB free_disk=24.984821319580078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:00:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:00:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:00:48 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:00:48 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 8811f5aa-3fa1-4878-9ed3-c05913fd7808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:00:48 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6e55f01f-98c2-4fb1-a25a-b8082e70eeed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:00:48 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:00:48 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:00:49 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:00:49 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:00:49 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:00:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:00:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:00:55 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:00:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:00:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:00:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:00:55 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:00:55 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updating instance_info_cache with network_info: [{"id": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "address": "fa:16:3e:16:27:7b", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfb2ed3-05", "ovs_interfaceid": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:00:55 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:00:55 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:00:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:01:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:01:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:01:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:01:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:01:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:01:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:01:29 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:01:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:01:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:01:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:01:32 user nova-compute[72820]: DEBUG nova.objects.instance [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lazy-loading 'flavor' on Instance uuid 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:01:32 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:01:33 user nova-compute[72820]: INFO nova.compute.manager [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Attaching volume ae3cb747-be50-4b67-9644-57d48e62bae7 to /dev/vdb
Aug 27 03:01:33 user nova-compute[72820]: DEBUG os_brick.utils [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5781ee-81a8-4f9d-a435-520d01a7c6c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25099e9-b292-497f-85ab-5b20f95451af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe02719-e62f-40db-8f30-daf41d445d9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad6fd9a-42e0-443c-8388-69fea68e9fa6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:01:33 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:01:33 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7d31e5-d4bb-4c18-abb3-8503f289672b]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG os_brick.utils [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:01:33 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Updating existing volume attachment record: 5c25c15a-8413-4b4b-a387-e116ab409f98 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:01:37 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:01:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:01:38 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:01:40 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:01:40 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:01:40 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:01:41 user nova-compute[72820]: DEBUG nova.compute.manager [req-c385d57d-ab44-4ead-9f45-5f17e74a7284 req-776f9042-b274-42d2-9db1-e3961da62354 service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Received event network-changed-7d196b97-5a33-4226-a6cd-7cbe243cc9fa {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:01:41 user nova-compute[72820]: DEBUG nova.compute.manager [req-c385d57d-ab44-4ead-9f45-5f17e74a7284 req-776f9042-b274-42d2-9db1-e3961da62354 service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Refreshing instance network info cache due to event network-changed-7d196b97-5a33-4226-a6cd-7cbe243cc9fa. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:01:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c385d57d-ab44-4ead-9f45-5f17e74a7284 req-776f9042-b274-42d2-9db1-e3961da62354 service nova] Acquiring lock "refresh_cache-6e55f01f-98c2-4fb1-a25a-b8082e70eeed" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:01:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c385d57d-ab44-4ead-9f45-5f17e74a7284 req-776f9042-b274-42d2-9db1-e3961da62354 service nova] Acquired lock "refresh_cache-6e55f01f-98c2-4fb1-a25a-b8082e70eeed" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:01:41 user nova-compute[72820]: DEBUG nova.network.neutron [req-c385d57d-ab44-4ead-9f45-5f17e74a7284 req-776f9042-b274-42d2-9db1-e3961da62354 service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Refreshing network info cache for port 7d196b97-5a33-4226-a6cd-7cbe243cc9fa {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:01:41 user nova-compute[72820]: DEBUG nova.network.neutron [req-c385d57d-ab44-4ead-9f45-5f17e74a7284 req-776f9042-b274-42d2-9db1-e3961da62354 service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Updated VIF entry in instance network info cache for port 7d196b97-5a33-4226-a6cd-7cbe243cc9fa. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:01:41 user nova-compute[72820]: DEBUG nova.network.neutron [req-c385d57d-ab44-4ead-9f45-5f17e74a7284 req-776f9042-b274-42d2-9db1-e3961da62354 service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Updating instance_info_cache with network_info: [{"id": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "address": "fa:16:3e:86:34:c6", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d196b97-5a", "ovs_interfaceid": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:01:41 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-c385d57d-ab44-4ead-9f45-5f17e74a7284 req-776f9042-b274-42d2-9db1-e3961da62354 service nova] Releasing lock "refresh_cache-6e55f01f-98c2-4fb1-a25a-b8082e70eeed" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:01:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:01:43 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAieXPRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:01:44 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:01:44 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:01:44 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cf49a4-a461-4c49-b7bf-d7214d85a025]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:01:44 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa15150-b189-42af-8052-fb1002e1a3d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7] added
Aug 27 03:01:44 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f975e7ae-9f8f-4520-8416-c41746dc4cd7]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fffd14-5e90-44db-8135-e3aca387031c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SAieXPRl {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SAieXPRl" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedefcd5-83de-494c-b5bc-aaaa54f2ad44]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SAieXPRl'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d15ed1-6056-4736-a85f-5852a3343711]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aacca7-50ac-45cb-acb8-610a0027a539]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)
Aug 27 03:01:44 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)
Aug 27 03:01:44 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccfe3b9-bd4f-4a15-adbf-22fca2f105ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7, portal: 172.16.0.220,3260]
Aug 27 03:01:44 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7, portal: 172.16.0.220,3260] successful.
Aug 27 03:01:44 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[be933e2c-2a5c-4580-894e-08a5f8be699c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca53d59-9344-4e12-843a-d08d72d0b07e]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)
Aug 27 03:01:44 user nova-compute[72820]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 (non-flash)
Aug 27 03:01:44 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)
Aug 27 03:01:44 user nova-compute[72820]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 (non-flash)
Aug 27 03:01:44 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[969b15b6-6e08-4eb3-87e2-969d6f36c90b]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:01:44 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAieXPRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:01:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:01:45 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26236336361356365', 'path': '/dev/sdb'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:01:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236336361356365', 'path': '/dev/sdb'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:01:45 user nova-compute[72820]: DEBUG nova.objects.instance [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lazy-loading 'flavor' on Instance uuid 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:01:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 03:01:45 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:01:45 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 03:01:45 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:01:45 user nova-compute[72820]:   <serial>ae3cb747-be50-4b67-9644-57d48e62bae7</serial>
Aug 27 03:01:45 user nova-compute[72820]: </disk>
Aug 27 03:01:45 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:01:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:01:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:01:45 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] No VIF found with MAC fa:16:3e:39:1d:d2, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:01:45 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ce01416-334d-4bc6-8fd5-3747dde0c13c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.798s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG nova.objects.instance [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lazy-loading 'flavor' on Instance uuid 6e55f01f-98c2-4fb1-a25a-b8082e70eeed {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:01:46 user nova-compute[72820]: INFO nova.compute.manager [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Attaching volume f91764eb-5918-41a0-8a94-ef9081b4d138 to /dev/vdb
Aug 27 03:01:46 user nova-compute[72820]: DEBUG os_brick.utils [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[071ab4f7-aafd-4c70-8716-3e298fa0d30b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[084a87ff-4040-4590-ba86-9f1efe434d79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded884e0-e0ea-40ae-942d-cdd596e6b734]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13a6087-9fda-4b4f-909a-14d2c9b485c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:01:46 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:01:46 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4fdcf1-4a65-4cdb-9a4f-c8cee50a0569]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG os_brick.utils [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:01:46 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Updating existing volume attachment record: 8598dfc5-f8f4-4d57-8064-f1c57e114b3c {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:01:47 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:01:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:01:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:01:47 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:01:47 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:01:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:01:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:47 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:01:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:47 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:48 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:01:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:48 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:01:48 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:01:48 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:01:48 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8499MB free_disk=24.983592987060547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:01:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:01:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:01:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:01:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:01:48 user nova-compute[72820]: INFO nova.compute.manager [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Detaching volume ae3cb747-be50-4b67-9644-57d48e62bae7
Aug 27 03:01:49 user nova-compute[72820]: INFO nova.virt.block_device [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Attempting to driver detach volume ae3cb747-be50-4b67-9644-57d48e62bae7 from mountpoint /dev/vdb
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Attempting to detach device vdb from instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:01:49 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:01:49 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 03:01:49 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:01:49 user nova-compute[72820]:   <serial>ae3cb747-be50-4b67-9644-57d48e62bae7</serial>
Aug 27 03:01:49 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:01:49 user nova-compute[72820]: </disk>
Aug 27 03:01:49 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:01:49 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Successfully detached device vdb from instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb from the persistent domain config.
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:01:49 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:01:49 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 03:01:49 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:01:49 user nova-compute[72820]:   <serial>ae3cb747-be50-4b67-9644-57d48e62bae7</serial>
Aug 27 03:01:49 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:01:49 user nova-compute[72820]: </disk>
Aug 27 03:01:49 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 8811f5aa-3fa1-4878-9ed3-c05913fd7808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6e55f01f-98c2-4fb1-a25a-b8082e70eeed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing inventories for resource provider a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Updating ProviderTree inventory for provider a962b30a-2750-431c-be10-075d0f991065 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Updating inventory in ProviderTree for provider a962b30a-2750-431c-be10-075d0f991065 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing aggregate associations for resource provider a962b30a-2750-431c-be10-075d0f991065, aggregates: None {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing trait associations for resource provider a962b30a-2750-431c-be10-075d0f991065, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693105309.5717964, 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 03:01:49 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Successfully detached device vdb from instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb from the live domain config.
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAieXPRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:01:49 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bc4168-f93d-4655-bf98-030b45033a04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 03:01:49 user nova-compute[72820]: No targets found.
Aug 27 03:01:49 user nova-compute[72820]: iSNS:
Aug 27 03:01:49 user nova-compute[72820]: No targets found.
Aug 27 03:01:49 user nova-compute[72820]: STATIC:
Aug 27 03:01:49 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7
Aug 27 03:01:49 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 03:01:49 user nova-compute[72820]:                 Iface Name: default
Aug 27 03:01:49 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388
Aug 27 03:01:49 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 03:01:49 user nova-compute[72820]:                 Iface Name: default
Aug 27 03:01:49 user nova-compute[72820]: FIRMWARE:
Aug 27 03:01:49 user nova-compute[72820]: No targets found.
Aug 27 03:01:49 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 03:01:49 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 03:01:49 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc3f0a5-b602-47cb-9ed9-8083344d1f69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf43c0c0-c16c-44ae-bf02-85df2368fea4]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)
Aug 27 03:01:49 user nova-compute[72820]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 (non-flash)
Aug 27 03:01:49 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)
Aug 27 03:01:49 user nova-compute[72820]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 (non-flash)
Aug 27 03:01:49 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a0420940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7'): ({'sdb'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Removing single pathed devices sdb {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36f02a7-c047-481b-8d16-5a99c9849c2a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5e7bdf-afe2-4a26-ab71-7001b79a6a85]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Flushing IO for device /dev/sdb {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d03e1d5-2b66-410c-af8a-5e55cd079819]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6866cf3b-f035-4ca1-a372-ee84d7a2c420]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab7d8b2-9639-4c82-978a-7e9c6fd390e0]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[577fc077-95df-4b3e-b2e5-1ffeff565cf5]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7, portal: 172.16.0.220,3260]
Aug 27 03:01:49 user nova-compute[72820]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7, portal: 172.16.0.220,3260] successful.
Aug 27 03:01:49 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3cb747-be50-4b67-9644-57d48e62bae7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce83c383-8634-4c30-8c6c-840988b48629]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] <== disconnect_volume: return (308ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:01:49 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:01:50 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:01:50 user nova-compute[72820]: DEBUG nova.objects.instance [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lazy-loading 'flavor' on Instance uuid 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:01:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-52d39d4f-60f8-461a-b4e3-95526e33d41c tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.716s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:01:52 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:01:52 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 03:01:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:01:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:01:54 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:01:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:01:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 03:01:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:01:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:01:54 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:01:54 user nova-compute[72820]: DEBUG nova.objects.instance [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lazy-loading 'info_cache' on Instance uuid 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:01:54 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Updating instance_info_cache with network_info: [{"id": "bab32c26-3329-444a-a85b-d799d989001b", "address": "fa:16:3e:39:1d:d2", "network": {"id": "60f55925-2c0c-4cb5-8594-5077a5ad46c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-573392329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cac0972a24bb4362ab3d814a870cb3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab32c26-33", "ovs_interfaceid": "bab32c26-3329-444a-a85b-d799d989001b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:01:54 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:01:54 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qeMNPEDB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:01:57 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:01:57 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:01:57 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[251b1136-5e2e-4c5b-836b-a39b1c99f5f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:01:57 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c62e996-9b72-4483-a70a-194d72c3af9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138] added
Aug 27 03:01:57 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbeefcf-6a7b-40b1-8e25-ce6cd2619de3]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a404e69d-8289-4fce-831a-ff14c83d8e96]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qeMNPEDB {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qeMNPEDB" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1328e64b-4ead-4c28-90d4-9b9ce40c073a]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qeMNPEDB'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[795bc35e-f9a1-49bf-8352-0d6ecb95dbce]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f639f21a-45fb-48f4-a578-a3c14765bbd5]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)
Aug 27 03:01:57 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)
Aug 27 03:01:57 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[79845339-8cf6-462f-b570-94f71e881ac9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138, portal: 172.16.0.220,3260]
Aug 27 03:01:57 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138, portal: 172.16.0.220,3260] successful.
Aug 27 03:01:57 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c578d9b-4f51-4bbd-b311-398292d1db2c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc29532-7349-4f5f-b468-4d0752141e91]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)
Aug 27 03:01:57 user nova-compute[72820]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 (non-flash)
Aug 27 03:01:57 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)
Aug 27 03:01:57 user nova-compute[72820]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 (non-flash)
Aug 27 03:01:57 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c207986-6c9f-4230-b462-850ed866fabc]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:01:57 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:01:58 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:01:58 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:01:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qeMNPEDB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:01:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:01:58 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23036336566363133', 'path': '/dev/sdb'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:01:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036336566363133', 'path': '/dev/sdb'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:01:58 user nova-compute[72820]: DEBUG nova.objects.instance [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lazy-loading 'flavor' on Instance uuid 6e55f01f-98c2-4fb1-a25a-b8082e70eeed {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:01:58 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 03:01:58 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:01:58 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 03:01:58 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:01:58 user nova-compute[72820]:   <serial>f91764eb-5918-41a0-8a94-ef9081b4d138</serial>
Aug 27 03:01:58 user nova-compute[72820]: </disk>
Aug 27 03:01:58 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:01:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:01:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:01:59 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] No VIF found with MAC fa:16:3e:86:34:c6, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:01:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-41b22f7b-f488-4b67-a308-6565e81215ea tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.811s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:02:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:02:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:02:00 user nova-compute[72820]: INFO nova.compute.manager [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Detaching volume f91764eb-5918-41a0-8a94-ef9081b4d138
Aug 27 03:02:00 user nova-compute[72820]: INFO nova.virt.block_device [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Attempting to driver detach volume f91764eb-5918-41a0-8a94-ef9081b4d138 from mountpoint /dev/vdb
Aug 27 03:02:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Attempting to detach device vdb from instance 6e55f01f-98c2-4fb1-a25a-b8082e70eeed from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:02:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:02:00 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:02:00 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 03:02:00 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:02:00 user nova-compute[72820]:   <serial>f91764eb-5918-41a0-8a94-ef9081b4d138</serial>
Aug 27 03:02:00 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:02:00 user nova-compute[72820]: </disk>
Aug 27 03:02:00 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:02:00 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Successfully detached device vdb from instance 6e55f01f-98c2-4fb1-a25a-b8082e70eeed from the persistent domain config.
Aug 27 03:02:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6e55f01f-98c2-4fb1-a25a-b8082e70eeed from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 03:02:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:02:00 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:02:00 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 03:02:00 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:02:00 user nova-compute[72820]:   <serial>f91764eb-5918-41a0-8a94-ef9081b4d138</serial>
Aug 27 03:02:00 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:02:00 user nova-compute[72820]: </disk>
Aug 27 03:02:00 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693105321.0321388, 6e55f01f-98c2-4fb1-a25a-b8082e70eeed => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6e55f01f-98c2-4fb1-a25a-b8082e70eeed {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 03:02:01 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Successfully detached device vdb from instance 6e55f01f-98c2-4fb1-a25a-b8082e70eeed from the live domain config.
Aug 27 03:02:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qeMNPEDB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:02:01 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fe2280-fe01-4857-8df2-eeba538b6fc9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 03:02:01 user nova-compute[72820]: No targets found.
Aug 27 03:02:01 user nova-compute[72820]: iSNS:
Aug 27 03:02:01 user nova-compute[72820]: No targets found.
Aug 27 03:02:01 user nova-compute[72820]: STATIC:
Aug 27 03:02:01 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138
Aug 27 03:02:01 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 03:02:01 user nova-compute[72820]:                 Iface Name: default
Aug 27 03:02:01 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388
Aug 27 03:02:01 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 03:02:01 user nova-compute[72820]:                 Iface Name: default
Aug 27 03:02:01 user nova-compute[72820]: FIRMWARE:
Aug 27 03:02:01 user nova-compute[72820]: No targets found.
Aug 27 03:02:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 03:02:01 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 03:02:01 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5c77eb-8eaa-4f15-9790-1f35415af39e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[93203bb5-4217-47a7-b5af-668a0561d0ad]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)
Aug 27 03:02:01 user nova-compute[72820]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 (non-flash)
Aug 27 03:02:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)
Aug 27 03:02:01 user nova-compute[72820]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 (non-flash)
Aug 27 03:02:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a05976d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138'): ({'sdb'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Removing single pathed devices sdb {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a7ed90-bba9-4d8f-a7ad-2067b67b93f4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a14d843-bb7b-4186-8513-de2c390b5185]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Flushing IO for device /dev/sdb {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd6d7ba-61cc-4790-a09d-be375e29f01e]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c62a9a7-c9bf-4a5e-b02a-04d404f6c736]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ac3b31-8511-46c9-b3c7-e3eed73ac971]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6012f7ce-abb3-47c3-8097-3b490f16e8a5]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138, portal: 172.16.0.220,3260]
Aug 27 03:02:01 user nova-compute[72820]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138, portal: 172.16.0.220,3260] successful.
Aug 27 03:02:01 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f91764eb-5918-41a0-8a94-ef9081b4d138 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c134e2f-8a16-4fcc-a168-47b6f3cb8373]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] <== disconnect_volume: return (306ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:02:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:02:02 user nova-compute[72820]: DEBUG nova.objects.instance [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lazy-loading 'flavor' on Instance uuid 6e55f01f-98c2-4fb1-a25a-b8082e70eeed {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:02:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-1d326d76-17b8-48de-9f6b-2d0986e32c22 tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.628s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:02:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:03 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:02:03 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 03:02:03 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] There are 0 instances to clean {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 03:02:05 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:02:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-d68ddda9-437a-49ee-bf24-9417ff3459d5 req-5d35b215-cf75-49a2-a6dd-47b3204b7290 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received event network-changed-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:02:07 user nova-compute[72820]: DEBUG nova.compute.manager [req-d68ddda9-437a-49ee-bf24-9417ff3459d5 req-5d35b215-cf75-49a2-a6dd-47b3204b7290 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Refreshing instance network info cache due to event network-changed-9cfb2ed3-052d-49fa-8e62-495bfc033d19. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:02:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d68ddda9-437a-49ee-bf24-9417ff3459d5 req-5d35b215-cf75-49a2-a6dd-47b3204b7290 service nova] Acquiring lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:02:07 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d68ddda9-437a-49ee-bf24-9417ff3459d5 req-5d35b215-cf75-49a2-a6dd-47b3204b7290 service nova] Acquired lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:02:07 user nova-compute[72820]: DEBUG nova.network.neutron [req-d68ddda9-437a-49ee-bf24-9417ff3459d5 req-5d35b215-cf75-49a2-a6dd-47b3204b7290 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Refreshing network info cache for port 9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG nova.network.neutron [req-d68ddda9-437a-49ee-bf24-9417ff3459d5 req-5d35b215-cf75-49a2-a6dd-47b3204b7290 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updated VIF entry in instance network info cache for port 9cfb2ed3-052d-49fa-8e62-495bfc033d19. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG nova.network.neutron [req-d68ddda9-437a-49ee-bf24-9417ff3459d5 req-5d35b215-cf75-49a2-a6dd-47b3204b7290 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updating instance_info_cache with network_info: [{"id": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "address": "fa:16:3e:16:27:7b", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfb2ed3-05", "ovs_interfaceid": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d68ddda9-437a-49ee-bf24-9417ff3459d5 req-5d35b215-cf75-49a2-a6dd-47b3204b7290 service nova] Releasing lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:02:08 user nova-compute[72820]: INFO nova.compute.manager [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Detaching volume 5eb8acd3-4512-489b-8f1a-c1f472375388
Aug 27 03:02:08 user nova-compute[72820]: INFO nova.virt.block_device [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Attempting to driver detach volume 5eb8acd3-4512-489b-8f1a-c1f472375388 from mountpoint /dev/vdb
Aug 27 03:02:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Attempting to detach device vdb from instance 8811f5aa-3fa1-4878-9ed3-c05913fd7808 from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:02:08 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:02:08 user nova-compute[72820]:   <source dev="/dev/sdc"/>
Aug 27 03:02:08 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:02:08 user nova-compute[72820]:   <serial>5eb8acd3-4512-489b-8f1a-c1f472375388</serial>
Aug 27 03:02:08 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:02:08 user nova-compute[72820]: </disk>
Aug 27 03:02:08 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:02:08 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Successfully detached device vdb from instance 8811f5aa-3fa1-4878-9ed3-c05913fd7808 from the persistent domain config.
Aug 27 03:02:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8811f5aa-3fa1-4878-9ed3-c05913fd7808 from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:02:08 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:02:08 user nova-compute[72820]:   <source dev="/dev/sdc"/>
Aug 27 03:02:08 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:02:08 user nova-compute[72820]:   <serial>5eb8acd3-4512-489b-8f1a-c1f472375388</serial>
Aug 27 03:02:08 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:02:08 user nova-compute[72820]: </disk>
Aug 27 03:02:08 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693105328.878395, 8811f5aa-3fa1-4878-9ed3-c05913fd7808 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8811f5aa-3fa1-4878-9ed3-c05913fd7808 {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 03:02:08 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Successfully detached device vdb from instance 8811f5aa-3fa1-4878-9ed3-c05913fd7808 from the live domain config.
Aug 27 03:02:08 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbVSKkoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:02:08 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:02:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddb0e12-f840-4ecf-80c2-748893ef3da6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 03:02:08 user nova-compute[72820]: No targets found.
Aug 27 03:02:08 user nova-compute[72820]: iSNS:
Aug 27 03:02:08 user nova-compute[72820]: No targets found.
Aug 27 03:02:08 user nova-compute[72820]: STATIC:
Aug 27 03:02:08 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388
Aug 27 03:02:08 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 03:02:08 user nova-compute[72820]:                 Iface Name: default
Aug 27 03:02:08 user nova-compute[72820]: FIRMWARE:
Aug 27 03:02:08 user nova-compute[72820]: No targets found.
Aug 27 03:02:08 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 03:02:08 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 03:02:08 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6a7c5f-153b-40cf-91d6-f676c343a10a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0f59e0-ef3c-4712-9b8a-1841c4d0f34f]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)
Aug 27 03:02:08 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 (non-flash)
Aug 27 03:02:08 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a0596680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388'): ({'sdc'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Removing single pathed devices sdc {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:02:08 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1fe4f8-eeed-4581-95d3-f1f59b26283d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d02d20e-c32a-4198-8b81-cbbceb3b2b06]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Flushing IO for device /dev/sdc {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cde5e4a-7fd5-434a-8b37-5d9f29fc4b4c]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[90531b30-20c1-4110-9956-6d4ffefd6b2e]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] SCSI volumes sdc have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c9a02c-074c-46fa-9846-20aaafaa8c8a]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c28a77-b342-4c63-93cd-01242bc0594e]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388, portal: 172.16.0.220,3260]
Aug 27 03:02:09 user nova-compute[72820]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388, portal: 172.16.0.220,3260] successful.
Aug 27 03:02:09 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb8acd3-4512-489b-8f1a-c1f472375388 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd7edaf-4050-4c79-9923-f9926783f51d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] <== disconnect_volume: return (294ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG nova.compute.manager [req-786cdae6-ee7d-4996-8b16-eb96ba7aec07 req-a1f25cca-6019-4d1a-8f1e-b01c6eec07ed service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received event network-changed-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG nova.compute.manager [req-786cdae6-ee7d-4996-8b16-eb96ba7aec07 req-a1f25cca-6019-4d1a-8f1e-b01c6eec07ed service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Refreshing instance network info cache due to event network-changed-9cfb2ed3-052d-49fa-8e62-495bfc033d19. {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-786cdae6-ee7d-4996-8b16-eb96ba7aec07 req-a1f25cca-6019-4d1a-8f1e-b01c6eec07ed service nova] Acquiring lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-786cdae6-ee7d-4996-8b16-eb96ba7aec07 req-a1f25cca-6019-4d1a-8f1e-b01c6eec07ed service nova] Acquired lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG nova.network.neutron [req-786cdae6-ee7d-4996-8b16-eb96ba7aec07 req-a1f25cca-6019-4d1a-8f1e-b01c6eec07ed service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Refreshing network info cache for port 9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:02:09 user nova-compute[72820]: DEBUG nova.objects.instance [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lazy-loading 'flavor' on Instance uuid 8811f5aa-3fa1-4878-9ed3-c05913fd7808 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:02:10 user nova-compute[72820]: DEBUG nova.network.neutron [req-786cdae6-ee7d-4996-8b16-eb96ba7aec07 req-a1f25cca-6019-4d1a-8f1e-b01c6eec07ed service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updated VIF entry in instance network info cache for port 9cfb2ed3-052d-49fa-8e62-495bfc033d19. {{(pid=72820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:02:10 user nova-compute[72820]: DEBUG nova.network.neutron [req-786cdae6-ee7d-4996-8b16-eb96ba7aec07 req-a1f25cca-6019-4d1a-8f1e-b01c6eec07ed service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updating instance_info_cache with network_info: [{"id": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "address": "fa:16:3e:16:27:7b", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfb2ed3-05", "ovs_interfaceid": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:02:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-58a82af4-d31a-479d-87af-1968236f250b tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.666s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:02:10 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-786cdae6-ee7d-4996-8b16-eb96ba7aec07 req-a1f25cca-6019-4d1a-8f1e-b01c6eec07ed service nova] Releasing lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:02:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:13 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:02:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 03:02:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:02:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:02:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:02:29 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:02:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:33 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:02:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:02:38 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:02:39 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:02:40 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:02:40 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:02:41 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:02:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:02:47 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:02:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:02:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 03:02:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:02:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:02:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:48 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:02:48 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:02:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:02:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:02:48 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:02:48 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:02:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:48 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG nova.objects.instance [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lazy-loading 'flavor' on Instance uuid 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:02:49 user nova-compute[72820]: INFO nova.compute.manager [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Attaching volume 9d22e5e1-9b78-4f44-9430-e9f5188f4b82 to /dev/vdb
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG os_brick.utils [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[397b1134-c54b-4a17-bead-ce1337b47346]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dbb9c7-b9c3-4f24-940b-bebf29baf35f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:49 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:02:49 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:02:49 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8531MB free_disk=24.982208251953125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b08251-8dd2-4dfd-984c-8db549b8814b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48da530-5909-4fe0-9842-e9ba69bdc365]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:02:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:02:50 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:02:50 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6113ac-1f89-4650-a90f-c4c51164cdc3]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG os_brick.utils [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] <== get_connector_properties: return (497ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Updating existing volume attachment record: 630dcb7c-a430-41e2-83bb-b5b0c60b0dec {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 8811f5aa-3fa1-4878-9ed3-c05913fd7808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 6e55f01f-98c2-4fb1-a25a-b8082e70eeed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:02:50 user nova-compute[72820]: INFO nova.compute.manager [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Terminating instance
Aug 27 03:02:50 user nova-compute[72820]: DEBUG nova.compute.manager [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-ee132e0a-9706-408b-9c8c-a7e57910f70a req-953664f6-c6bd-4796-97a8-c4a4d673494e service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Received event network-vif-unplugged-7d196b97-5a33-4226-a6cd-7cbe243cc9fa {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:02:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ee132e0a-9706-408b-9c8c-a7e57910f70a req-953664f6-c6bd-4796-97a8-c4a4d673494e service nova] Acquiring lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:02:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ee132e0a-9706-408b-9c8c-a7e57910f70a req-953664f6-c6bd-4796-97a8-c4a4d673494e service nova] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:02:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-ee132e0a-9706-408b-9c8c-a7e57910f70a req-953664f6-c6bd-4796-97a8-c4a4d673494e service nova] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:02:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-ee132e0a-9706-408b-9c8c-a7e57910f70a req-953664f6-c6bd-4796-97a8-c4a4d673494e service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] No waiting events found dispatching network-vif-unplugged-7d196b97-5a33-4226-a6cd-7cbe243cc9fa {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:02:51 user nova-compute[72820]: DEBUG nova.compute.manager [req-ee132e0a-9706-408b-9c8c-a7e57910f70a req-953664f6-c6bd-4796-97a8-c4a4d673494e service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Received event network-vif-unplugged-7d196b97-5a33-4226-a6cd-7cbe243cc9fa for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:02:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:51 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Instance destroyed successfully.
Aug 27 03:02:51 user nova-compute[72820]: DEBUG nova.objects.instance [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lazy-loading 'resources' on Instance uuid 6e55f01f-98c2-4fb1-a25a-b8082e70eeed {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:02:51 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-585885270',display_name='tempest-AttachVolumeNegativeTest-server-585885270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-585885270',id=51,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMszfYGD7Ws3KoqAcy7wwuXI7KdFWCY38saHWDVRvQzzdaMKw7cpsifvMOy62DJXlGgAU0TyL9bq1sAz5brqJWsAxD24ngMr8FtfRQ/vUsIsFqyICWrPlPJtXOQi4xgVQ==',key_name='tempest-keypair-265325938',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='117a0b3ffbe84eba93968f924fa7d2e9',ramdisk_id='',reservation_id='r-xrjeui2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2145874992',owner_user_name='tempest-AttachVolumeNegativeTest-2145874992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='391718f05f07460f9388d168d1ebdc98',uuid=6e55f01f-98c2-4fb1-a25a-b8082e70eeed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "address": "fa:16:3e:86:34:c6", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d196b97-5a", "ovs_interfaceid": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:02:51 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converting VIF {"id": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "address": "fa:16:3e:86:34:c6", "network": {"id": "01c95632-df0f-497d-86a9-43a152241c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1137450288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117a0b3ffbe84eba93968f924fa7d2e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d196b97-5a", "ovs_interfaceid": "7d196b97-5a33-4226-a6cd-7cbe243cc9fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:02:51 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:34:c6,bridge_name='br-int',has_traffic_filtering=True,id=7d196b97-5a33-4226-a6cd-7cbe243cc9fa,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d196b97-5a') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:02:51 user nova-compute[72820]: DEBUG os_vif [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:34:c6,bridge_name='br-int',has_traffic_filtering=True,id=7d196b97-5a33-4226-a6cd-7cbe243cc9fa,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d196b97-5a') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:02:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d196b97-5a, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:02:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:51 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:02:51 user nova-compute[72820]: INFO os_vif [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:34:c6,bridge_name='br-int',has_traffic_filtering=True,id=7d196b97-5a33-4226-a6cd-7cbe243cc9fa,network=Network(01c95632-df0f-497d-86a9-43a152241c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d196b97-5a')
Aug 27 03:02:51 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Deleting instance files /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed_del
Aug 27 03:02:51 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Deletion of /opt/stack/data/nova/instances/6e55f01f-98c2-4fb1-a25a-b8082e70eeed_del complete
Aug 27 03:02:51 user nova-compute[72820]: INFO nova.compute.manager [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 27 03:02:51 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:02:51 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:02:51 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:02:52 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:02:52 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Took 0.91 seconds to deallocate network for instance.
Aug 27 03:02:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:02:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:02:52 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:02:52 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:02:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:02:52 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Deleted allocations for instance 6e55f01f-98c2-4fb1-a25a-b8082e70eeed
Aug 27 03:02:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-b5620ab9-bd5d-413e-87f8-24812fdf9cfb tempest-AttachVolumeNegativeTest-2145874992 tempest-AttachVolumeNegativeTest-2145874992-project-member] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.122s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:02:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-04c8c819-8599-4418-8675-93d32da88f76 req-84be4cd4-1043-4bf8-92a4-cbf0a158166e service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Received event network-vif-plugged-7d196b97-5a33-4226-a6cd-7cbe243cc9fa {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:02:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-04c8c819-8599-4418-8675-93d32da88f76 req-84be4cd4-1043-4bf8-92a4-cbf0a158166e service nova] Acquiring lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:02:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-04c8c819-8599-4418-8675-93d32da88f76 req-84be4cd4-1043-4bf8-92a4-cbf0a158166e service nova] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:02:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-04c8c819-8599-4418-8675-93d32da88f76 req-84be4cd4-1043-4bf8-92a4-cbf0a158166e service nova] Lock "6e55f01f-98c2-4fb1-a25a-b8082e70eeed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:02:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-04c8c819-8599-4418-8675-93d32da88f76 req-84be4cd4-1043-4bf8-92a4-cbf0a158166e service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] No waiting events found dispatching network-vif-plugged-7d196b97-5a33-4226-a6cd-7cbe243cc9fa {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:02:53 user nova-compute[72820]: WARNING nova.compute.manager [req-04c8c819-8599-4418-8675-93d32da88f76 req-84be4cd4-1043-4bf8-92a4-cbf0a158166e service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Received unexpected event network-vif-plugged-7d196b97-5a33-4226-a6cd-7cbe243cc9fa for instance with vm_state deleted and task_state None.
Aug 27 03:02:53 user nova-compute[72820]: DEBUG nova.compute.manager [req-04c8c819-8599-4418-8675-93d32da88f76 req-84be4cd4-1043-4bf8-92a4-cbf0a158166e service nova] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Received event network-vif-deleted-7d196b97-5a33-4226-a6cd-7cbe243cc9fa {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:02:53 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:56 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:02:57 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:02:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:02:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:02:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:02:57 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:02:57 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updating instance_info_cache with network_info: [{"id": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "address": "fa:16:3e:16:27:7b", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfb2ed3-05", "ovs_interfaceid": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:02:57 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-8811f5aa-3fa1-4878-9ed3-c05913fd7808" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:02:57 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLIJSahN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:03:00 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:03:00 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:03:00 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b30870a-c109-4260-a3f4-bd32e7f5d77f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:03:00 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48423e4-418f-4eda-bed2-55d11ab7a4bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82] added
Aug 27 03:03:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4c2423-c0f5-4d6b-9c5b-ec0d4dbe668d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe09d93-b5a3-4a50-9cdb-bfae9425fe32]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qLIJSahN {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qLIJSahN" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f5ca10-5016-4ce8-a335-19fad9b81ecc]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qLIJSahN'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[19071da1-b183-4971-8c39-b7d960bf7a8f]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d07981-1376-45bf-a8ab-b6f14dbfe525]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 03:03:00 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 03:03:00 user nova-compute[72820]:  {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:03:00 user nova-compute[72820]: WARNING os_brick.initiator.connectors.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 03:03:00 user nova-compute[72820]: 
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[02efad86-6893-45a8-91de-7f8aa57738c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82, portal: 172.16.0.220,3260]
Aug 27 03:03:00 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82, portal: 172.16.0.220,3260] successful.
Aug 27 03:03:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b7cda9-64e0-4ef3-9680-5c28bd2fb9c4]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0aad77f-de81-4274-b658-c0b27b6144ac]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 (non-flash)
Aug 27 03:03:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 (non-flash)
Aug 27 03:03:00 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3a95d0-43bc-4acc-ae18-f35c09dc3674]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:03:00 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLIJSahN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:03:01 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:03:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:03:01 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23739303430303732', 'path': '/dev/sdb'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:03:01 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739303430303732', 'path': '/dev/sdb'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:03:02 user nova-compute[72820]: DEBUG nova.objects.instance [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lazy-loading 'flavor' on Instance uuid 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:03:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 03:03:02 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:03:02 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 03:03:02 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:03:02 user nova-compute[72820]:   <serial>9d22e5e1-9b78-4f44-9430-e9f5188f4b82</serial>
Aug 27 03:03:02 user nova-compute[72820]: </disk>
Aug 27 03:03:02 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:03:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:03:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:03:02 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] No VIF found with MAC fa:16:3e:39:1d:d2, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:03:02 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2ba0ae31-fadf-4274-9f56-6c69f08f3ddb tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.145s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:03:03 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:03:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:03:04 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:03:04 user nova-compute[72820]: INFO nova.compute.manager [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Detaching volume 9d22e5e1-9b78-4f44-9430-e9f5188f4b82
Aug 27 03:03:04 user nova-compute[72820]: INFO nova.virt.block_device [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Attempting to driver detach volume 9d22e5e1-9b78-4f44-9430-e9f5188f4b82 from mountpoint /dev/vdb
Aug 27 03:03:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Attempting to detach device vdb from instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:03:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:03:04 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:03:04 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 03:03:04 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:03:04 user nova-compute[72820]:   <serial>9d22e5e1-9b78-4f44-9430-e9f5188f4b82</serial>
Aug 27 03:03:04 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:03:04 user nova-compute[72820]: </disk>
Aug 27 03:03:04 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:03:04 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Successfully detached device vdb from instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb from the persistent domain config.
Aug 27 03:03:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 03:03:04 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:03:04 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:03:04 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 03:03:04 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:03:04 user nova-compute[72820]:   <serial>9d22e5e1-9b78-4f44-9430-e9f5188f4b82</serial>
Aug 27 03:03:04 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:03:04 user nova-compute[72820]: </disk>
Aug 27 03:03:04 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693105385.4296374, 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 03:03:05 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Successfully detached device vdb from instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb from the live domain config.
Aug 27 03:03:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLIJSahN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:03:05 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff3c7ae-f18c-4fe0-9280-0fce31cc6c55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 03:03:05 user nova-compute[72820]: No targets found.
Aug 27 03:03:05 user nova-compute[72820]: iSNS:
Aug 27 03:03:05 user nova-compute[72820]: No targets found.
Aug 27 03:03:05 user nova-compute[72820]: STATIC:
Aug 27 03:03:05 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82
Aug 27 03:03:05 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 03:03:05 user nova-compute[72820]:                 Iface Name: default
Aug 27 03:03:05 user nova-compute[72820]: FIRMWARE:
Aug 27 03:03:05 user nova-compute[72820]: No targets found.
Aug 27 03:03:05 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 03:03:05 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 03:03:05 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fc416a-711d-4361-b8a1-fba55ebcebeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[505337ec-b78f-4976-9c11-6552b34bc9ce]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 (non-flash)
Aug 27 03:03:05 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 (non-flash)
Aug 27 03:03:05 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75c0432950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82'): ({'sdb'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Removing single pathed devices sdb {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea10fef7-827b-4096-9938-d2874b2f18f1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31332f0-7a60-4f96-8c03-c35abb50c5b5]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Flushing IO for device /dev/sdb {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ebccb3-7c15-423e-a9a6-7af568fb2875]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[336cc2b1-5b64-4d02-a690-94157e597a77]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e02d9d-0786-4155-a6fa-8b54b5781625]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[146b0269-3944-4f9e-9d77-e085d7409a3e]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82, portal: 172.16.0.220,3260]
Aug 27 03:03:05 user nova-compute[72820]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82, portal: 172.16.0.220,3260] successful.
Aug 27 03:03:05 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22e5e1-9b78-4f44-9430-e9f5188f4b82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ec3e98-e5ba-46d8-8a52-b0d01661a0f3]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] <== disconnect_volume: return (321ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:03:05 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:03:06 user nova-compute[72820]: DEBUG nova.objects.instance [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lazy-loading 'flavor' on Instance uuid 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:03:06 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693105371.5951982, 6e55f01f-98c2-4fb1-a25a-b8082e70eeed => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:03:06 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] VM Stopped (Lifecycle Event)
Aug 27 03:03:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-bfda836d-c0ef-43b3-9996-55f5159d0d01 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.759s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:03:06 user nova-compute[72820]: DEBUG nova.compute.manager [None req-f6b6a11d-1e41-47c4-b213-69460344a78c None None] [instance: 6e55f01f-98c2-4fb1-a25a-b8082e70eeed] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:03:06 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:03:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:03:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:03:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:03:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:03:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:03:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:03:09 user nova-compute[72820]: INFO nova.compute.manager [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Terminating instance
Aug 27 03:03:09 user nova-compute[72820]: DEBUG nova.compute.manager [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:03:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:03:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:03:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:03:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:03:09 user nova-compute[72820]: DEBUG nova.compute.manager [req-645077eb-4b1f-4834-8ded-7e2df8586c97 req-58fbefc8-4dbc-4fd4-a31f-cbba274a3a5e service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received event network-vif-unplugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:03:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-645077eb-4b1f-4834-8ded-7e2df8586c97 req-58fbefc8-4dbc-4fd4-a31f-cbba274a3a5e service nova] Acquiring lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:03:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-645077eb-4b1f-4834-8ded-7e2df8586c97 req-58fbefc8-4dbc-4fd4-a31f-cbba274a3a5e service nova] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:03:09 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-645077eb-4b1f-4834-8ded-7e2df8586c97 req-58fbefc8-4dbc-4fd4-a31f-cbba274a3a5e service nova] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:03:09 user nova-compute[72820]: DEBUG nova.compute.manager [req-645077eb-4b1f-4834-8ded-7e2df8586c97 req-58fbefc8-4dbc-4fd4-a31f-cbba274a3a5e service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] No waiting events found dispatching network-vif-unplugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:03:09 user nova-compute[72820]: DEBUG nova.compute.manager [req-645077eb-4b1f-4834-8ded-7e2df8586c97 req-58fbefc8-4dbc-4fd4-a31f-cbba274a3a5e service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received event network-vif-unplugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:03:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:03:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:03:10 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Instance destroyed successfully.
Aug 27 03:03:10 user nova-compute[72820]: DEBUG nova.objects.instance [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lazy-loading 'resources' on Instance uuid 8811f5aa-3fa1-4878-9ed3-c05913fd7808 {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:03:10 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:58:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-64352634',display_name='tempest-TestMinimumBasicScenario-server-64352634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-64352634',id=50,image_ref='83d1620c-e3f7-4390-ba3b-8df656bf0a7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAk1Sl7rSBqRUjIVi5LM8IiKkqyqSNd5NtkxFGlOMAjcboeJx4SGEZAJeIK3njEXIe+YIXi/JflOw+wt0fNH/TeMgRiyAZFyPzbbHYT9ovoTNBaKIWeglVeKOjsGbO5Aw==',key_name='tempest-TestMinimumBasicScenario-64515797',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:58:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54352cfd7c104bd9acb2d479ccefc214',ramdisk_id='',reservation_id='r-wa105tea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='83d1620c-e3f7-4390-ba3b-8df656bf0a7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-181769521',owner_user_name='tempest-TestMinimumBasicScenario-181769521-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:00:23Z,user_data=None,user_id='a767e402c070429caad7dd8a4cedf72d',uuid=8811f5aa-3fa1-4878-9ed3-c05913fd7808,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "address": "fa:16:3e:16:27:7b", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfb2ed3-05", "ovs_interfaceid": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:03:10 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Converting VIF {"id": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "address": "fa:16:3e:16:27:7b", "network": {"id": "2a442436-ba81-4e2c-9e8e-88dd5c535983", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1327064071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54352cfd7c104bd9acb2d479ccefc214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfb2ed3-05", "ovs_interfaceid": "9cfb2ed3-052d-49fa-8e62-495bfc033d19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:03:10 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=9cfb2ed3-052d-49fa-8e62-495bfc033d19,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cfb2ed3-05') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:03:10 user nova-compute[72820]: DEBUG os_vif [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=9cfb2ed3-052d-49fa-8e62-495bfc033d19,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cfb2ed3-05') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:03:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:03:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cfb2ed3-05, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:03:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:03:10 user nova-compute[72820]: INFO os_vif [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=9cfb2ed3-052d-49fa-8e62-495bfc033d19,network=Network(2a442436-ba81-4e2c-9e8e-88dd5c535983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cfb2ed3-05')
Aug 27 03:03:10 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Deleting instance files /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808_del
Aug 27 03:03:10 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Deletion of /opt/stack/data/nova/instances/8811f5aa-3fa1-4878-9ed3-c05913fd7808_del complete
Aug 27 03:03:10 user nova-compute[72820]: INFO nova.compute.manager [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 27 03:03:10 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:03:10 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:03:10 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:03:11 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:03:11 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Took 0.88 seconds to deallocate network for instance.
Aug 27 03:03:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-0c5caa98-23a0-4f56-99dc-0c93ef6c9100 req-f8399a46-da31-43b1-b63e-00bfcf6fb594 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received event network-vif-deleted-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:03:11 user nova-compute[72820]: INFO nova.compute.manager [req-0c5caa98-23a0-4f56-99dc-0c93ef6c9100 req-f8399a46-da31-43b1-b63e-00bfcf6fb594 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Neutron deleted interface 9cfb2ed3-052d-49fa-8e62-495bfc033d19; detaching it from the instance and deleting it from the info cache
Aug 27 03:03:11 user nova-compute[72820]: DEBUG nova.network.neutron [req-0c5caa98-23a0-4f56-99dc-0c93ef6c9100 req-f8399a46-da31-43b1-b63e-00bfcf6fb594 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:03:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-0c5caa98-23a0-4f56-99dc-0c93ef6c9100 req-f8399a46-da31-43b1-b63e-00bfcf6fb594 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Detach interface failed, port_id=9cfb2ed3-052d-49fa-8e62-495bfc033d19, reason: Instance 8811f5aa-3fa1-4878-9ed3-c05913fd7808 could not be found. {{(pid=72820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 03:03:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:03:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:03:11 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:03:11 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:03:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:03:11 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Deleted allocations for instance 8811f5aa-3fa1-4878-9ed3-c05913fd7808
Aug 27 03:03:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-ddbc33da-2054-4c04-ac68-99ab899ccde4 tempest-TestMinimumBasicScenario-181769521 tempest-TestMinimumBasicScenario-181769521-project-member] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.062s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:03:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-323513d5-21eb-4af7-b861-e08aa1f6ec37 req-bf4f0ff5-4706-4d7f-a0ef-f3b404de71f4 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received event network-vif-plugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:03:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-323513d5-21eb-4af7-b861-e08aa1f6ec37 req-bf4f0ff5-4706-4d7f-a0ef-f3b404de71f4 service nova] Acquiring lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:03:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-323513d5-21eb-4af7-b861-e08aa1f6ec37 req-bf4f0ff5-4706-4d7f-a0ef-f3b404de71f4 service nova] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:03:11 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-323513d5-21eb-4af7-b861-e08aa1f6ec37 req-bf4f0ff5-4706-4d7f-a0ef-f3b404de71f4 service nova] Lock "8811f5aa-3fa1-4878-9ed3-c05913fd7808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:03:11 user nova-compute[72820]: DEBUG nova.compute.manager [req-323513d5-21eb-4af7-b861-e08aa1f6ec37 req-bf4f0ff5-4706-4d7f-a0ef-f3b404de71f4 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] No waiting events found dispatching network-vif-plugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:03:11 user nova-compute[72820]: WARNING nova.compute.manager [req-323513d5-21eb-4af7-b861-e08aa1f6ec37 req-bf4f0ff5-4706-4d7f-a0ef-f3b404de71f4 service nova] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Received unexpected event network-vif-plugged-9cfb2ed3-052d-49fa-8e62-495bfc033d19 for instance with vm_state deleted and task_state None.
Aug 27 03:03:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:03:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:03:25 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693105390.2344294, 8811f5aa-3fa1-4878-9ed3-c05913fd7808 => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:03:25 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] VM Stopped (Lifecycle Event)
Aug 27 03:03:25 user nova-compute[72820]: DEBUG nova.compute.manager [None req-cf22f24e-c58c-4017-85d6-769d55db6c4e None None] [instance: 8811f5aa-3fa1-4878-9ed3-c05913fd7808] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:03:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:03:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:03:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 03:03:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:03:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:03:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:03:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:03:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:03:34 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:03:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:03:38 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:03:40 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:03:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:03:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:03:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 03:03:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:03:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:03:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:03:40 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:03:40 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:03:42 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:03:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:03:48 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:03:49 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:03:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:03:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:03:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:03:49 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:03:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:03:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:03:50 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:03:50 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:03:50 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8700MB free_disk=25.036712646484375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:03:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:03:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:03:50 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:03:50 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:03:50 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:03:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:03:50 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:03:50 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:03:50 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:03:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:03:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:03:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:03:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:03:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Didn't find any instances for network info cache update. {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 03:04:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:04:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:04:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:04:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG nova.objects.instance [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lazy-loading 'flavor' on Instance uuid 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:04:06 user nova-compute[72820]: INFO nova.compute.manager [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Attaching volume 3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 to /dev/vdb
Aug 27 03:04:06 user nova-compute[72820]: DEBUG os_brick.utils [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bab37e-95d8-4536-a85d-cc3f600ef467]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:354629f690a8\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc884d9-3bb9-4a67-9618-858c42522850]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8f8fc9-dd14-4801-987c-48b4732afdcf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4820e05b-74b4-4e46-8138-72fbc749f0b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Running cmd (subprocess): nvme version {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] 'nvme version' failed. Not Retrying. {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] nvme not present on system {{(pid=72820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:04:06 user nova-compute[72820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:04:06 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8ad05f-63f8-446e-954e-d052547c63de]: (4, '') {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.lightos [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] LIGHTOS: no hostnqn found. {{(pid=72820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG os_brick.utils [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:354629f690a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:04:06 user nova-compute[72820]: DEBUG nova.virt.block_device [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Updating existing volume attachment record: 9fcffb82-f874-4415-8528-ed3429f4dcb5 {{(pid=72820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:04:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:04:08 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:04:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:04:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:04:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Calling os-brick to attach iSCSI Volume {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAUdqpKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:04:17 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:04:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:04:17 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:04:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:04:17 user nova-compute[72820]: INFO os_brick.initiator.connectors.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:04:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60f5023-8f2c-456e-b96d-3ebea57a1bfd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:04:17 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --interface default --op new {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0eee832-eb46-4ed6-bcea-d03084d67d68]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78] added\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78] added
Aug 27 03:04:17 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e0fcde-4c13-4315-973c-735f4b6b8605]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a86ba7-1581-4aad-bf21-3e0773ff2898]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:04:17 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAUdqpKZ {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAUdqpKZ" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97e8026-ee7d-4f3e-862c-5c9b3db0a34d]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nAUdqpKZ'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[30265269-63b9-499a-b850-9070c68ad84a]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22f963f-6fc0-47d4-830d-757657e7480e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 03:04:18 user nova-compute[72820]:  {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 03:04:18 user nova-compute[72820]:  {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:04:18 user nova-compute[72820]: WARNING os_brick.initiator.connectors.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 03:04:18 user nova-compute[72820]: 
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --login {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[66536013-465e-4965-92d6-cc64836b08df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78, portal: 172.16.0.220,3260]
Aug 27 03:04:18 user nova-compute[72820]: Login to [iface: default, target: iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78, portal: 172.16.0.220,3260] successful.
Aug 27 03:04:18 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd2fa5a-77e3-4cf1-a01c-ae61110b1ea5]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48a97c4-c618-472f-aeba-b6c45f56a8a7]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 (non-flash)
Aug 27 03:04:18 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 (non-flash)
Aug 27 03:04:18 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Connected to 172.16.0.220:3260 {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c75ab8-f001-418c-925f-9a5e61d7817f]: (4, ('- - 0', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:18 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:04:19 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:04:19 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAUdqpKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:04:19 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:04:19 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26261353664613035', 'path': '/dev/sdb'} {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:04:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261353664613035', 'path': '/dev/sdb'} {{(pid=72820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:04:19 user nova-compute[72820]: DEBUG nova.objects.instance [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lazy-loading 'flavor' on Instance uuid 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:04:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 03:04:19 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:04:19 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 03:04:19 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:04:19 user nova-compute[72820]:   <serial>3bcc8a1e-5fe3-4d87-a435-931f4c40bc78</serial>
Aug 27 03:04:19 user nova-compute[72820]: </disk>
Aug 27 03:04:19 user nova-compute[72820]:  {{(pid=72820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:04:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] No BDM found with device name vda, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:04:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:04:19 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] No VIF found with MAC fa:16:3e:39:1d:d2, not building metadata {{(pid=72820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:04:19 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-6ed1adc1-0a94-4678-a101-57f303de87d0 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.066s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:04:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:04:22 user nova-compute[72820]: INFO nova.compute.manager [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Detaching volume 3bcc8a1e-5fe3-4d87-a435-931f4c40bc78
Aug 27 03:04:22 user nova-compute[72820]: INFO nova.virt.block_device [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Attempting to driver detach volume 3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 from mountpoint /dev/vdb
Aug 27 03:04:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Attempting to detach device vdb from instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb from the persistent domain config. {{(pid=72820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:04:22 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:04:22 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 03:04:22 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:04:22 user nova-compute[72820]:   <serial>3bcc8a1e-5fe3-4d87-a435-931f4c40bc78</serial>
Aug 27 03:04:22 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:04:22 user nova-compute[72820]: </disk>
Aug 27 03:04:22 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:04:22 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Successfully detached device vdb from instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb from the persistent domain config.
Aug 27 03:04:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb from the live domain config. {{(pid=72820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.guest [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:04:22 user nova-compute[72820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:04:22 user nova-compute[72820]:   <source dev="/dev/sdb"/>
Aug 27 03:04:22 user nova-compute[72820]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:04:22 user nova-compute[72820]:   <serial>3bcc8a1e-5fe3-4d87-a435-931f4c40bc78</serial>
Aug 27 03:04:22 user nova-compute[72820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:04:22 user nova-compute[72820]: </disk>
Aug 27 03:04:22 user nova-compute[72820]:  {{(pid=72820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-8c1b0988-35a5-4395-91da-5c22c6aa5329 None None] Received event <DeviceRemovedEvent: 1693105462.7387078, 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72820) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.driver [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 03:04:22 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Successfully detached device vdb from instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb from the live domain config.
Aug 27 03:04:22 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] calling os-brick to detach iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f75c04b9990>, {'target_iqn': 'iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAUdqpKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:04:22 user nova-compute[72820]: WARNING os_brick.initiator.connectors.base [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:04:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d0adb1-80f6-48f5-b4be-1380b1ecb8a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Aug 27 03:04:22 user nova-compute[72820]: No targets found.
Aug 27 03:04:22 user nova-compute[72820]: iSNS:
Aug 27 03:04:22 user nova-compute[72820]: No targets found.
Aug 27 03:04:22 user nova-compute[72820]: STATIC:
Aug 27 03:04:22 user nova-compute[72820]: Target: iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78
Aug 27 03:04:22 user nova-compute[72820]:         Portal: 172.16.0.220:3260,-1
Aug 27 03:04:22 user nova-compute[72820]:                 Iface Name: default
Aug 27 03:04:22 user nova-compute[72820]: FIRMWARE:
Aug 27 03:04:22 user nova-compute[72820]: No targets found.
Aug 27 03:04:22 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Aug 27 03:04:22 user nova-compute[72820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Aug 27 03:04:22 user nova-compute[72820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:371}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78', 0)] {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1539c520-14ad-45fd-bca6-ea01514d4120]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1545d21e-65a9-4b32-a487-923970424855]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 (non-flash)\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 (non-flash)
Aug 27 03:04:22 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 (non-flash)
Aug 27 03:04:22 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75a05f7b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78'): ({'sdb'}, set())}) {{(pid=72820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Removing single pathed devices sdb {{(pid=72820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe35557-0e17-49e8-8e8b-8edc40b93b62]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[184c2889-2e2c-408c-97e1-8224211a4c7e]: (4, ('ok\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Flushing IO for device /dev/sdb {{(pid=72820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bdeec1-475a-4758-8289-bfc4f35b9088]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00c262c-4f85-49b6-92eb-a87ea0850d1f]: (4, ('1', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG os_brick.initiator.linuxscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] SCSI volumes sdb have been removed. {{(pid=72820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78')] {{(pid=72820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1010101-dd00-4f83-907c-0001013c4a37]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:04:22 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --logout {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[faab2697-95cc-4062-8d58-b672aa9fe4b9]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78, portal: 172.16.0.220,3260]
Aug 27 03:04:23 user nova-compute[72820]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78, portal: 172.16.0.220,3260] successful.
Aug 27 03:04:23 user nova-compute[72820]:  stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:04:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --op delete {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:23 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bcc8a1e-5fe3-4d87-a435-931f4c40bc78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:23 user nova-compute[72820]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe81dca-3665-4f59-a493-2e7d9970a4b1]: (4, ('', '')) {{(pid=84057) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:04:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:04:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.base [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:04:23 user nova-compute[72820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] <== disconnect_volume: return (277ms) None {{(pid=72820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:04:23 user nova-compute[72820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Disconnected iSCSI Volume {{(pid=72820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:04:23 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:04:23 user nova-compute[72820]: DEBUG nova.objects.instance [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lazy-loading 'flavor' on Instance uuid 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:04:23 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-cfa32894-9c30-4abc-badd-fefb907a165a tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.720s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:04:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:04:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:04:31 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:04:35 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:04:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:04:38 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:04:40 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:04:40 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:04:40 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:04:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:04:42 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:04:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:04:48 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:04:49 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:04:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:04:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:04:49 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:04:49 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:04:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:04:49 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:04:50 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:04:50 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:04:50 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8739MB free_disk=25.073822021484375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:04:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:04:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:04:50 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:04:50 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:04:50 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:04:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:04:50 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:04:50 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:04:50 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:04:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:04:51 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:04:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:04:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:04:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 03:04:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:04:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:04:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:04:58 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:04:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:04:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 03:04:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:04:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:04:58 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:04:58 user nova-compute[72820]: DEBUG nova.objects.instance [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lazy-loading 'info_cache' on Instance uuid 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:04:58 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Updating instance_info_cache with network_info: [{"id": "bab32c26-3329-444a-a85b-d799d989001b", "address": "fa:16:3e:39:1d:d2", "network": {"id": "60f55925-2c0c-4cb5-8594-5077a5ad46c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-573392329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cac0972a24bb4362ab3d814a870cb3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab32c26-33", "ovs_interfaceid": "bab32c26-3329-444a-a85b-d799d989001b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:04:58 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:04:58 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:05:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:05:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:05:09 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:05:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:05:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:05:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:05:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:05:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:05:33 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:05:35 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:05:37 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:05:40 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:05:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:05:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:05:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 03:05:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:05:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:05:40 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:05:41 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:05:41 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:05:42 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:05:43 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:05:45 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:05:50 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:05:50 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:05:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:05:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:05:50 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:05:50 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:05:50 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:05:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:05:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:05:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:05:50 user nova-compute[72820]: DEBUG oslo_concurrency.processutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:05:51 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:05:51 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:05:51 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8731MB free_disk=25.063556671142578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:05:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:05:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:05:51 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:05:51 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:05:51 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:05:51 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:05:51 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:05:51 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:05:51 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:05:55 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:05:59 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:05:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:05:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 03:05:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:05:59 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquired lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:05:59 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Forcefully refreshing network info cache for instance {{(pid=72820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:05:59 user nova-compute[72820]: DEBUG nova.objects.instance [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lazy-loading 'info_cache' on Instance uuid 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:06:00 user nova-compute[72820]: DEBUG nova.network.neutron [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Updating instance_info_cache with network_info: [{"id": "bab32c26-3329-444a-a85b-d799d989001b", "address": "fa:16:3e:39:1d:d2", "network": {"id": "60f55925-2c0c-4cb5-8594-5077a5ad46c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-573392329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cac0972a24bb4362ab3d814a870cb3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab32c26-33", "ovs_interfaceid": "bab32c26-3329-444a-a85b-d799d989001b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:06:00 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Releasing lock "refresh_cache-2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" {{(pid=72820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:06:00 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Updated the network info_cache for instance {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:06:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:06:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 03:06:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:06:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:06:00 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:06:05 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:06:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 03:06:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:06:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:06:10 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:15 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:20 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:06:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 03:06:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:06:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:06:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:30 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:06:31 user nova-compute[72820]: INFO nova.compute.manager [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Terminating instance
Aug 27 03:06:31 user nova-compute[72820]: DEBUG nova.compute.manager [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Start destroying the instance on the hypervisor. {{(pid=72820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-84b92457-f9b2-4f6c-8d14-0aa272e36f3e req-4c1f1e22-dcf9-4dd9-ad0a-990cbb6c4a05 service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Received event network-vif-unplugged-bab32c26-3329-444a-a85b-d799d989001b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-84b92457-f9b2-4f6c-8d14-0aa272e36f3e req-4c1f1e22-dcf9-4dd9-ad0a-990cbb6c4a05 service nova] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-84b92457-f9b2-4f6c-8d14-0aa272e36f3e req-4c1f1e22-dcf9-4dd9-ad0a-990cbb6c4a05 service nova] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-84b92457-f9b2-4f6c-8d14-0aa272e36f3e req-4c1f1e22-dcf9-4dd9-ad0a-990cbb6c4a05 service nova] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-84b92457-f9b2-4f6c-8d14-0aa272e36f3e req-4c1f1e22-dcf9-4dd9-ad0a-990cbb6c4a05 service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] No waiting events found dispatching network-vif-unplugged-bab32c26-3329-444a-a85b-d799d989001b {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG nova.compute.manager [req-84b92457-f9b2-4f6c-8d14-0aa272e36f3e req-4c1f1e22-dcf9-4dd9-ad0a-990cbb6c4a05 service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Received event network-vif-unplugged-bab32c26-3329-444a-a85b-d799d989001b for instance with task_state deleting. {{(pid=72820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:06:31 user nova-compute[72820]: INFO nova.virt.libvirt.driver [-] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Instance destroyed successfully.
Aug 27 03:06:31 user nova-compute[72820]: DEBUG nova.objects.instance [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lazy-loading 'resources' on Instance uuid 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb {{(pid=72820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG nova.virt.libvirt.vif [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T02:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1289349205',display_name='tempest-SnapshotDataIntegrityTests-server-1289349205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1289349205',id=49,image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG32lOvsDNiT4vuJRP/tIL8quML7tAeTS5Br3J4DUK2D7bjBrAG2P1ri1IFjtrLgGJit5FE81DKuoJSi9p3rbJ1MuCqfQybIuKiOWSGXoKq+H4mQd0xN0n9ZlaMuh5I8sA==',key_name='tempest-keypair-1450068098',keypairs=<?>,launch_index=0,launched_at=2023-08-27T02:57:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cac0972a24bb4362ab3d814a870cb3d0',ramdisk_id='',reservation_id='r-14shu0u5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='68b7ab8d-6942-4500-ab2d-968640e48617',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1735637744',owner_user_name='tempest-SnapshotDataIntegrityTests-1735637744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T02:57:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffcf2a6b2a25478396e51631fd874c7e',uuid=2fe2ee1f-9fce-4bf4-8571-31de5e6747bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bab32c26-3329-444a-a85b-d799d989001b", "address": "fa:16:3e:39:1d:d2", "network": {"id": "60f55925-2c0c-4cb5-8594-5077a5ad46c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-573392329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cac0972a24bb4362ab3d814a870cb3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab32c26-33", "ovs_interfaceid": "bab32c26-3329-444a-a85b-d799d989001b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Converting VIF {"id": "bab32c26-3329-444a-a85b-d799d989001b", "address": "fa:16:3e:39:1d:d2", "network": {"id": "60f55925-2c0c-4cb5-8594-5077a5ad46c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-573392329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cac0972a24bb4362ab3d814a870cb3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab32c26-33", "ovs_interfaceid": "bab32c26-3329-444a-a85b-d799d989001b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG nova.network.os_vif_util [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:1d:d2,bridge_name='br-int',has_traffic_filtering=True,id=bab32c26-3329-444a-a85b-d799d989001b,network=Network(60f55925-2c0c-4cb5-8594-5077a5ad46c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbab32c26-33') {{(pid=72820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:06:31 user nova-compute[72820]: DEBUG os_vif [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:1d:d2,bridge_name='br-int',has_traffic_filtering=True,id=bab32c26-3329-444a-a85b-d799d989001b,network=Network(60f55925-2c0c-4cb5-8594-5077a5ad46c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbab32c26-33') {{(pid=72820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:06:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbab32c26-33, bridge=br-int, if_exists=True) {{(pid=72820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:06:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:06:32 user nova-compute[72820]: INFO os_vif [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:1d:d2,bridge_name='br-int',has_traffic_filtering=True,id=bab32c26-3329-444a-a85b-d799d989001b,network=Network(60f55925-2c0c-4cb5-8594-5077a5ad46c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbab32c26-33')
Aug 27 03:06:32 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Deleting instance files /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb_del
Aug 27 03:06:32 user nova-compute[72820]: INFO nova.virt.libvirt.driver [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Deletion of /opt/stack/data/nova/instances/2fe2ee1f-9fce-4bf4-8571-31de5e6747bb_del complete
Aug 27 03:06:32 user nova-compute[72820]: INFO nova.compute.manager [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 27 03:06:32 user nova-compute[72820]: DEBUG oslo.service.loopingcall [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:06:32 user nova-compute[72820]: DEBUG nova.compute.manager [-] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Deallocating network for instance {{(pid=72820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:06:32 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] deallocate_for_instance() {{(pid=72820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:06:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:33 user nova-compute[72820]: DEBUG nova.network.neutron [-] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Updating instance_info_cache with network_info: [] {{(pid=72820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:06:33 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Took 0.98 seconds to deallocate network for instance.
Aug 27 03:06:33 user nova-compute[72820]: DEBUG nova.compute.manager [req-c0f42f3e-4fda-4dff-8ab6-8be765bef6f6 req-0d185191-7c98-4e1e-9ac7-bd1a9251fc72 service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Received event network-vif-deleted-bab32c26-3329-444a-a85b-d799d989001b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:06:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:06:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:06:33 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:06:33 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:06:33 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:06:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:06:33 user nova-compute[72820]: INFO nova.scheduler.client.report [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Deleted allocations for instance 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb
Aug 27 03:06:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-2f701df7-963f-462f-971e-a50a7d9cc283 tempest-SnapshotDataIntegrityTests-1735637744 tempest-SnapshotDataIntegrityTests-1735637744-project-member] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.447s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:06:33 user nova-compute[72820]: DEBUG nova.compute.manager [req-d1332924-b58b-4f35-8181-1c24a611efb6 req-bcfc9670-8355-48ce-8081-3a3c7177f811 service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Received event network-vif-plugged-bab32c26-3329-444a-a85b-d799d989001b {{(pid=72820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:06:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d1332924-b58b-4f35-8181-1c24a611efb6 req-bcfc9670-8355-48ce-8081-3a3c7177f811 service nova] Acquiring lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:06:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d1332924-b58b-4f35-8181-1c24a611efb6 req-bcfc9670-8355-48ce-8081-3a3c7177f811 service nova] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:06:33 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [req-d1332924-b58b-4f35-8181-1c24a611efb6 req-bcfc9670-8355-48ce-8081-3a3c7177f811 service nova] Lock "2fe2ee1f-9fce-4bf4-8571-31de5e6747bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:06:33 user nova-compute[72820]: DEBUG nova.compute.manager [req-d1332924-b58b-4f35-8181-1c24a611efb6 req-bcfc9670-8355-48ce-8081-3a3c7177f811 service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] No waiting events found dispatching network-vif-plugged-bab32c26-3329-444a-a85b-d799d989001b {{(pid=72820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:06:33 user nova-compute[72820]: WARNING nova.compute.manager [req-d1332924-b58b-4f35-8181-1c24a611efb6 req-bcfc9670-8355-48ce-8081-3a3c7177f811 service nova] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Received unexpected event network-vif-plugged-bab32c26-3329-444a-a85b-d799d989001b for instance with vm_state deleted and task_state None.
Aug 27 03:06:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:39 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:06:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:06:42 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:06:42 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:06:43 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:06:43 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:06:43 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:06:46 user nova-compute[72820]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693105591.9727488, 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb => Stopped> {{(pid=72820) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:06:46 user nova-compute[72820]: INFO nova.compute.manager [-] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] VM Stopped (Lifecycle Event)
Aug 27 03:06:46 user nova-compute[72820]: DEBUG nova.compute.manager [None req-17c38848-6425-4a62-ab6b-3df00871ed6f None None] [instance: 2fe2ee1f-9fce-4bf4-8571-31de5e6747bb] Checking state {{(pid=72820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:06:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:06:48 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:06:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:06:52 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:06:52 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:06:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:06:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:06:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:06:52 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:06:52 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:06:52 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:06:52 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=8925MB free_disk=25.090614318847656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:06:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:06:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:06:52 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:06:52 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:06:53 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing inventories for resource provider a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 03:06:53 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Updating ProviderTree inventory for provider a962b30a-2750-431c-be10-075d0f991065 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 03:06:53 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Updating inventory in ProviderTree for provider a962b30a-2750-431c-be10-075d0f991065 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 03:06:53 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing aggregate associations for resource provider a962b30a-2750-431c-be10-075d0f991065, aggregates: None {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 03:06:53 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Refreshing trait associations for resource provider a962b30a-2750-431c-be10-075d0f991065, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 03:06:53 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:06:53 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:06:53 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:06:53 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:06:53 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:06:53 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 03:06:57 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:06:59 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:06:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Starting heal instance info cache {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:06:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Rebuilding the list of instances to heal {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 03:06:59 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Didn't find any instances for network info cache update. {{(pid=72820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 03:07:02 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:07:07 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:07:11 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:07:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Cleaning up deleted instances {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 03:07:11 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] There are 0 instances to clean {{(pid=72820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 03:07:12 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:07:13 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:07:17 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:07:20 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:07:21 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:07:22 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:07:25 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:07:27 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:07:28 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:07:32 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:07:34 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:07:37 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:07:39 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:07:42 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:07:42 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:07:43 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:07:44 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:07:45 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:07:45 user nova-compute[72820]: DEBUG nova.compute.manager [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:07:47 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:07:52 user nova-compute[72820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:07:52 user nova-compute[72820]: DEBUG oslo_service.periodic_task [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:07:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:07:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:07:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:07:52 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Auditing locally available compute resources for user (node: user) {{(pid=72820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:07:52 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:07:52 user nova-compute[72820]: WARNING nova.virt.libvirt.driver [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:07:52 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Hypervisor/Node resource view: name=user free_ram=9085MB free_disk=25.039897918701172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:07:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:07:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:07:52 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:07:52 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:07:52 user nova-compute[72820]: DEBUG nova.compute.provider_tree [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed in ProviderTree for provider: a962b30a-2750-431c-be10-075d0f991065 {{(pid=72820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:07:52 user nova-compute[72820]: DEBUG nova.scheduler.client.report [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Inventory has not changed for provider a962b30a-2750-431c-be10-075d0f991065 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:07:52 user nova-compute[72820]: DEBUG nova.compute.resource_tracker [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Compute_service record updated for user:user {{(pid=72820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:07:52 user nova-compute[72820]: DEBUG oslo_concurrency.lockutils [None req-29d0217b-81fb-42e2-a5ca-8f7fa59afa9a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=72820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}